Work with automatic measurements every 5 minutes in a database, as illustrated:
I usually use Excel to do analysis (sum, mean, distribution, etc.). However, due to the large volume of data, about 500 thousand lines, excel does not account for processing. I would like to make an application that only performs the analyzes I need, but I do not know what would be the most correct way of storing the data (csv, txt, mysql, etc.) or which programming language is most suitable for data processing of this type.
I would like your opinion.