Data measured in a 5min interval - Which programming language. use? [closed]

-1

Work with automatic measurements every 5 minutes in a database, as illustrated:

I usually use Excel to do analysis (sum, mean, distribution, etc.). However, due to the large volume of data, about 500 thousand lines, excel does not account for processing. I would like to make an application that only performs the analyzes I need, but I do not know what would be the most correct way of storing the data (csv, txt, mysql, etc.) or which programming language is most suitable for data processing of this type.

I would like your opinion.

    
asked by anonymous 21.11.2014 / 16:26

1 answer

0

I work with CSV's that have large sizes like 10Gb, 12Gb and so on. Basically I use Python with some libraries that help me in performance and facilitate some operations, take a look:

Pandas: link NumPy: link

    
21.11.2014 / 16:35