Home » Meeting » (Data) Size Matters!

(Data) Size Matters!

These days I’m attending a conference in Frascati, on the beautiful hills surrounding Rome, about large space satellite datasets and their exploitation. Most of the sessions so far have been about new data processing infrastructures and technologies and Earth Observations, but this morning’s session (opened by the excellent keynote by Naples’ Peppe Longo of DAME fame) is about Big Data in Astronomy, and some of the most ambitious upcoming astronomical ground-based projects such as LSST and SKA have also sneaked into the program. Throughout, much emphasis is being put on bridging the gap between the software engineering layer required to store the data and the actual scientific exploitation, including customizing Data Mining and Machine Learning techniques to Astronomy. And for those who were wondering: at a nominal data rate of 1 Exabyte / day (that’s a million Terabyte, or a billion Gigabyte, per day), the Square Kilometre Array perhaps unsurprisingly leads the pack;-)

Leave a Reply