DailyPost 602
BIG DATA IN PRACTICE
While Big Data fundas, the tools & the ecosystem remains a matter of immense discussion, taking a fad to concrete business results, is what diehard practitioners do. Though the base concepts remain the same their concept, vision, plan & execution makes the difference. First things first. The creation of data; data does not get created out of the blue. The more the transactions, more the data points. Data point is the genesis of data.
Making meaning out of the vast amount of data available in whatever datasets & databases is Big Data Analytics. Prof. Daphne Koller, a renowned ML practitioner in Biology / Health area says data sets suited to the problem statement, gives best results, with appropriate machine learning tools being used. For IBM Watson & other’s health is ML’s attraction.
The Mecca of Big Data is CERN, the international scientific research organisation, that operates Large Hadron Collider(LHC), humanity’s biggest & most advanced physics experiment. Tim Berners-Lee, the father of the Internet, developed the hypertext protocol which holds the together the worldwide web while at CERN. The LHC generates 30 petabytes of information per year – 15 trillion pages of printed text, enough to fill 600 million filling cabinets – clearly Big Data by anyone’s standards! Data is used to search for elusive theoretical particles & also probe answers to anti-matter, dark matter & extra dimensions of time & space. Data is collected by sensors inside the collider that monitors hundreds of millions of particle collisions every second. This data is then analysed by algorithms tuned to pick up telltale signatures left behind by the appearance & disappearance of the exotic particles CERN is searching for.
Social media giants like LinkedIn use stream processing technology, working on Big Data, streaming upto date data, analysed data in real time. An excellent real time Analytics Process.
MORE USED CASES LEADS TO MATURING OF BOTH TECHNOLOGY & THE PROCESS.
Sanjay Sahay