Identifying important information in Big Data to answer real world challenges
Over the past one year, knowingly or unknowingly, Big Data has become the biggest buzzword enterprises are finding hard to pass. Believe it or not, according to the current dependence on Big Data and its allied technologies, we can assume that Big Data is here to stay, and we all will have to use it to address our real world problems.
The way in which Big Data technologies have evolved in the real word enterprise goes on to show that even technologists and scientists who might have disparaged the word (Big Data) previously, will now be acknowledging it.
Like everything has loopholes, Big Data isn’t any different. Big Data problems are basically issues caused not because of the unavailability of data, but by the abundance of available data. There is so much influx of data that is rather impossible to know which piece of information is actually important and how different important information pieces can be put together for meaningful information.
Researching on a general way to understand complex systems and to answer the biggest question that Big Data can’t answer – ‘how to know what’s important in complex world?’ president and scientist of the New England Complex Systems Institute Yaneer Bar-Yam has devised a trick to identify patterns in largest scale of behavior. Bar-Yam has revealed his findings in the article titled “Beyond big data: Identifying important information for real world challenges”
According to Yaneer, to understand and address most social and biological challenges, it is important to frame a scientific inquiry with an idea to objectively conclude what is important or unimportant instead of amassing larger and larger sets of data.
Yaneer explains that the identified patterns of behavior determined from handful of information are the key to understanding a system and to inform how the behavior can be influenced in the future.
Yaneer Bar-Yam and his team have used the successful tested this approach by predicting various complex systems and real world challenges like market crashes, ethnic violence, food prices and many more biological and complex social systems.
Consider Reading to these articles: