Torbjorn Zetterlund

Thu 22 2019

What is going on with BigData

by bernt & torsten

If you are following what is going on in BigData, you know that there is current chaos in the BigData ecosystem.

This year we have seen a seemingly endless wave of acquisitions, some that really proportional: Salesforce acquired Tableau and Google acquired Looker  CommVault purchased Hedvig, Cloudera bought Arcadia Data, Logi Analytics bought Zoomdata, Sisense bought Periscope Data, and Alteryx bought ClearStory and the year is not over, we will see more acquisition before the end of the year.

There were other developments this year, Hadoop’s decline further increased this year with Cloudera’s stock price dropping in June and MapR’s value plunging. With so much enterprise data enmeshed within Hadoop, its decline raises a lot of uncertainty.

With all these shakeups in the data world, there are few things that will take place of ver the end of this year and the next.

There will be more acquisition

We’re seeing a natural progression as businesses seek to maximize their investments in business intelligence (BI) – gaining faster, simpler, and more accurate insights. BI is moving out of the hands of data scientists teams and into the hands of the business decision-makers – due to these facts we’re going to see more acquisition on the BI side and less on the presentation side.

AI is important

Companies are moving forward in their big data life cycle. The phase of establishing data discipline – i.e. achieving the capability of not throwing away any data has passed. What companies are looking for actionable and accessible insights from their data. If you have large data sets only AI-powered machine learning make sense to seriously impact revenues and competitive edge.

Focus on cloud applications

Running your own BI inhouse with your own on-prem processing power processing massive data sets is very expensive. inhouse BI technology was built for batch processing. Serverless application services by Cloud providers are now offering BI solutions in the cloud that outweighs the in-house built technology. More and more business abandon their in-house BI technology and migrating their data to the cloud.

In conclusion

Watching the big data space, it will be interesting to watch how Data-centric solution companies are positioning themselves, what acquisition will be made. The BigData technology is to allow more and more of business staff, being able to create their own dashboard for their department or business unit and not rely on a data group department made up of data scientist and data analyst to build the organizations’ dashboards and reporting. The business should organize the data group department to focus on delivering data sets in cloud for the rest of the business units to make reports and dashboards on.