Home / News / Data management investments often stumble, survey finds

Data management investments often stumble, survey finds

All of the periods from Become 2021 are to be had on-demand now. Watch now.

The majority of the investments made in information control platforms to this point has no longer been cash neatly spent, in keeping with a Knowledge Worth Scorecard revealed nowadays through information lake platform Dremio.

The scorecard reveals handiest 22% of the information leaders surveyed mentioned they’ve totally discovered a go back on funding (ROI) in information control previously two years.

Doubtlessly extra troubling, over part of respondents (56%) admitted that in relation to information control they’ve no possible way of constantly measuring ROI. The scorecard is according to a survey of 500 information and analytics leaders at undertaking IT organizations within the U.S., U.Okay., Germany, Denmark, Sweden, Norway, Australia, Hong Kong, and Singapore.

Knowledge get entry to

The survey, in collaboration with Wakefield Analysis, notes that greater than three-quarters of respondents (76%) are these days locked into no less than one closed device. The ones proprietary platforms additionally make it tough for analysts to get entry to the entire doubtlessly related information they want in a well timed approach, Dremio CEO BillyBosworth famous.

80-four % of information leaders surveyed mentioned it’s standard for information analysts at their corporate to paintings with a partial dataset. Most effective 16% mentioned they be expecting the information control platform they make use of to make recent information to be had in a question of hours or mins. Greater than part (51%) mentioned it takes their group weeks to replace information saved of their present platform. This factor is particularly problematic as a result of maximum virtual industry processes wish to happen in close to actual time, Bosworth added.

A complete of 79% of respondents additionally famous they’ve issues concerning the degree scale that may be completed the use of their present platforms.

Control problems

In spite of everything, the survey makes it transparent organizations are suffering with information control. Survey respondents on reasonable mentioned they make 12 copies in their information to verify it’s to be had for all customers. A complete of 60% document their corporate has greater than 10 copies of such information. A complete 82% mentioned their finish customers have used inconsistent variations of the similar dataset on the similar time because of bulky extract turn into and cargo (ETL) processes which might be required to transport information into a knowledge control platform.

Total, the scorecard suggests handiest about 20% of organizations are effectively managing their information, with 28% of respondents claiming it’s “really easy” for finish customers to get entry to information and broaden insights. Most effective 20% mentioned timelines for ETL initiatives are “hardly ever or by no means” underestimated, whilst an equivalent proportion mentioned their corporate has “little to no” restrictions on information get entry to for governance.

The truth that many organizations set up information poorly controlled is likely one of the grimy little secrets and techniques undertaking IT leaders don’t like to recognize. Maximum information is created inside the context of an software used inside a line of industrial. The information created through each and every of the ones programs is continuously conflicting and inconsistent. That factor is now coming to a head as a result of virtual industry transformation projects that depend on analytics and synthetic intelligence (AI) want get entry to to dependable information to correctly automate a procedure.

Cleansing up that mess creates a chance for centralized IT groups to develop into extra related. No line of industrial unit is in a position to combination the entire information required to pressure a virtual procedure on their very own, Bosworth famous. “Maximum organizations have come to that realization,” he mentioned.

Knowledge garage

Dremio is creating a case for changing information warehouses operating on-premises or within the cloud with a knowledge lake that leverages affordable cloud garage to make petabytes of information to be had by way of SQL queries. Bosworth argues that as extra information is saved within the cloud, IT organizations wish to set up information totally unbiased of each the programs hired to create it and the infrastructure used to retailer it.

Reaching that function turns into more uncomplicated when information is saved, for instance, in an open cloud garage provider that allows IT organizations to profit from a centrally controlled information lake platform to spot and set up information in a extra constant approach, Bosworth mentioned.

This isn’t the primary time a case is being made for using information lakes as an alternative choice to information warehouses. Many organizations tried to construct information lakes according to open supply Hadoop platforms. However the ones efforts continuously resulted within the introduction of information swamps, just because organizations lacked the equipment and processes to successfully set up terabytes of information. Because of this, many organizations nowadays are continuously reluctant to release any other information lake initiative.

With regards to general information control adulthood, no two undertaking IT organizations are alike. Then again, it’s turning into increasingly more obvious that the power of any group to compete in a global depending on virtual processes will come all the way down to how neatly they set up the information that drives the ones processes.


VentureBeat’s venture is to be a virtual the town sq. for technical decision-makers to realize wisdom about transformative era and transact.

Our website delivers crucial knowledge on information applied sciences and methods to lead you as you lead your organizations. We invite you to develop into a member of our group, to get entry to:

  • up-to-date knowledge at the topics of pastime to you
  • our newsletters
  • gated thought-leader content material and discounted get entry to to our prized occasions, equivalent to Become 2021: Be told Extra
  • networking options, and extra

Grow to be a member


Check Also

Data observability platform Bigeye lands 45M 310x165 - Data observability platform Bigeye lands $45M

Data observability platform Bigeye lands $45M

The Develop into Generation Summits get started October 13th with Low-Code/No Code: Enabling Endeavor Agility. …