Prophecy Finds GenAI Boosting Data Team Productivity by Up to 50%
PALO ALTO, Calif., Feb. 19, 2025 -- Generative AI (GenAI) has come to the enterprise data team, and expectations are sky-high. A new survey of data and analytics executives by Wakefield Research on behalf of data copilot company Prophecy finds data departments are well underway with GenAI, with early adopters seeing huge gains in productivity.
Among data teams using GenAI, nearly half (41%) are seeing productivity growth of 15%-30% for overall data delivery. Even more (46%) report jumps of 31%-50%. Given average GenAI productivity gains of 25%, these results suggest data teams stand to gain at least as much, or more, from GenAI than other parts of the enterprise.
Adoption is moving fast. Overall, 64% of data teams are already using GenAI, and every organization surveyed has, at minimum, plans to use GenAI in the future. A remarkable 23% say their GenAI efforts are already "fully scaled." The most common use case is automatic data curation (58%), with conversational analytics (51%) and data tests and quality (51%) running a close second and third.
Top management is on board—and sometimes leading the charge. A quarter of executives (25%) say their leaders will greenlight any project "with AI as a core component," though the largest group (44%) are a bit more cautious, seeing the need for AI investment while putting at least some guardrails on the process.
Despite widespread enthusiasm for GenAI, data executives see obstacles to adoption as well. The issue most commonly cited (36%) is the need for better data governance, while 24% say faster access to data is the most significant hurdle. A substantial minority (36%) say all GenAI projects require review at a company-wide level, potentially bottlenecking innovation and development at those organizations.
Hiring is another roadblock. Most organizations (67%) have between 100 and 1,000 data sources, and 60% provide data to between 100 and 1,000 downstream users. Hiring and training staff to wrangle all this data is a constant challenge. More than half of organizations (53%) struggle to find and hire highly skilled data engineers, while 50% say it's a challenge to onboard and ramp new employees, and 53% to scale team capabilities to meet growing data demands.
"GenAI has clearly landed in data teams and organizations are already getting value. Over the next few years, GenAI will transform data operations top to bottom — from data management to data transformation to data integration, and everything in between. It's a secular shift in the industry," said Prophecy CEO Raj Bains. "The challenge is to capture the value of GenAI while maintaining the highest standards of security, governance and reliability amid a worldwide shortage of talent. Rather than try to build everything from scratch, the most successful organizations will accelerate their deployments by making smart use of commercial data solutions powered by GenAI and proven to work in Fortune 500-class environments."
The survey was conducted by Wakefield Research among 500 US data and data analytics executives with a minimum seniority of Director, at companies with a minimum annual revenue of $1B USD, between November 22nd and December 3rd, 2024, using an email invitation and an online survey.
For a deep dive into the findings, join Prophecy's session The Impact of GenAI on Data Teams at Gartner Data & Analytics Summit 2025 in Orlando, March 5, 2025. To download the full report, visit the Prophecy website here.
About Prophecy
Prophecy is the data copilot company. Fortune 500 enterprises — including the largest institutions in banking, insurance, healthcare and life sciences and technology — rely on Prophecy Data Transformation Copilot to accelerate AI and analytics by delivering data that is clean, trusted and timely. Prophecy enables all data users and makes them productive by helping develop, deploy and observe data pipelines on cloud data platforms. Organizations trust Prophecy for the most demanding workloads, including tens of thousands of data pipelines that deliver massive volumes of data for AI and analytics.
Source: Prophecy
