Research from TDWI and ThoughtSpot, the leader in search & AI-driven analytics, reveals the emergence of a new generation of business analysts as organizations modernize their analytics capabilities and aim to unlock the value of ever increasing amounts of data. 

The report, “The Modern Analyst: Meeting Tomorrow’s Challenge” surveys 430 data and analytics professionals including six industry sectors in North America, Europe, and Asia Pacific. The study found that analysts at most organizations are not reporting success from their analytics projects. To do so, analysts must evolve their role to empower others, namely nontechnical business users to understand data, uncover insights on their own, and improve decision-making. In the process, these analysts will be able to upskill, focus on more strategic business initiatives, and unlock new career opportunities.

The research also says that enterprises aren’t fully tapping the value of their analysts. Simultaneously, analysts want to be delivering greater impact to their broader organization. Currently, business analysts are spending a disproportionate amount of time compiling reports and dashboards rather than focusing on the insights emerging from such data reports for strategic initiatives. 

The majority (66%) of respondents say less than 80% of their reports provide value for the organization at all. Over one-third (35%) want to spend more time understanding strategic business initiatives to deliver more impactful business outcomes and value for their organizations. Analysts in North America are particularly likely to note analytics projects haven’t been successful, with roughly 70% stating their analytics efforts to date have not been successful in generating measurable value, while 56% of EMEA respondents and 44% of APAC respondents report the same.

The research shows analysts want to transition into the next generation of data professionals, scale their efforts to more business users, and be more strategic partners to their organizations. In order to do so, however, businesses must reduce the dependency of their business users on analysts and traditional reports. Instead, they must democratize analytics so business users can access data on their own, freeing analytics teams tied down with reporting and to learn new skills and evolve.

In fact, 44% of respondents cite the need to democratize analytics as the top change necessary to become more productive, efficient, and strategic in their roles. Training is also a top priority, with 41% of respondents wanting to see more training for data and analytics professionals. To that end, over one-third of organizations would like to see technologies and tools automate the process to surface insights (38%) and build data pipelines and in data preparation (36%). Historically, organizations have spent too much time compiling data for analytics while only reserving a quarter of that time for the actual analysis. New tools and technology simplify this process and frees up time for analysts to dedicate to strategic analysis.

The research says organizations aren’t able to realize the benefits of modern analytics and the evolving analyst role without overcoming barriers. Data infrastructure (49%) and data literacy (39%) are listed as the top challenges for organizations, especially as they move to democratize analytics. Data literacy is more likely to be cited as a challenge by EMEA organizations (47%) when compared to their North American (38%) and APAC (26%) counterparts.

Organizations in the telecommunication, Internet, and technology sectors have been successful at overcoming these obstacles, with respondents being more likely than other industries to say that their analytics journey has been a success. In fact, 63% of these companies are in the process of upskilling or have already upskilled some of their business analysts in more advanced technology. On the other hand, government organizations lag behind in analytics technology maturity, with 50% primarily using spreadsheets, reports, and dashboards for their analytics.

“Organizations that utilize sophisticated analytics and data driven decision-making are more likely to realize benefits such as top-line growth, higher customer satisfaction, and more effective and efficient operations than those that do not,” says Dr. Fern Halper, vice president & senior research director, TDWI Research. “As organizations are facing pressures to operate in today’s digital economy, they need to modernize their analytics to meet current and future requirements. Looking forward, analysts have a unique role to play in terms of providing strategic insights to their organizations and as coaches and mentors to others.”