Smart companies will experiment with small generative AI applications to gain the skills and confidence to try bolder projects. Credit: Martin Bergsma / Shutterstock Just like big data back in 2013, we’re in the “everyone’s doing it, no one knows why” phase of generative AI (genAI). A recent McKinsey survey found that 65% of enterprises are “regularly using genAI.” Promising! In Elastic’s recent earnings call, the company noted that over 1,000 customers are paying to build genAI applications. Wow! Each of the big cloud companies, as well as Oracle, has talked up how genAI is driving cloud spend. Amazing! Maybe. Maybe not. Peel back the headlines and we’re still seeing genAI as aspirational, not necessarily transformational for most companies. For example, while touting all its customers building genAI applications, Elastic CEO Ash Kulkarni also said, “We are not modeling significant revenue contribution from genAI this year.” In other words, 1,000 companies are not paying very much, largely because they’re not doing very much. That’s not a slight on Elastic; rather, it’s the reality of where we’re at with genAI today. The clouds are mostly fattening their AI revenues through training models, rather than enterprises using those models to draw inferences from that data in applications. In other words, if you have yet to transform your business with AI, you’re not alone. You have time. Still early for genAI I wrote about this recently and won’t belabor the same points (i.e., rather than big genAI projects, the enterprises finding real success tend to be doing better search through retrieval-augmented generation (RAG). According to the McKinsey survey, enterprises have yet to figure out where exactly to use genAI. Only two use cases (“content support for marketing strategy” and “personalized marketing”) were cited by at least 15% of respondents. There are some IT help desk chatbots (7% of respondents) and design development (10%), but for the most part, everything else is largely a rounding error. Enterprises are kicking the tires, to put it nicely. Other data from the survey creates more questions than it answers. For example, the report said, “Respondents most commonly report meaningful revenue increases (of more than 5%) in supply chain and inventory management,” yet just 6% of enterprises in that market report regularly using genAI. If it’s working so well to drive revenue, wouldn’t more companies be doing it? Again, this isn’t to suggest that genAI, and AI more broadly, won’t have a significant impact. Rather, it’s indicative that we are early in the adoption cycle. Get started. Break things I suspect one key reason that sales and marketing is the biggest area for genAI within enterprises, according to the McKinsey survey, is the perception that these are areas a company can “get wrong.” I don’t mean that these areas are unimportant. I just mean you’d probably rather have an LLM hallucinate on an early version of marketing copy than your income statement. According to McKinsey, the top genAI performers tend to be those that “have experienced every negative consequence from genAI we asked about, from cybersecurity and personal privacy to explainability and IP infringement.” They’ve been burned by genAI and learned from the experience. It’s best to learn the ropes with activities that are behind the firewall and relatively low risk. These same high performers run more genAI workloads than their peers (they use genAI in three functions on average; less-experienced companies average two) because they’ve figured out how to manage the risks of rough edges. They also have more advanced risk-mitigation strategies, says McKinsey, and then become “more than three times as likely as others to be using genAI in [more advanced] activities ranging from processing of accounting documents and risk assessment to R&D testing and pricing and promotions.” They’ve also run into problems with data: 70% of high performers cite problems with data, including figuring out data governance processes or lacking sufficient training data. You don’t run into these problems (and learn from them), if you aren’t willing to experiment and risk breaking things. Returning to Elastic’s 1,000 customers paying to build genAI applications, this is great news for Elastic, as well as the industry, regardless of near-term financial impact. As the company’s executives said, genAI will be “a significant growth driver for us in the long term,” even though “customers are still in the early stages of the adoption cycle.” The way all enterprises are going to go from early tire-kicking to enterprise transformation is to start small, break a few things, and gain the experience and confidence to go bigger with genAI. More by Matt Asay: Your generative AI project is going to fail AI’s moment of disillusionment Are we thinking too small about generative AI? Related content analysis Azure AI Foundry tools for changes in AI applications Microsoft’s launch of Azure AI Foundry at Ignite 2024 signals a welcome shift from chatbots to agents and to using AI for business process automation. By Simon Bisson Nov 20, 2024 7 mins Microsoft Azure Generative AI Development Tools news Microsoft unveils imaging APIs for Windows Copilot Runtime Generative AI-backed APIs will allow developers to build image super resolution, image segmentation, object erase, and OCR capabilities into Windows applications. By Paul Krill Nov 19, 2024 2 mins Generative AI APIs Development Libraries and Frameworks feature A GRC framework for securing generative AI How can enterprises secure and manage the expanding ecosystem of AI applications that touch sensitive business data? Start with a governance framework. By Trevor Welsh Nov 19, 2024 11 mins Generative AI Data Governance Application Security news Go language evolving for future hardware, AI workloads The Go team is working to adapt Go to large multicore systems, the latest hardware instructions, and the needs of developers of large-scale AI systems. By Paul Krill Nov 15, 2024 3 mins Google Go Generative AI Programming Languages Resources Videos