Next Up For AI Chatbots: It’s All About The APIs
Next Up For AI Chatbots: It’s All About The APIs
The magical demos displayed the capability. Now the platform wars begin.
The chatbots did their job. They inspired awe, mockery, and even some fear. Most importantly, they drew attention. Front-page headlines, cover stories, and word of mouth caused millions to try them, leading businesses and developers to ask how they could put the technology to use.
The APIs, of course, were always the point. ChatGPT and Bing’s chatbot were never the end product. They were demos meant to sell other companies on tools they could use to build their own. And it worked. Now, the war to build the leading generative AI platform is underway.
“For OpenAI, the vast majority of the money they will ever make will come from developers,” Ben Parr, president of Octane AI, told me via phone Thursday. “ChatGPT is just the entry road into everything else.”
Even before this wave of AI chatbots reached the public, the companies behind them prepared APIs for developers. When ChatGPT gained momentum in January, OpenAI president Greg Brockman teased an API “coming soon.” That same week, Microsoft made OpenAI models available through Azure. On the day Google introduced its BARD chatbot, CEO Sundar Pichai promised to make some of the underlying technology available by March. And this week, just a bit late, Amazon announced it would partner with Hugging Face to make a generative language tool available through AWS.
“Everybody who develops software is either alerted, or shocked into alert, or actively working on something that is like ChatGPT to be integrated into their application, or integrated into their service,” NVIDIA CEO Jensen Huang said during his company’s earnings call Wednesday. NVIDIA provides the chips the tech runs on, so it stands to benefit too. Its stock jumped 14% Thursday.
Finding broad, useful applications for generative AI will be challenging, but some obvious early applications stand out. Customer service departments, for instance, could use chatbots that can hold a conversation. Gaming companies could build intelligent characters and make NPCs a thing of the past. And marketers could attempt to use generative language models to forge deeper bonds with customers.
This is all moving fast. On Tuesday, OpenAI announced it had partnered with Bain to help clients build on its API. Zack Kass, OpenAI’s chief customer officer, said in a launch video that OpenAI couldn’t keep up with the interest in its technology. “We are inundated at this point with enterprise demand that we sort of waited for, for a long time, and here it is,” he said. “Now we just need to figure out how we field it.”
Later in the video, Coca-Cola executives said they planned to use the tech in their marketing efforts “to deliver creative content at speed.” Coca-Cola CEO James Quincey also mentioned he believed the tech would change knowledge work, but without going into specifics.
Coca-Cola is a fitting launch partner. In a recent presentation, investor Chamath Palihapitiya mentioned that Coke succeeded thanks to another invention: refrigeration. Coca-Cola made more money than the people that invented the refrigerator, he said, and that could happen here too. “If AI/LLMs are the refrigeration,” he asked. “Who will be the next Coca-Cola?”
The companies that enable successful AI applications — the refrigeration, in Palihapitiya’s analogy — still stand to benefit tremendously though. And so those developing the underlying technology are doing what they can to help launch the next big thing on their platform, and perhaps take a chunk of it too. OpenAI, for instance, has a $100 million startup fund meant to work with AI companies in health care, climate, education, and elsewhere. “Look at some of the companies that OpenAI’s invested in,” said Parr. “There are real use cases.”
The APIs, amid the commotion, are what matter. They’re why Microsoft was willing to release an unproven chatbot into Bing, even when it knew it was a bit crazy. And why the company didn’t seem to mind when the bot's flaws exploded into public view. It was never about Bing or ChatGPT, but about the potential future they previewed. And now, given the demos’ success, the race to enable that future is underway.
Mow Money, Less Problems (Sponsored)
The landscaping industry faces a critical labor shortage, with 1 in 3 landscapers working for less than a full year on the job. Graze is giving commercial landscapers a way to stabilize the churn: fully electric, autonomous lawnmowers that have the potential to increase landscaper profit margins by 5X. What does that mean for you? They’re giving our readers the opportunity to invest in the company for a limited time.
What Else I’m Reading, Etc.
The four-day workweek might actually make sense [WSJ]
Spotify has a robot DJ [Techcrunch]
JP Morgan bans ChatGPT at the office [WSJ]
Elon Musk laid off even more sales staff at Twitter [The Verge]
Turkey bans original social media site, Eksi Sozluk [Bloomberg]
James O’Keefe is out at Project Veritas [Washington Post]
Why the 90s were the best decade [Freddie deBoer]
Casey Neistat tests motor-powered sneakers [YouTube]
See a story you like? Tweet it with “tip @bigtechnology” for consideration in this section
Number Of The Week
$200 billion
Sales powered through Shopify last year, 45% as big as Amazon’s marketplace (Via Benedict Evans, slide 43).
Quote Of The Week
"We're a Court. We really don't know about these things. These are not, like, the nine greatest experts on the Internet."
Supreme Court Justice Elena Kagan in the Gonzalez v. Google case.
Advertise with Big Technology?
Advertising with Big Technology gets your product, service, or cause in front of the tech world’s top decision-makers. To reach 115,000+ plugged-in tech insiders, reply to this email or write alex.kantrowitz@gmail.com
This Week On Big Technology Podcast: Blake Lemoine and Gary Marcus Debate AI Chatbots
Blake Lemoine is the ex-Google engineer who concluded the company's LaMDA chatbot was sentient. Gary Marcus is an academic, author, and outspoken AI critic. The two join Big Technology Podcast to debate the utility of AI chatbots, their dangers, and the actual technology they're built on. Join us for a fascinating conversation that reveals much about the state of this technology. There's plenty to be learned from the disagreements, and the common ground as well.
You can listen on Apple, Spotify, or wherever you get your podcasts.
Thanks again for reading. Please share Big Technology if you like it!
And hit that Like Button if you love digital red hearts like you love APIs.
Questions? Email me by responding to this email, or by writing alex.kantrowitz@gmail.com
News tips? Find me on Signal at 516-695-8680
I agree with the demo argument. It will be interesting to see more use cases for specific industry verticals (e.g. DocsGPT in healthcare, Intercom's new customer service modules, etc...).
Interesting article and very on point. An analogy that I like is that LLMs can be though of the modern day Graphical User Interfaces. While GUIs completely changed the game, the applications on top (Word, Excel, Browsers, Editors, etc.) were what shaped the day-to-day experience of most users. Similarly LLMs can the the underlying infrastructure for many applications that solve business problems.