Tom Tunguz

DECEMBER 10, 2023

The future of LLM evaluations resembles software testing more than benchmarks. Real-world testing looks like this , asking LLMs to produce Dad jokes like this zinger : I’m reading a book about gravity & it’s impossible to put down. LLMs are tricky. 1 can be greater than 4. This is called non-determinism.

Artificial Intelligence 251

Artificial Intelligence Machine Learning Benchmarks Software 251

Intercom, Inc.

SEPTEMBER 9, 2022

GPT-3 can create human-like text on demand, and DALL-E, a machine learning model that generates images from text prompts, has exploded in popularity on social media, answering the world’s most pressing questions such as, “what would Darth Vader look like ice fishing?” Today, we have an interesting topic to discuss.

Artificial Intelligence 249

Artificial Intelligence Machine Learning AI Search AI 249

TechEmpower SaaS

NOVEMBER 13, 2023

On a different project, we’d just used a Large Language Model (LLM) - in this case OpenAI’s GPT - to provide users with pre-filled text boxes, with content based on choices they’d previously made. This gives Mark more control over the process, without requiring him to write much, and gives the LLM more to work with.

Generative AI 443

Generative AI Artificial Intelligence AI New CTO 443

Tom Tunguz

AUGUST 29, 2023

Large-language models have transformed how millions interact with products : from customer support to code generation to legal document analysis. These new engagement models invite users through a meaningfully different product journey. is a product analytics platform for LLM-powered applications. Context.ai

Artificial Intelligence 205

Artificial Intelligence User Experience Customer Support Engagement 205

Tom Tunguz

OCTOBER 6, 2023

Over the last few weeks I’ve been experimenting with chaining together large language models. Bad data from the transcription -> inaccurate prompt to the LLM -> incorrect output. Tn machine learning systems, achieving an 80% solution is pretty rapid. I dictate emails & blog posts often.

Artificial Intelligence 135

Artificial Intelligence Machine Learning Communication Data 135

Andreessen Horowitz

JUNE 20, 2023

Large language models are a powerful new primitive for building software. In this post, we’re sharing a reference architecture for … The post Emerging Architectures for LLM Applications appeared first on Andreessen Horowitz.

Artificial Intelligence 145

Artificial Intelligence Software Machine Learning Generative AI 145

Tom Tunguz

APRIL 23, 2024

Snowflake announced Artic , their open 17b model. The LLM perfomance chart is replete with new offerings in just a few weeks. One thing stands out from the announcement - the positioning of the model. Overall knowledge performance is asymptoting as expected. It’s hard to discern the most recent dots.

Artificial Intelligence 217

Artificial Intelligence B2B Marketing AI 217

Tom Tunguz

SEPTEMBER 20, 2023

Yesterday at TechCrunch Disrupt, Harrison Chase , founder of LangChain , Ashe Magalhaes founder of Hearth , & Henry Scott-Green , founder of Context.ai , & I discussed the future of building LLM-enabled applications. First, it’s very early in LLM application development in every sense of the word.

Artificial Intelligence 251

Artificial Intelligence AI Social Media Application Development 251

Tom Tunguz

MARCH 30, 2023

Models require millions of dollars & technical expertise to deploy: document chunking, vectorization, prompt-tuning or plugins for better accuracy & breadth. Machine learning systems, like any complex program, benefit from more use. But in the long-term, usage will be the enduring moat.

Artificial Intelligence 303

Artificial Intelligence AI Machine Learning Generative AI 303

Tom Tunguz

FEBRUARY 26, 2024

At least 10% of their revenue - about $60m - comes from selling data to train Large Language Models. Quoting directly : We expect our growing data advantage and intellectual property to continue to be a key element in the training of future LLMs. The LLM vendors should pay more for better data.

Artificial Intelligence 263

Artificial Intelligence Business Model Business Travel 263

Tom Tunguz

NOVEMBER 8, 2023

LLMs Transform the Stack : Large language models transform data in many ways. If you’re curious about the evolution of the LLM stack or the requirements to build a product with LLMs, please see Theory’s series on the topic here called From Model to Machine.

Artificial Intelligence 182

Artificial Intelligence Trends Data Software Review 182

Tom Tunguz

MARCH 17, 2024

We believe every LLM-based application will need this capability. Combining text & structured data in an LLM workflow the right is difficult. Vector computers simplify many kinds of data into vectors - the language of AI systems - and push them into your vector database. If you’d like to learn more, click here.

Artificial Intelligence 229

Artificial Intelligence Machine Learning AI Engineering 229

Tom Tunguz

OCTOBER 2, 2023

Eliciting product feedback elegantly is a competitive advantage for LLM-software. LLM systems aren’t deterministic. 1 can be larger than 4 for an LLM. If an LLM produces a few spurious results, the user won’t trust it. I asked Bard to compare the 3rd-row leg room of the leading 7-passenger SUVs.

Artificial Intelligence 173

Artificial Intelligence SaaS Software Data 173

Tom Tunguz

NOVEMBER 15, 2023

Different models cost different amounts. How much does AI cost? It depends on a a few different dimensions, but for a typical use case where a user enters a query & expects about a 200 word response, the cost varies from $0.03 Also, the size of the context window is an important factor.

Artificial Intelligence 336

Artificial Intelligence AI Engineering Trends 336

Tom Tunguz

FEBRUARY 4, 2024

A recognized query routes to small language model, which tends to be more accurate, more responsive, & less expensive to operate. If the query is not recognized, a large language model handles it. LLMs much more expensive to operate, but successfully returns answers to a larger variety of queries.

AI 313

AI Artificial Intelligence User Experience Engineering 313

Andreessen Horowitz

APRIL 19, 2023

Artificial intelligence and machine learning have been used in the financial services industry for more than a decade, enabling enhancements that range from better underwriting to improved foundational fraud scores.

Artificial Intelligence 138

Artificial Intelligence Generative AI AI Machine Learning 138

Tom Tunguz

AUGUST 8, 2024

Cortex is a suite of AI building blocks that enable customers to leverage large language models (LLMs) & build applications. Developing open source initiatives including a data catalog, Polaris, & an open LLM Model Arctic which focuses on SQL performance.

Artificial Intelligence 187

Artificial Intelligence AI Search AI Investment 187

Tom Tunguz

AUGUST 8, 2019

Artificial Intelligence - yes, it’s a buzzword but it’s more than that. AI or Machine Learning is a new technology that will benefit nearly every type of sector and we’re still in the very earliest innings. Some sectors have hit their apogee and are declining. Others have grown by more than 3x.

Artificial Intelligence 280

Artificial Intelligence Startup Blockchain Social Media 280

Andreessen Horowitz

NOVEMBER 14, 2023

The aforementioned tasks are what large language models (LLMs) are well poised to be tuned to do—e.g. Add to this the opportunity to monetize transactions once the LLM integrates into a marketplace of services that can be directly booked, and numerous revenue streams worth billions of dollars in aggregate become possible.

Artificial Intelligence 129

Artificial Intelligence Healthcare Marketplace as a Service Systems Review 129

SaaStr

JUNE 14, 2023

Join us as we uncover lessons from UiPath’s success in creating a new category within RPA Enterprise Automation – Robotic Process Automation – while navigating the challenges inherent in digital transformation powered by artificial intelligence and machine learning technologies.

Scale 244

Scale Artificial Intelligence Technical Review Software Review 244

The Moz Blog

NOVEMBER 27, 2023

Learn when not to use artificial intelligence in digital PR. In the field of public relations, the human touch remains essential and irreplaceable.

Artificial Intelligence 117

Artificial Intelligence 117

Tom Tunguz

MAY 15, 2023

A product manager today faces a key architectural question with AI : to use a small language model or a large language model? the company would prefer to rely on external experts to drive innovation within the models. the company would prefer to rely on external experts to drive innovation within the models.

Artificial Intelligence 198

Artificial Intelligence AI Machine Learning Scale 198

Tom Tunguz

MARCH 6, 2023

As machine learning becomes core to every product, engineering teams will restructure. In the past, the core engineering team & the data science/machine learning teams worked separately. LLM-features should contribute directly to revenue via upsell & market share, quieting questions.

Artificial Intelligence 208

Artificial Intelligence ChatGPT Engineering Machine Learning 208

Tom Tunguz

JULY 10, 2023

Large language models enable fracking of documents. But LLMs do this beautifully, pumping value from one of the hardest places to mine. We are tinkering with deploying large language models on top of them. Historically, extracting value from unstructured text files has been difficult.

Artificial Intelligence 129

Artificial Intelligence Systems Review Machine Learning Government 129

Tom Tunguz

SEPTEMBER 14, 2023

First, large language models like GPT-3 are making AI accessible to the masses. These advanced models allow people to interact conversationally with technology. Universities are eager to incorporate large language models into curricula and instruction. Four themes resonated throughout the session.

AI 279

AI Artificial Intelligence Technical Cofounder Education 279

Sparktoro

APRIL 2, 2023

But, the core problem with content created by large language model (LLM) outputs is that it’s so cheap, so accessible, so ubiquitous—it’s not merely table stakes; AI content… Some of it’s pretty good.

Artificial Intelligence 145

Artificial Intelligence AI Data Marketing 145

Intercom, Inc.

FEBRUARY 22, 2019

Artificial intelligence is radically redefining the customer service landscape. Here’s a look at how customer service chatbots can improve your service experience, and a few examples of intelligent bots that will inspire you to create your own. What is a customer service chatbot, and do I need one?

AI Search 267

AI Search AI Artificial Intelligence Scale 267

SaaStr

FEBRUARY 26, 2024

Building off the popularity of our AI Day at last September’s SaaStr Annual , we’re bringing it back online this March on Wednesday, March 27th for a completely live, digital event that will bring the global SaaStr community together with the brightest innovators in Artificial Intelligence for a day of digital content.

AI 258

AI Artificial Intelligence Social Media Innovation 258

Clouded Judgement

AUGUST 25, 2023

Our modern and intuitive SaaS platform combines our proprietary data and application layers into one vertically-integrated solution with advanced machine learning and artificial intelligence capabilities.

Benchmarks 246

Benchmarks Artificial Intelligence Data Software Review 246

SaaStr

JANUARY 17, 2024

Benjamin Mann, co-founder of Anthropic added: “ For example, one large bank that we were talking to came to us and said, ‘we’ve talked to everybody in our company, and we have 500 different use cases that we want to apply large language models to.’ ’ That’s really incredible.

AI 294

AI Enterprise Artificial Intelligence compliance 294