Definition
Foundation model
A large model trained on broad data that can be adapted to many different tasks, serving as the base for many products.
How founders on the podcast use it
A large model pretrained on raw signal data that can then be adapted to many downstream tasks. SleepFM is one, trained on polysomnography.
Chronic Insomnia: Almost None Get Treated — Colin Lawlor on the Sleep Data GapThe base large language models — Claude, GPT, Gemini, and others — that AI products are built on top of. Will mentions rebuilding Workmate's AI stack multiple times as foundation models improve.
The AI EA FlexHear it on the podcast2 episodes
Learn the language of AI-native founders
Every week: the new terms, tools, and workflows founders are using, straight from the podcast.
Related terms in AI Fundamentals
Federated learningTraining a model across many devices or servers that each keep their own data, so the raw data never has to be pooled in one place.Few-shot learningWhen a model learns a new task from just a handful of examples, often given right in the prompt.Fine-Tuned LLMA large language model that has been further trained on a domain-specific dataset — in Videra's case, behavioral health conversations between providers and patients — to make its outputs more accurate and contextually appropriate for that domain than a general-purpose model.Fine-tuningTaking a pre-trained model and training it further on data for a specific task or domain so it performs better there.Foundation Model Fine-TuningThe process of taking a pre-trained large language model (such as GPT-4, Claude, or Gemini) and continuing its training on a smaller, domain-specific dataset to specialize its behavior for a particular use case without training a model from scratch. Fine-tuning allows companies to capture the reasoning and language capabilities of a foundation model while customizing it for specific vocabularies, response formats, constraints, or domain knowledge. Loman.ai fine-tunes foundation models for the specific context of restaurant phone conversations - teaching them the nuances of taking food orders, handling 86'd items, managing reservation requests, and maintaining the appropriate tone for different restaurant types. Christian's approach: test every major foundation model, identify which performs best for each specific sub-task within the product, and fine-tune for production performance.Frontier labsThe handful of companies training the most capable models, including Anthropic, OpenAI, and Google.Frontier modelOne of the most capable general-purpose AI models available, at or near the leading edge of the field.GAN (Generative Adversarial Network)A setup where two neural networks compete: a generator creates fake data and a discriminator tries to spot it, which pushes the generator to get more realistic.