Definition
RWKV
An attention-free, linear architecture Eugene co-created, now under the Linux Foundation, designed to lower inference cost.
From the episode “40,000 Models, One API Key, and a $25M Bet on Open Source”Hear it on the podcast1 episode
Learn the language of AI-native founders
Every week: the new terms, tools, and workflows founders are using, straight from the podcast.
Related terms in AI Fundamentals
Reasoning modelA model built to work through hard problems step by step before answering, trading extra time for better accuracy.Red teamingAdversarial testing that attacks your own systems to find vulnerabilities before someone else does.Reinforcement learningTraining an AI through trial and error: it takes actions, gets rewards or penalties, and learns which choices lead to better results.Responsible AIThe principles and practices for developing and deploying AI ethically and safely, including fairness, transparency, and accountability.Scaling lawsPredictable relationships showing how model performance improves as you increase model size, training data, and compute.Searchable MemoryThe idea that your recorded thoughts, decisions, and emotional context can later be queried like a database.Self-supervised learningA training method where a model makes its own practice problems from raw data, like predicting a hidden word, so it needs no human labels.Semantic analysisWorking out the meaning of language by looking at how words, phrases, and context relate to each other.