Definition

Supervised Fine-Tuning (SFT)

The standard technique for specializing a pretrained large language model on a specific task or domain: show the model labeled examples of correct input-output pairs, and train it to reproduce that behavior. SFT requires curated training data, and the quality of that data is the primary bottleneck - not the compute or the base model. Ben Turtle built LightningRod to eliminate this bottleneck for teams that lack the scale, budget, or time to pay human labeling companies like Scale AI or Labelbox to create SFT-ready datasets.

From the episode “AI That Predicts the Future”