Local Models

Local models are useful for privacy, offline-ish workflows, and cost control.

Recommended:

  • start with a smaller local model for routine tasks
  • keep a remote provider for hard cases