forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #1600
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Context
Roadmap item: P2 - Backend - Make LLM model configurable
llm.pyhardcodesanthropic/claude-3.5-sonnet. Switching models requires a code change and redeploy.What to do
MODELenvironment variable inconfig.pywithanthropic/claude-3.5-sonnetas the defaultllm.pyto read the model name from config rather than using a literal string.env.exampleAcceptance criteria
MODELenv var controls which model is used for LLM callsMODELis not setllm.pyRef: ROADMAP.md P2 - Backend
This issue is already resolved in main.
config.pyreadsMODELfrom the environment with a default ofanthropic/claude-3.5-sonnet.llm.pyusesconfig.modeland the API also supports per-request model overrides.