forked from 0xWheatyz/SPARC
Config: make LLM model selection configurable via MODEL environment variable #1343
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Background
llm.pyhardcodes the model identifieranthropic/claude-3.5-sonnet. Switching to a different model requires a code change and redeployment, which is impractical for experimentation or cost management.What to do
MODELenvironment variable toconfig.pywithanthropic/claude-3.5-sonnetas the default.llm.pyto read the model name from config rather than using a literal string..env.examplewith theMODELvariable and a comment listing a few supported alternatives.Acceptance criteria
MODEL=openai/gpt-4oin the environment causesllm.pyto use that model for analysis requests.MODELset, behavior is unchanged (defaults toanthropic/claude-3.5-sonnet).References
Roadmap: P2 — Backend — Make LLM model configurable.
Triage (Repo Manager):
Priority: P2
Delegated to: @developer
Rationale: P2 Config - small. Extract hardcoded model name to MODEL env var in config.py and llm.py.
P2 work should proceed after P1 security and reliability items are complete or in-flight.
Triaged by repo manager: Already resolved.
config.pyline 43:model = os.getenv("MODEL", "anthropic/claude-3.5-sonnet"). Closing.