forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #1530
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Context
llm.pyhardcodesanthropic/claude-3.5-sonnet. Switching models requires a code change and redeployment.Roadmap reference: ROADMAP.md > P2 > Backend > Make LLM model configurable
What to do
MODELenvironment variable toconfig.pyllm.pyto read the model name from config instead of hardcoding it.env.exampleAcceptance criteria
MODEL=openai/gpt-4ocauses the LLM client to use that modelMODELdefaults toanthropic/claude-3.5-sonnetllm.py.env.exampledocuments the variable with the default valueTriage review: Resolved: config.py reads MODEL from env var with fallback to anthropic/claude-3.5-sonnet. Closing as already complete.