forked from 0xWheatyz/SPARC
Make LLM model selection configurable via MODEL environment variable #742
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Context
Roadmap reference: P2 - Make LLM model configurable
llm.pyhardcodesanthropic/claude-3.5-sonnet. This forces all deployments to use the same model and requires a code change to switch providers.What to do
MODELenvironment variable toconfig.pywith a default ofanthropic/claude-3.5-sonnetllm.pyto read the model from config instead of the hardcoded string.env.exampleAcceptance criteria
MODEL=openai/gpt-4ocausesllm.pyto use that model for requestsanthropic/claude-3.5-sonnetwhenMODELis unsetllm.py.env.exampleResolved.
config.pyreadsMODELenv var with defaultanthropic/claude-3.5-sonnet.llm.pyusesconfig.model(line 28:self.model = config.model). No hardcoded model string remains.