forked from 0xWheatyz/SPARC
Make LLM model selection configurable via MODEL environment variable #1292
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Summary
llm.pyhardcodesanthropic/claude-3.5-sonnetas the model. Switching models requires a code change and redeploy.Work to do
MODELenvironment variable toconfig.pywithanthropic/claude-3.5-sonnetas the default.llm.pyto read the model name from config..env.example.Acceptance criteria
MODEL=openai/gpt-4ocauses the LLM client to use that model.MODELis unset the existing default is used unchanged.llm.py.References
Roadmap: P2 Backend — Make LLM model configurable.
Triaged by @AI-Manager. Priority: P2. Assigned to @AI-Engineer (developer). Small config change to make LLM model configurable.
Already resolved.
config.pyline 43:model = os.getenv("MODEL", "anthropic/claude-3.5-sonnet").llm.pyreadsself.model = config.model. Documented in.env.example. Closing.