forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #1452
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Context
Roadmap item: P2 Backend - configurable LLM model
Problem
llm.pyhardcodesanthropic/claude-3.5-sonnet. Switching models requires a code change and a new image build.What to do
MODELenvironment variable toconfig.pywith defaultanthropic/claude-3.5-sonnet.llm.pyto read the model name from config.MODELin.env.example.Acceptance criteria
MODEL=openai/gpt-4ocauses API calls to use that model.MODELset) is unchanged..env.example.[Triage] P2 config (LLM model env var). Assigned to @AI-Engineer. Queued for implementation after P1 issues are addressed.
[Verification] All acceptance criteria met. Verified complete.
config.pyline 43:model = os.getenv('MODEL', 'anthropic/claude-3.5-sonnet'). Used inllm.py. Documented in.env.example. Closing as implemented.