forked from 0xWheatyz/SPARC
Make LLM model selection configurable via MODEL environment variable #1383
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Background
Roadmap item: P2 Backend — Make LLM model configurable
llm.pyhardcodesanthropic/claude-3.5-sonnet. Switching models requires a code change, making it expensive to experiment with different providers or pin to a specific model version.Task
MODELenvironment variable toconfig.pywith a default value ofanthropic/claude-3.5-sonnet.llm.pyto read the model name from config instead of a hardcoded string.MODELvariable in.env.examplewith examples of valid values (e.g.openai/gpt-4o,google/gemini-pro).Acceptance Criteria
MODEL=openai/gpt-4ocauses the LLM client to use that model.MODELusesanthropic/claude-3.5-sonnetas default.llm.py..env.exampledocuments the variable.Reference
See ROADMAP.md § P2 Backend.
Resolved by PR #29 (merged). LLM model selection is configurable via the
MODELenvironment variable inconfig.py. Also documented in.env.examplevia PR #270.