forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #668
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Context
llm.pyhardcodesanthropic/claude-3.5-sonnet. Switching models requires a code change and a new image build.What to do
MODELenvironment variable inllm.py.anthropic/claude-3.5-sonnetwhen the variable is not set.MODELin.env.example.Acceptance criteria
MODEL=openai/gpt-4ocauses LLM calls to use that model.MODELcontinues to useanthropic/claude-3.5-sonnet.llm.py..env.exampledocuments the variable with the default value.References
Roadmap item: P2 Backend — configurable LLM model.
Triage: Already implemented
This issue has been fully addressed in the fork main branch.
Verification:
SPARC/config.pyreadsMODELenv var with defaultanthropic/claude-3.5-sonnet(line 43).SPARC/llm.pyusesconfig.modelinstead of hardcoded strings (line 28)..env.exampledocuments theMODELvariable with supported models listed.All acceptance criteria are met. Closing.