forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #313
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Context
Roadmap item: P2 Backend — configurable LLM model
llm.pyhardcodesanthropic/claude-3.5-sonnet. Switching models requires a code change and a new image build.Work Required
MODELenvironment variable inllm.py(orconfig.py) withanthropic/claude-3.5-sonnetas the defaultMODELto.env.examplewith a comment listing some valid valuesAcceptance Criteria
MODEL=openai/gpt-4ocauses the API to use that model for analysis requestsMODELfalls back toanthropic/claude-3.5-sonnetThis issue has already been resolved in the fork's main branch. Already implemented in PR #29. See SPARC/config.py: model = os.getenv('MODEL', ...).
Closing as completed.