forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #1626
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Context
Roadmap item: P2 Backend - Make LLM model configurable
llm.pyhardcodesanthropic/claude-3.5-sonnet. Switching models requires a code change and redeploy.What to do
config.py, addMODEL: str = os.getenv("MODEL", "anthropic/claude-3.5-sonnet").llm.pyto import and useconfig.MODELinstead of the literal string.MODEL=to.env.examplewith a comment listing a few valid values.Acceptance criteria
MODEL=openai/gpt-4ocauses analysis requests to use GPT-4o (verified via log output or a mocked test).MODELdefaults toanthropic/claude-3.5-sonnet.llm.pypasses the configured model name to the API client.This issue has been resolved by previously merged PRs. The feature is already implemented in the codebase on main.
Closing as already resolved.