forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #210
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Context
llm.pyhardcodesanthropic/claude-3.5-sonnet. Switching models requires a code change and redeploy.Roadmap reference: ROADMAP.md > P2 > Backend > Make LLM model configurable
What to do
MODEL(orLLM_MODEL) environment variable toconfig.pywithanthropic/claude-3.5-sonnetas the default.llm.pywith the config value..env.example.Acceptance criteria
MODEL=openai/gpt-4ocauses the API to use that model for analysis calls.llm.py.This issue has already been resolved in the current codebase.
config.pyline 43 readsMODELfrom the environment:model = os.getenv("MODEL", "anthropic/claude-3.5-sonnet").llm.pyusesconfig.model(line 28). No hardcoded model string remains inllm.py.Closing as already implemented.