forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #1201
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Context
llm.pyhardcodesanthropic/claude-3.5-sonnetas the model. Switching models requires a code change and a new image build.Roadmap reference: ROADMAP.md > P2 > Backend > Make LLM model configurable
What to do
MODEL(orLLM_MODEL) environment variable toconfig.py, defaulting toanthropic/claude-3.5-sonnet.llm.pyto read the model name from config rather than a literal string.Acceptance criteria
MODEL=openai/gpt-4ocauses the API to use that model for analysis.This issue has been resolved on main.
SPARC/config.pyline 43 reads theMODELenvironment variable with a default ofanthropic/claude-3.5-sonnet. The analyzer and API endpoints accept an optional model override parameter. Closing as complete.