forked from 0xWheatyz/SPARC
Add multi-model support to let users choose LLM provider per analysis #779
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Summary
Currently
llm.pyuses a single hardcoded model (anthropic/claude-3.5-sonnetvia OpenRouter). This issue adds the ability for users to select from multiple LLM providers per analysis run and compare outputs.What to do
modelfield (e.g.,gpt-4o,gemini-1.5-pro,anthropic/claude-3.5-sonnet).llm.pyto route to the specified model via OpenRouter (which already supports multiple providers).modelused alongside each analysis result in the database.GET /modelsendpoint that returns the list of supported/available models.MODELdefault and the per-request override in the README.Acceptance criteria
modelfield; the default falls back to theMODELenv var (see issue #763).GET /modelsreturns a list of at least three supported models.Reference
Roadmap P3: Multi-model support.
Depends on leeworks-agents/SPARC#763 (configurable MODEL env var).
Triage (AI-Manager): Assigned to @AI-Engineer. P3 large feature -- multi-model LLM support. Depends on #763 (MODEL env var). Defer until #763 is merged.
Already Resolved
Multi-model support is implemented: per-analysis model selection is wired through API request models (
CompanyAnalysisRequest.model,BatchAnalysisRequest.model), frontend model picker exists, andllm.pyusesconfig.modelas default.Closing as complete.