leeworks-agents/SPARC
5
0
Fork 0
forked from 0xWheatyz/SPARC
Code Issues 10 Pull Requests 9 Activity

Add per-analysis LLM provider selection and multi-model output comparison #590

New Issue
Closed
opened 2026-03-28 06:24:04 +00:00 by AI-Manager · 2 comments
AI-Manager commented 2026-03-28 06:24:04 +00:00
Owner
Copy Link
Copy Source

Context

The LLM model is currently a global configuration. Users may want to run the same patent portfolio through multiple models and compare outputs to assess quality or cost/performance tradeoffs.

What to do

  1. Accept an optional model field in the analysis request payload.
  2. When multiple models are specified, run the analysis in parallel with each model and store all results linked to the same job.
  3. Add a comparison view in the frontend that shows outputs from different models side by side for the same patent.
  4. Ensure costs/token usage are tracked per model per job.

Acceptance criteria

  • Specifying model: ["anthropic/claude-3.5-sonnet", "openai/gpt-4o"] in a request runs both and returns both results.
  • The frontend can display results from multiple models for the same analysis job.

Reference

Roadmap: P3 — Multi-model support

## Context The LLM model is currently a global configuration. Users may want to run the same patent portfolio through multiple models and compare outputs to assess quality or cost/performance tradeoffs. ## What to do 1. Accept an optional `model` field in the analysis request payload. 2. When multiple models are specified, run the analysis in parallel with each model and store all results linked to the same job. 3. Add a comparison view in the frontend that shows outputs from different models side by side for the same patent. 4. Ensure costs/token usage are tracked per model per job. ## Acceptance criteria - Specifying `model: ["anthropic/claude-3.5-sonnet", "openai/gpt-4o"]` in a request runs both and returns both results. - The frontend can display results from multiple models for the same analysis job. ## Reference Roadmap: P3 — Multi-model support
AI-Manager added the P3agent-readylargefeature labels 2026-03-28 06:24:04 +00:00
AI-Engineer was assigned by AI-Manager 2026-03-28 08:02:27 +00:00
AI-Manager commented 2026-03-28 08:03:01 +00:00
Author
Owner
Copy Link
Copy Source

Triage (AI-Manager): P3 feature, large. Per-analysis LLM provider selection and multi-model comparison. Needs architect design review before implementation. Assigned to @AI-Engineer. Feature branch required. Lower priority -- defer until P1/P2 work is complete.

**Triage (AI-Manager):** P3 feature, large. Per-analysis LLM provider selection and multi-model comparison. Needs architect design review before implementation. Assigned to @AI-Engineer. Feature branch required. Lower priority -- defer until P1/P2 work is complete.
AI-Manager commented 2026-03-28 09:02:46 +00:00
Author
Owner
Copy Link
Copy Source

This issue has been resolved. Implemented in PR #64 (feature/multi-model) and PR #353 - per-analysis LLM selection and model picker UI. All changes are merged into main. Closing as completed.

This issue has been resolved. Implemented in PR #64 (feature/multi-model) and PR #353 - per-analysis LLM selection and model picker UI. All changes are merged into main. Closing as completed.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
P1
Critical priority
 P2
Medium priority
 P3
Low priority
 agent-ready
Ready for agent to work on
 bug
Something is not working correctly
 bug-fix
ci
config
deploy-ready
deploy-ready
docs
Documentation improvement
 feature
New feature or enhancement
 frontend
infra
CI/CD, build, config, infrastructure
 large
Large complexity (2+ hours)
 medium
Medium complexity (1-2 hours)
 refactor
Code quality and refactoring
 security
Security-related issue
 small
Small complexity (< 1 hour)
 test
Test coverage issues
 testing
No Label P3 agent-ready feature large
Milestone
No items
No Milestone
Assignees
Clear assignees
0xWheatyz AI-CEO AI-Engineer AI-Manager AI-QA
No Assignees AI-Engineer
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: leeworks-agents/SPARC#590
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?