Compare commits
3 Commits
| Author | SHA1 | Date | |
|---|---|---|---|
| e2d750146c | |||
| 6105ba7793 | |||
| e8cdc089fa |
+122
@@ -0,0 +1,122 @@
|
|||||||
|
# SPARC Roadmap
|
||||||
|
|
||||||
|
Semiconductor Patent & Analytics Report Core -- development priorities.
|
||||||
|
|
||||||
|
## Current State
|
||||||
|
|
||||||
|
SPARC is a patent analysis platform with a working end-to-end pipeline:
|
||||||
|
Python/FastAPI backend, React/TypeScript frontend, PostgreSQL for persistence
|
||||||
|
and caching, Docker Compose for local development, and Gitea Actions CI/CD for
|
||||||
|
image builds. Core features (patent retrieval via SerpAPI, PDF parsing, LLM
|
||||||
|
analysis via OpenRouter/Claude, batch processing, JWT authentication, analytics
|
||||||
|
dashboard) are all implemented and functional.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## P1 -- High Priority
|
||||||
|
|
||||||
|
These items address correctness, security, and reliability gaps that should be
|
||||||
|
resolved before broader production use.
|
||||||
|
|
||||||
|
### Security hardening
|
||||||
|
|
||||||
|
- **Rotate default JWT secret.** `auth.py` ships a fallback
|
||||||
|
`sparc-secret-key-change-in-production` that will be used if `JWT_SECRET` is
|
||||||
|
unset. Add a startup check that refuses to start with the default secret in
|
||||||
|
non-development environments.
|
||||||
|
- **CORS allow-origins are hardcoded.** `api.py` only permits
|
||||||
|
`localhost:3000` and `localhost:5173`. Make the allowed origins configurable
|
||||||
|
via environment variable so the dashboard works when deployed behind a real
|
||||||
|
domain.
|
||||||
|
- **Database credentials in docker-compose.yml.** The compose file embeds
|
||||||
|
`postgres:postgres` in plain text. Reference a `.env` file or Docker secrets
|
||||||
|
instead.
|
||||||
|
|
||||||
|
### Error handling and resilience
|
||||||
|
|
||||||
|
- **`get_db_client()` in `auth.py` creates a new `DatabaseClient` on every
|
||||||
|
call.** This bypasses the connection pool and can exhaust database
|
||||||
|
connections under load. Refactor to share a single pooled client.
|
||||||
|
- **`_jobs` dict is in-memory only.** Job state is lost on API restart. Persist
|
||||||
|
job status in PostgreSQL or Redis so async batch results survive restarts.
|
||||||
|
- **No rate limiting on auth endpoints.** `/auth/login` and `/auth/register`
|
||||||
|
are unprotected against brute-force or abuse. Add rate limiting middleware.
|
||||||
|
|
||||||
|
### Test coverage for auth and admin
|
||||||
|
|
||||||
|
- The existing API tests (`tests/test_api.py`) bypass authentication entirely.
|
||||||
|
Add tests that exercise the JWT flow: registration, login, protected-route
|
||||||
|
access, token refresh, and admin-only endpoints.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## P2 -- Medium Priority
|
||||||
|
|
||||||
|
Improvements to usability, performance, and developer experience.
|
||||||
|
|
||||||
|
### Backend
|
||||||
|
|
||||||
|
- **Add structured logging.** Replace `print()` calls throughout `analyzer.py`,
|
||||||
|
`serp_api.py`, and `llm.py` with Python `logging` so log levels and
|
||||||
|
formatting are consistent.
|
||||||
|
- **Make LLM model configurable.** `llm.py` hardcodes
|
||||||
|
`anthropic/claude-3.5-sonnet`. Accept a `MODEL` environment variable to allow
|
||||||
|
switching models without code changes.
|
||||||
|
- **SERP cache TTL is hardcoded to 24 hours.** Expose `SERP_CACHE_TTL_HOURS`
|
||||||
|
as an environment variable in `config.py`.
|
||||||
|
- **Patent PDF storage.** PDFs are saved to a local `patents/` directory. For
|
||||||
|
containerized deployments, consider object storage (S3/MinIO) or at minimum
|
||||||
|
document the volume mount requirement more prominently.
|
||||||
|
- **`analyze_single_patent` assumes local file path.** The method constructs
|
||||||
|
`patents/{patent_id}.pdf` and reads from disk, but does not download the PDF
|
||||||
|
first. Either integrate the download step or document the prerequisite.
|
||||||
|
- **`Patent.patent_id` typed as `int` in `types.py` but used as `str`
|
||||||
|
everywhere.** Fix the type annotation to `str`.
|
||||||
|
|
||||||
|
### Frontend
|
||||||
|
|
||||||
|
- **No loading/error states on several pages.** The Batch and Analytics pages
|
||||||
|
would benefit from skeleton loaders and user-friendly error messages.
|
||||||
|
- **No dark mode.** Tailwind is configured but no dark variant is applied.
|
||||||
|
- **Missing `package-lock.json` or `pnpm-lock.yaml`.** The frontend has no
|
||||||
|
lockfile committed, leading to non-reproducible builds.
|
||||||
|
|
||||||
|
### CI/CD
|
||||||
|
|
||||||
|
- **No test stage in the Gitea Actions workflow.** `build.yaml` builds and
|
||||||
|
pushes images but never runs `pytest`. Add a test job that gates the build.
|
||||||
|
- **No linting or type checking.** Add `ruff` (Python) and `tsc --noEmit`
|
||||||
|
(TypeScript) to CI.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## P3 -- Nice to Have
|
||||||
|
|
||||||
|
Lower-urgency enhancements and future features.
|
||||||
|
|
||||||
|
- **Export analysis reports.** Allow users to download analysis results as PDF
|
||||||
|
or CSV from the dashboard.
|
||||||
|
- **Comparison view.** Side-by-side comparison of two companies' patent
|
||||||
|
portfolios.
|
||||||
|
- **Scheduled/recurring analysis.** Periodically re-analyze tracked companies
|
||||||
|
and alert on significant changes.
|
||||||
|
- **Webhook/notification support.** Send alerts (Slack, Discord, email) when
|
||||||
|
batch jobs complete or when a company's innovation score changes
|
||||||
|
significantly.
|
||||||
|
- **Multi-model support.** Let users choose between LLM providers per analysis
|
||||||
|
(e.g., GPT-4o, Gemini, Claude) and compare outputs.
|
||||||
|
- **Patent trend charts.** Visualize patent filing frequency and technology
|
||||||
|
category distribution over time in the Analytics page.
|
||||||
|
- **API pagination.** The `/analyze/batch` and `/jobs` endpoints could benefit
|
||||||
|
from cursor-based pagination for large result sets.
|
||||||
|
- **OpenAPI client generation.** Auto-generate the TypeScript API client from
|
||||||
|
the FastAPI OpenAPI spec to keep frontend types in sync.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Infrastructure and Deployment
|
||||||
|
|
||||||
|
Kubernetes manifests, Helm charts, and cluster-level concerns (MetalLB,
|
||||||
|
storage, FluxCD sync) are tracked in the
|
||||||
|
[Talos](https://10.0.1.10/leeworks-agents/Talos) repository. File
|
||||||
|
infrastructure-related issues there, not here.
|
||||||
+28
-6
@@ -7,9 +7,13 @@ from contextlib import asynccontextmanager
|
|||||||
from datetime import datetime
|
from datetime import datetime
|
||||||
from typing import Annotated, List
|
from typing import Annotated, List
|
||||||
|
|
||||||
from fastapi import BackgroundTasks, Depends, FastAPI, HTTPException, Query
|
from fastapi import BackgroundTasks, Depends, FastAPI, HTTPException, Query, Request
|
||||||
from fastapi.middleware.cors import CORSMiddleware
|
from fastapi.middleware.cors import CORSMiddleware
|
||||||
|
from fastapi.responses import JSONResponse
|
||||||
from pydantic import BaseModel, EmailStr, Field
|
from pydantic import BaseModel, EmailStr, Field
|
||||||
|
from slowapi import Limiter
|
||||||
|
from slowapi.errors import RateLimitExceeded
|
||||||
|
from slowapi.util import get_remote_address
|
||||||
|
|
||||||
from SPARC import config
|
from SPARC import config
|
||||||
from SPARC.analyzer import CompanyAnalyzer
|
from SPARC.analyzer import CompanyAnalyzer
|
||||||
@@ -164,6 +168,22 @@ app = FastAPI(
|
|||||||
root_path=config.root_path,
|
root_path=config.root_path,
|
||||||
)
|
)
|
||||||
|
|
||||||
|
# Rate limiter (in-memory storage, suitable for single-instance deployments)
|
||||||
|
limiter = Limiter(key_func=get_remote_address)
|
||||||
|
app.state.limiter = limiter
|
||||||
|
|
||||||
|
|
||||||
|
@app.exception_handler(RateLimitExceeded)
|
||||||
|
async def rate_limit_handler(request: Request, exc: RateLimitExceeded):
|
||||||
|
"""Return 429 with Retry-After header when rate limit is exceeded."""
|
||||||
|
retry_after = getattr(exc, "retry_after", 60)
|
||||||
|
return JSONResponse(
|
||||||
|
status_code=429,
|
||||||
|
content={"detail": "Rate limit exceeded. Please try again later."},
|
||||||
|
headers={"Retry-After": str(retry_after)},
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
# Add CORS middleware for React frontend
|
# Add CORS middleware for React frontend
|
||||||
app.add_middleware(
|
app.add_middleware(
|
||||||
CORSMiddleware,
|
CORSMiddleware,
|
||||||
@@ -178,7 +198,8 @@ app.add_middleware(
|
|||||||
|
|
||||||
|
|
||||||
@app.post("/auth/register", response_model=UserResponse, tags=["Auth"])
|
@app.post("/auth/register", response_model=UserResponse, tags=["Auth"])
|
||||||
async def register(request: RegisterRequest):
|
@limiter.limit("5/minute")
|
||||||
|
async def register(request: Request, body: RegisterRequest):
|
||||||
"""Register a new user.
|
"""Register a new user.
|
||||||
|
|
||||||
The first registered user automatically becomes an admin.
|
The first registered user automatically becomes an admin.
|
||||||
@@ -190,8 +211,8 @@ async def register(request: RegisterRequest):
|
|||||||
role = "admin" if user_count == 0 else "user"
|
role = "admin" if user_count == 0 else "user"
|
||||||
|
|
||||||
user = db.create_user(
|
user = db.create_user(
|
||||||
email=request.email,
|
email=body.email,
|
||||||
password=request.password,
|
password=body.password,
|
||||||
role=role,
|
role=role,
|
||||||
)
|
)
|
||||||
|
|
||||||
@@ -210,11 +231,12 @@ async def register(request: RegisterRequest):
|
|||||||
|
|
||||||
|
|
||||||
@app.post("/auth/login", response_model=TokenResponse, tags=["Auth"])
|
@app.post("/auth/login", response_model=TokenResponse, tags=["Auth"])
|
||||||
async def login(request: LoginRequest):
|
@limiter.limit("10/minute")
|
||||||
|
async def login(request: Request, body: LoginRequest):
|
||||||
"""Authenticate user and return JWT tokens."""
|
"""Authenticate user and return JWT tokens."""
|
||||||
db = get_db_client()
|
db = get_db_client()
|
||||||
|
|
||||||
user = db.authenticate_user(request.email, request.password)
|
user = db.authenticate_user(body.email, body.password)
|
||||||
|
|
||||||
if not user:
|
if not user:
|
||||||
raise HTTPException(
|
raise HTTPException(
|
||||||
|
|||||||
@@ -14,3 +14,4 @@ numpy
|
|||||||
pandas
|
pandas
|
||||||
bcrypt
|
bcrypt
|
||||||
PyJWT
|
PyJWT
|
||||||
|
slowapi
|
||||||
|
|||||||
@@ -0,0 +1,97 @@
|
|||||||
|
"""Tests for rate limiting on auth endpoints."""
|
||||||
|
|
||||||
|
import pytest
|
||||||
|
from unittest.mock import Mock, patch, MagicMock
|
||||||
|
from fastapi.testclient import TestClient
|
||||||
|
|
||||||
|
from SPARC.api import app
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.fixture
|
||||||
|
def client():
|
||||||
|
"""Create test client with rate limiter enabled."""
|
||||||
|
return TestClient(app)
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.fixture(autouse=True)
|
||||||
|
def reset_limiter():
|
||||||
|
"""Reset rate limiter storage between tests."""
|
||||||
|
from SPARC.api import limiter
|
||||||
|
limiter.reset()
|
||||||
|
yield
|
||||||
|
|
||||||
|
|
||||||
|
class TestRateLimiting:
|
||||||
|
"""Test rate limiting on login and register endpoints."""
|
||||||
|
|
||||||
|
@patch("SPARC.api.get_db_client")
|
||||||
|
def test_login_allows_requests_under_limit(self, mock_db_client, client):
|
||||||
|
"""Login endpoint allows requests under the rate limit."""
|
||||||
|
mock_db = MagicMock()
|
||||||
|
mock_db.authenticate_user.return_value = None
|
||||||
|
mock_db_client.return_value = mock_db
|
||||||
|
|
||||||
|
# Should allow at least a few requests
|
||||||
|
for _ in range(5):
|
||||||
|
response = client.post(
|
||||||
|
"/auth/login",
|
||||||
|
json={"email": "test@example.com", "password": "password123"},
|
||||||
|
)
|
||||||
|
# 401 is expected (invalid credentials), not 429
|
||||||
|
assert response.status_code == 401
|
||||||
|
|
||||||
|
@patch("SPARC.api.get_db_client")
|
||||||
|
def test_login_rate_limited_after_threshold(self, mock_db_client, client):
|
||||||
|
"""Login endpoint returns 429 after exceeding rate limit."""
|
||||||
|
mock_db = MagicMock()
|
||||||
|
mock_db.authenticate_user.return_value = None
|
||||||
|
mock_db_client.return_value = mock_db
|
||||||
|
|
||||||
|
# Send more than the limit (10/minute)
|
||||||
|
statuses = []
|
||||||
|
for _ in range(15):
|
||||||
|
response = client.post(
|
||||||
|
"/auth/login",
|
||||||
|
json={"email": "test@example.com", "password": "password123"},
|
||||||
|
)
|
||||||
|
statuses.append(response.status_code)
|
||||||
|
|
||||||
|
# At least one should be 429
|
||||||
|
assert 429 in statuses, f"Expected 429 in statuses but got: {set(statuses)}"
|
||||||
|
|
||||||
|
@patch("SPARC.api.get_db_client")
|
||||||
|
def test_register_rate_limited_after_threshold(self, mock_db_client, client):
|
||||||
|
"""Register endpoint returns 429 after exceeding rate limit."""
|
||||||
|
mock_db = MagicMock()
|
||||||
|
mock_db.get_user_count.return_value = 1
|
||||||
|
mock_db.create_user.return_value = None # triggers 400 (email exists)
|
||||||
|
mock_db_client.return_value = mock_db
|
||||||
|
|
||||||
|
# Send more than the limit (5/minute)
|
||||||
|
statuses = []
|
||||||
|
for _ in range(10):
|
||||||
|
response = client.post(
|
||||||
|
"/auth/register",
|
||||||
|
json={"email": "test@example.com", "password": "password123"},
|
||||||
|
)
|
||||||
|
statuses.append(response.status_code)
|
||||||
|
|
||||||
|
# At least one should be 429
|
||||||
|
assert 429 in statuses, f"Expected 429 in statuses but got: {set(statuses)}"
|
||||||
|
|
||||||
|
@patch("SPARC.api.get_db_client")
|
||||||
|
def test_rate_limit_returns_retry_after_header(self, mock_db_client, client):
|
||||||
|
"""Rate limited responses include a Retry-After header."""
|
||||||
|
mock_db = MagicMock()
|
||||||
|
mock_db.authenticate_user.return_value = None
|
||||||
|
mock_db_client.return_value = mock_db
|
||||||
|
|
||||||
|
# Exhaust the limit
|
||||||
|
for _ in range(15):
|
||||||
|
response = client.post(
|
||||||
|
"/auth/login",
|
||||||
|
json={"email": "test@example.com", "password": "password123"},
|
||||||
|
)
|
||||||
|
if response.status_code == 429:
|
||||||
|
assert "Retry-After" in response.headers
|
||||||
|
break
|
||||||
Reference in New Issue
Block a user