Add observability for LLM topic context inclusion (#1038)
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: thomasnordquist <7721625+thomasnordquist@users.noreply.github.com> Co-authored-by: Thomas Nordquist <thomasnordquist@users.noreply.github.com>
This commit is contained in:
25
Readme.md
25
Readme.md
@@ -122,6 +122,31 @@ yarn test:backend
|
||||
yarn test
|
||||
```
|
||||
|
||||
### LLM Testing
|
||||
|
||||
The AI Assistant feature includes comprehensive tests to validate proposal quality and LLM integration.
|
||||
|
||||
**Offline tests** (default - no API key needed):
|
||||
```bash
|
||||
yarn test:app
|
||||
```
|
||||
|
||||
**Live LLM integration tests** (requires API key):
|
||||
```bash
|
||||
# Set your API key
|
||||
export OPENAI_API_KEY=sk-your-key-here
|
||||
# Or use Gemini
|
||||
export GEMINI_API_KEY=your-key-here
|
||||
|
||||
# Opt-in to live tests
|
||||
export RUN_LLM_TESTS=true
|
||||
|
||||
# Run tests
|
||||
yarn test:app
|
||||
```
|
||||
|
||||
For detailed LLM testing documentation, see [app/src/services/spec/README.md](app/src/services/spec/README.md).
|
||||
|
||||
### Integration & UI Tests
|
||||
|
||||
**UI test suite** - Independent, deterministic browser tests:
|
||||
|
||||
Reference in New Issue
Block a user