Repository navigation

All pull requests

fix(language): detect running loop before creating coroutine and propagate fetch errors
#764aniruddhaadak80 opened Sep 17, 20267 tasks done
fix(language): use tolerant parse_json for LLM choice scoring
#763aniruddhaadak80 opened Sep 16, 20265 of 7 tasks
fix(operators): handle empty and brace-less replies in parse_json
#762aniruddhaadak80 opened Sep 2, 2026
feat(operators): add ContentCoherence operator for long-form term consistency
#761aniruddhaadak80 opened Sep 2, 2026
test(framework): smoke tests for managed evals returning non-None scores
#760aniruddhaadak80 opened Sep 2, 2026
test(operators): smoke tests for language evals returning non-None scores
#759aniruddhaadak80 opened Sep 2, 2026
fix(operators): handle missing columns in polars DataFrame.drop with strict=False
#758aniruddhaadak80 opened Aug 31, 20267 of 10 tasks
1
Fix more RCE vulnerabilties
#756Kwstubbs opened Aug 11, 2026
Fixes security issues related to CORS, constant API key, and RCE in request parsing
#754Kwstubbs opened Aug 10, 2026
Fix GPL-3.0 license compatibility issue with rouge_score
#751yttrium400 opened Dec 6, 20255 of 10 tasks
Add RAG Q&A system evaluation use case example
#750yttrium400 opened Dec 6, 20255 of 10 tasks
Add Quick Navigation section to README
#749harsh2b opened Oct 7, 20253 of 10 tasks
Fix link in README.md
#746thyecust opened Apr 24, 20257 tasks
Update context relevancy to rely on uptrains parse json function to solve parsing error. Added more informative error logging.
#742karolshe opened Oct 8, 20241 of 7 tasks
use alternative function for operations
#740adventure8812 opened Aug 22, 2024
feat: adding support for gpt-4o-mini
#736rahulkrprajapati opened Aug 18, 2024
docs: fix typos by replacing 'reponse' with 'response' in docs and notebooks
#734nasudadada opened Aug 13, 20244 of 7 tasks
Added: Clarifai as LLM provider support
#733mogith-pn opened Aug 8, 20247 of 10 tasks
3
feat: add MT-bench operator
#729Abhinavcode13 opened Jul 29, 2024Contributor
feat: add MMLUScore operator
#728Abhinavcode13 opened Jul 29, 2024Contributor

Pull requests