Skip to content

Pull requests: open-compass/opencompass

New pull request New
27 Open 910 Closed
27 Open 910 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[WIP] [Feature] Support downloading dataset from OpenMind
#1792 opened Dec 27, 2024 by FightingZhen Loading…
6 tasks
@tonysy
[Feature] Added Bradley-Terry subjective evaluation method to wildbench, alpacaeval, and compassarena datasets Enhancement New feature or request
#1791 opened Dec 27, 2024 by acylam Loading…
@tonysy @MaiziXiao
[BUMP] Bump version to 0.3.9
#1790 opened Dec 27, 2024 by MaiziXiao Loading…
@tonysy
[Feature] Support MMLU-CF Benchmark
#1775 opened Dec 24, 2024 by fistyee Loading…
6 tasks done
@liushz
6
[Feature] Support G-Pass@k and LiveMathBench
#1772 opened Dec 20, 2024 by jnanliu Loading…
3 of 4 tasks
@tonysy
5
[Draft] Async pipeline
#1763 opened Dec 15, 2024 by HAOCHENYE Loading…
6 tasks
@tonysy
add jiutian-api cliet
#1677 opened Nov 12, 2024 by DewidPig Loading…
@liushz
1
[Enhance] Enhance volc
#1642 opened Oct 26, 2024 by HAOCHENYE Loading…
6 tasks
@tonysy
2
Add WMT19 dataset configuration and inference code
#1503 opened Sep 6, 2024 by cpa2001 Loading…
3 of 6 tasks
@tonysy
[Feature] Update octools CLI
#1496 opened Sep 6, 2024 by MaiziXiao Loading…
@tonysy
7
fix: IFEval dataset introduces the correct langdetect expectation path
#1451 opened Aug 23, 2024 by catohzs Loading…
@tonysy
1
[Feature] Add api_prompts to GenInferencerOutput
#1314 opened Jul 12, 2024 by xu-song Loading…
@tonysy
Add eval_benbench.py config
#1312 opened Jul 11, 2024 by Leymore Loading…
Add max_model_len when initializing VLLM engine
#1211 opened May 29, 2024 by xu-song Loading…
6 tasks done
@liushz
change max_task_size from CONSTANT value to DYNAMIC value
#1183 opened May 22, 2024 by disperaller Loading…
6 tasks
@liushz
Adding support for fireworks and vllm models and sample for wiki mode…
#1084 opened Apr 25, 2024 by arsh-orby Loading…
6 tasks
@kennymckormick
API-DEMO
#969 opened Mar 13, 2024 by TwT-JD Loading…
6 tasks done
@liushz
Update a MMLU dataset config with a more general post process
#790 opened Jan 11, 2024 by yitongYao Loading…
6 tasks
@kennymckormick
Support devops-eval
#762 opened Jan 3, 2024 by PanameraXXX Loading…
6 tasks
@yingfhu
1
[Feature] Add Codereval inference
#658 opened Dec 1, 2023 by jingmingzhuo Loading…
6 tasks
@tonysy
[SIG] add LogiQA dataset
#516 opened Oct 27, 2023 by KevinNuNu Loading…
6 tasks
@tonysy
[SIG] add HeadQA dataset
#513 opened Oct 27, 2023 by KevinNuNu • Draft
6 tasks
@tonysy
[SIG] add ethics dataset
#495 opened Oct 20, 2023 by KevinNuNu Loading…
6 tasks
@tonysy
Integrate pytorch poc python api
#490 opened Oct 19, 2023 by HIT-cwh Loading…
6 tasks
7
[Feat] Support Knowledge-based Retriever
#348 opened Sep 3, 2023 by zhangyikaii Loading…
6
ProTip! no:milestone will show everything without a milestone.