Skip to content

Pull requests: bigcode-project/bigcode-evaluation-harness

New pull request New
Clear current search query, filters, and sorts
36 Open 121 Closed
36 Open 121 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Update multiple.py
#314 by arjunguha was merged Jul 22, 2025 Loading…
wx.ai FT support
#312 by pawelknes was closed May 22, 2025 Loading…
Train uq
#309 by zawedcvg was closed Apr 2, 2025 Loading…
Add Granite3.1 tasks
#296 by neehar18 was closed Dec 17, 2024 Loading…
ibm-watsonx-ai integration
#294 by pawelknes was closed Dec 9, 2024 Loading…
Adding the ollama generation code
#293 by nmanthan was closed Dec 9, 2024 Loading…
Fix typos
#286 by gameofby was closed Dec 4, 2024 Loading…
Update fsspec
#274 by younesbelkada was merged Oct 31, 2024 Loading…
5
MultiPL-E now supports Dart, OCaml, Elixir, Haskell, Clojure
#273 by arjunguha was merged Sep 26, 2024 Loading…
3
fix typo bug in mbppplus
#269 by zkcpku was merged Oct 20, 2024 Loading…
1
Downgrade pyext dependency
#265 by shehrozek-cerebras was merged Sep 3, 2024 Loading…
2
Update Dockerfile-multiple
#255 by arjunguha was merged Jul 14, 2024 Loading…
1
Update MultiPL-E to v3 prompts
#254 by arjunguha was merged Jul 14, 2024 Loading…
[draft]save prompts and tests passed/failed
#253 by kbmlcoding was closed Jul 25, 2024 Loading…
Updating SparseML loading to SparseAutoModel
#248 by abhinavnmagic was closed Jun 21, 2024 Loading…
Fix: Leaderboard submission Documentation
#247 by anil-gurbuz was merged Jun 21, 2024 Loading…
1
Adding support for transformers>=4.40.2 to avoid crash with mbpp
#244 by meher-m was merged Jun 24, 2024 Loading…
4
fix: rust timeout exception
#241 by seobeomjin was closed Jun 21, 2024 Loading…
1
Changes
#239 by meher-m was closed May 31, 2024 Loading…
Add a new dataset Mercury
#238 by Elfsong was merged May 29, 2024 Loading…
4
Add package name and enforce python version in setup.py
#232 by shehrozek-cerebras was merged May 5, 2024 Loading…
6
Add StudentEval from LLM4Code 2024
#229 by arjunguha was merged Apr 23, 2024 Loading…
@loubnabnl
1
fix: Multiple-E dataset fix go_test.go path for test execution
#225 by sagtanih was merged Jul 1, 2025 Loading…
1
6
refactor(evalplus): maintain mbpp+ v0.2.0
#223 by ganler was merged Apr 19, 2024 Loading…
1
Add instruct models prompts
#219 by loubnabnl was merged Apr 16, 2024 Loading…
ProTip! Adding no:label will show everything without a label.