8000 Issues · stanford-crfm/helm · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Issues: stanford-crfm/helm

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

127 Open 995 Closed
127 Open 995 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Upstream error when using bert_score through unitxt
#3571 opened May 9, 2025 by yifanmai
Links on scenario leaderboard table go to all runs instead of scenario runs
#3569 opened May 8, 2025 by yifanmai
2
Proposal: Integration of Cultural Alignment evaluation
#3568 opened May 7, 2025 by tqv24
Running MedHELM benchmarks on local
#3564 opened May 1, 2025 by MattLiCodes
How to Configure with Custom Model Deployments in ANNOTATOR_MODELS
#3561 opened Apr 30, 2025 by chakravarthik27
2
Proposal: Adding Vietnamese LLMs into HELM
#3559 opened Apr 29, 2025 by martinakaduc
1
max_tokens restriction for Anthropic models
#3546 opened Apr 21, 2025 by Joey-Ji
1
Dependecy Conflict while Installing Heim
#3537 opened Apr 18, 2025 by parhamzm
9
Proposal: Integration of Speech Pathology Scenarios into HELM
#3524 opened Apr 13, 2025 by patelfagun1998
2
Urgent help needed on max_tokens
#3465 opened Mar 23, 2025 by rankofootball
1
Broken links of scenario and metric data
#3435 opened Mar 14, 2025 by gaduan8
2
Proposal: Integrating Vietnamese LLM evaluation
#3431 opened Mar 12, 2025 by martinakaduc
1
Issue with link to instances beyond first page
#3425 opened Mar 12, 2025 by liamjxu
How to submit the test results on the air-bench leaderboard of HELM by our closed-source LLM
#3398 opened Mar 3, 2025 by carlWM
1
ReadTheDocs failing inside mkdocs-autorefs
#3393 opened Mar 1, 2025 by yifanmai
GPU summarization metrics require sentencepiece
#3350 opened Feb 19, 2025 by yifanmai
Anthropic Client receiving unexpected key word
#3324 opened Feb 6, 2025 by ahmeda14960
2
Adaptive evaluation by customized data loader
#3323 opened Feb 6, 2025 by sangttruong
1
Incorporating Deepseek R1
#3294 opened Jan 26, 2025 by bryanzhou008
1
Verification about support for Granite models in the HELM leaderboard
#3269 opened Jan 14, 2025 by RonalddMatias
1
Issue with Model Execution on the HumanEval Benchmark user question
#3201 opened Dec 6, 2024 by lucas-s-p
3
Add new model NECTEC (nectec/OpenThaiLLM-Prebuilt-7B, nectec/Pathumma-llm-text-1.0.0)
#3188 opened Nov 28, 2024 by JackJessada
3
At least one of model_deployment and model must be specified user question
#3184 opened Nov 25, 2024 by thallysonjsa
5
VHELM setup user question
#3183 opened Nov 24, 2024 by smsarov
1
Reproducing WMT14 user question
#3175 opened Nov 19, 2024 by MaxHahnbueck
2
ProTip! Exclude everything labeled bug with -label:bug.
0