8000 Issues · SWE-bench/SWE-bench · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Issues: SWE-bench/SWE-bench

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

40 Open 224 Closed
40 Open 224 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Allow Azure OpenAI API configuration for inference run bug Something isn't working
#419 opened Jun 13, 2025 by vincentgiraud
1
The resolved rate fluctuates across each test with the same prediction file bug Something isn't working
#418 opened Jun 12, 2025 by zhimin-z
2
Error creating sandbox using Modal bug Something isn't working
#414 opened Jun 6, 2025 by anastasiya1155
Unavailable docker containers for SWE-multimodal bug Something isn't working
#413 opened Jun 5, 2025 by JegernOUTT
@carlosejimenez @ofirpress
1
Difference between patch_is_None and patch_exists? documentation Improvements or additions to documentation
#410 opened Jun 2, 2025 by zhimin-z
Harness no longer works: Could not find requirements.txt for some tasks
#400 opened May 16, 2025 by harshraj172
1
1
Strategy for broken env image builds documentation Improvements or additions to documentation
#399 opened May 16, 2025 by lacabra
4
Some instances from the SWE-Bench Verified are failing to be built. (matplotlib__matplotlib-25775, matplotlib__matplotlib-26208, and others) bug Something isn't working
#398 opened May 16, 2025 by StwayneXG
1
Multimodal: No 'karma.conf.cjs' in the commit of the instance chartjs__Chart.js-8593's repo bug Something isn't working
#395 opened May 14, 2025 by KbsdJames
Failed to apply patch to container bug Something isn't working
#383 opened Apr 22, 2025 by lycfight
5
Context length of BM25 retrieved results. documentation Improvements or additions to documentation
#380 opened Apr 17, 2025 by VincentXWD
When running create_text_dataset, the generated text field did not include all the files modified in the patch. bug Something isn't working
#378 opened Apr 14, 2025 by lycfight
Inconsistent evaluation in Modal vs without using Modal bug Something isn't working
#377 opened Apr 11, 2025 by maddyonline
2
Docker images for arm64
#375 opened Apr 9, 2025 by igor-susic
2
Error occurred when executing create_text_dataset. bug Something isn't working
#374 opened Apr 7, 2025 by lycfight
2
All the gold standards fail the test.
#372 opened Apr 4, 2025 by liuhaixu2021
4
harness.run_evaluation is not compatible with .ipynb files. bug Something isn't working
#363 opened Mar 10, 2025 by oliverRamirez4
3
how are instance diffs cleaned up? documentation Improvements or additions to documentation
#362 opened Mar 10, 2025 by 18jeffreyma
Making datasets failed bug Something isn't working
#361 opened Mar 9, 2025 by corberan
@carlosejimenez
Evaluation on Modal hangs for instance matplotlib__matplotlib-23964 bug Something isn't working
#359 opened Mar 6, 2025 by jemeza-codegen
Failure in parsing test output forastropy__astropy-12907 bug Something isn't working
#357 opened Mar 5, 2025 by jemeza-codegen
Evaluation discrepancy between swebench-full and swebench verified bug Something isn't working
#354 opened Mar 4, 2025 by marcmac
2
git apply error during evaluation bug Something isn't working
#345 opened Feb 28, 2025 by tangken333
2
Failure In Collecting the Test Cases In Task astropy__astropy-8872 bug Something isn't working
#343 opened Feb 27, 2025 by chenzhi-cz
1
Failure In Setting Up the Test Cases In Task astropy__astropy-8707 bug Something isn't working
#342 opened Feb 27, 2025 by chenzhi-cz
1
ProTip! Find all open issues with in progress development work with linked:pr.
0