-
Notifications
You must be signed in to change notification settings - Fork 419
Issues: swe-bench/SWE-bench
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Why engine_validation.py and ./harness/run_validation.sh files are misssing
documentation
Improvements or additions to documentation
#334
opened Feb 21, 2025 by
skj092
Can repo clonning be moved to env image?
documentation
Improvements or additions to documentation
#332
opened Feb 20, 2025 by
gireeshm-vayavya
sweb.eval.x86_64.pytest-dev__pytest-5809 没有 commit id 8aba863a634f40560e25055d179220f0eefabe9a
documentation
Improvements or additions to documentation
#331
opened Feb 20, 2025 by
linzm1007
Inconsistent result of gold patch
bug
Something isn't working
#328
opened Feb 18, 2025 by
williamd4112
building image sympy__sympy-20590: Environment image sweb.env.py.x86_64.c795f4b88616b8462021ed:latest not found for sympy__sympy-20590
documentation
Improvements or additions to documentation
#325
opened Feb 14, 2025 by
linzm1007
Incorrect Python versions used to reproduce issues and verify fixes
bug
Something isn't working
#324
opened Feb 14, 2025 by
jsdelfino
Evaluating on SWE-bench multimodal
documentation
Improvements or additions to documentation
#322
opened Feb 13, 2025 by
dk-forgood
Failing to build scikit-learn env image since this weekend.
bug
Something isn't working
#321
opened Feb 12, 2025 by
peniparker24
Refactor test_specs to support more languages, reduce code duplication
#313
opened Feb 5, 2025 by
kabirgh
Understanding Improvements or additions to documentation
get_test_directives and make_eval_script_list_py
documentation
#310
opened Feb 3, 2025 by
18jeffreyma
How stable is run_evaluation.py with gold patch for SWE-bench_Verified?
documentation
Improvements or additions to documentation
#294
opened Jan 20, 2025 by
MarcCote
Environment images failed to build in running "swebench.harness.run_evaluation"
bug
Something isn't working
#293
opened Jan 18, 2025 by
haoxianghz
Some SWE-bench_Verified test specs are missing test parameters
bug
Something isn't working
#292
opened Jan 17, 2025 by
jsdelfino
Truncated parametrized test names in SWE-bench_Verified
bug
Something isn't working
#290
opened Jan 16, 2025 by
jsdelfino
Tests incorrectly named [100%] in SWE-bench-Verified instances pytest-5262 and pytest-7521
bug
Something isn't working
#289
opened Jan 16, 2025 by
jsdelfino
How can I populate the FAIL_TO_PASS and PASS_TO_PASS fields?
documentation
Improvements or additions to documentation
#287
opened Jan 15, 2025 by
ErsjanKeri
"Successful" patches fail on unexecuted developer-written tests
bug
Something isn't working
#280
opened Jan 10, 2025 by
PrinzyW
Incorrect unit tests in Something isn't working
FAIL_TO_PASS and PASS_TO_PASS
bug
#275
opened Dec 17, 2024 by
WuYff
5 Instances in Verified Fail for Gold Patch
bug
Something isn't working
#267
opened Nov 30, 2024 by
wistuba
PASS_TO_PASS and FAIL_TO_PASS test cases
documentation
Improvements or additions to documentation
#257
opened Nov 21, 2024 by
chenzimin
What decides whether a dependency is part of the "instance" or "environment" level cache?
documentation
Improvements or additions to documentation
#256
opened Nov 19, 2024 by
max-kaufmann
Previous Next
ProTip!
Type g p on any issue or pull request to go back to the pull request listing page.