-
Notifications
You must be signed in to change notification settings - Fork 416
Permalink
Choose a base ref
{{ refName }}
default
Choose a head ref
{{ refName }}
default
Comparing changes
Choose two branches to see what’s changed or to start a new pull request.
If you need to, you can also or
learn more about diff comparisons.
Open a pull request
Create a new pull request by comparing changes across two branches. If you need to, you can also .
Learn more about diff comparisons here.
base repository: swe-bench/SWE-bench
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: main
Could not load branches
Nothing to show
Loading
Could not load tags
Nothing to show
{{ refName }}
default
Loading
...
head repository: sweepai/SWE-bench
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: main
Could not load branches
Nothing to show
Loading
Could not load tags
Nothing to show
{{ refName }}
default
Loading
Can’t automatically merge.
Don’t worry, you can still create the pull request.
7
contributors
Commits on Mar 14, 2024
-
Use the more portable
.
instead ofsource
This avoids errors such as `/bin/sh: 1: source: not found` ``` $ python harness/run_evaluation.py --predictions_path example-predictions.json --swe_bench_tasks example.json --log_dir example-log/ --testbed example-testbed/ Error: Command 'source /home/jgross/Documents/GitHub/SWE-bench/example-testbed/fakemodel/sqlfluff__sqlfluff/1.4/tmpdx4urtao/miniconda3/bin/activate sqlfluff__sqlfluff__1.4 && echo 'activate successful' && pip install -r /home/jgross/Documents/GitHub/SWE-bench/example-testbed/fakemodel/sqlfluff__sqlfluff/1.4/tmpfnim3stm/requirements.txt' returned non-zero exit status 127. Error stdout: Error stderr: /bin/sh: 1: source: not found Error traceback: Traceback (most recent call last): File "/home/jgross/Documents/GitHub/SWE-bench/harness/context_manager.py", line 50, in __call__ output = subprocess.run(cmd, **combined_args) File "/home/jgross/.local64/mambaforge/envs/swe-bench/lib/python3.9/subprocess.py", line 528, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command 'source /home/jgross/Documents/GitHub/SWE-bench/example-testbed/fakemodel/sqlfluff__sqlfluff/1.4/tmpdx4urtao/miniconda3/bin/activate sqlfluff__sqlfluff__1.4 && echo 'activate successful' && pip install -r /home/jgross/Documents/GitHub/SWE-bench/example-testbed/fakemodel/sqlfluff__sqlfluff/1.4/tmpfnim3stm/requirements.txt' returned non-zero exit status 127. Traceback (most recent call last): File "/home/jgross/Documents/GitHub/SWE-bench/harness/run_evaluation.py", line 186, in <module> main(**vars(args)) File "/home/jgross/Documents/GitHub/SWE-bench/harness/run_evaluation.py", line 162, in main eval_engine(args) File "/home/jgross/Documents/GitHub/SWE-bench/harness/engine_evaluation.py", line 164, in main setup_testbed(data_groups[0]) File "/home/jgross/Documents/GitHub/SWE-bench/harness/engine_validation.py", line 89, in setup_testbed with TestbedContextManager( File "/home/jgross/Documents/GitHub/SWE-bench/harness/context_manager.py", line 288, in __enter__ self.exec(cmd, shell=True) File "/home/jgross/Documents/GitHub/SWE-bench/harness/context_manager.py", line 58, in __call__ raise e File "/home/jgross/Documents/GitHub/SWE-bench/harness/context_manager.py", line 50, in __call__ output = subprocess.run(cmd, **combined_args) File "/home/jgross/.local64/mambaforge/envs/swe-bench/lib/python3.9/subprocess.py", line 528, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command 'source /home/jgross/Documents/GitHub/SWE-bench/example-testbed/fakemodel/sqlfluff__sqlfluff/1.4/tmpdx4urtao/miniconda3/bin/activate sqlfluff__sqlfluff__1.4 && echo 'activate successful' && pip install -r /home/jgross/Documents/GitHub/SWE-bench/example-testbed/fakemodel/sqlfluff__sqlfluff/1.4/tmpfnim3stm/requirements.txt' returned non-zero exit status 127. ```
Configuration menu - View commit details
-
Copy full SHA for d0b5d30 - Browse repository at this point
Copy the full SHA d0b5d30View commit details -
Configuration menu - View commit details
-
Copy full SHA for 39d43ed - Browse repository at this point
Copy the full SHA 39d43edView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8653c7a - Browse repository at this point
Copy the full SHA 8653c7aView commit details
Commits on Mar 20, 2024
-
Configuration menu - View commit details
-
Copy full SHA for cbf19bd - Browse repository at this point
Copy the full SHA cbf19bdView commit details
Commits on Mar 22, 2024
-
Merge pull request #1 from xingyaoww/main
Merge some SWE-Bench fixes
Configuration menu - View commit details
-
Copy full SHA for aa45fef - Browse repository at this point
Copy the full SHA aa45fefView commit details
Commits on Mar 25, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 5005cfb - Browse repository at this point
Copy the full SHA 5005cfbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 47c30a9 - Browse repository at this point
Copy the full SHA 47c30a9View commit details -
Configuration menu - View commit details
-
Copy full SHA for f1b4650 - Browse repository at this point
Copy the full SHA f1b4650View commit details -
Configuration menu - View commit details
-
Copy full SHA for 21340c7 - Browse repository at this point
Copy the full SHA 21340c7View commit details
Commits on Mar 27, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 1bb85c6 - Browse repository at this point
Copy the full SHA 1bb85c6View commit details -
Configuration menu - View commit details
-
Copy full SHA for caa5e65 - Browse repository at this point
Copy the full SHA caa5e65View commit details -
Configuration menu - View commit details
-
Copy full SHA for 590a050 - Browse repository at this point
Copy the full SHA 590a050View commit details -
Merge pull request #2 from libowen2121/feature-infer
Add support for open source model inference
Configuration menu - View commit details
-
Copy full SHA for 39f5fb8 - Browse repository at this point
Copy the full SHA 39f5fb8View commit details
Commits on Mar 31, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 8a4d216 - Browse repository at this point
Copy the full SHA 8a4d216View commit details
Commits on Apr 1, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 163fecb - Browse repository at this point
Copy the full SHA 163fecbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9b8dde6 - Browse repository at this point
Copy the full SHA 9b8dde6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 302f81f - Browse repository at this point
Copy the full SHA 302f81fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 35ab948 - Browse repository at this point
Copy the full SHA 35ab948View commit details
Commits on Apr 6, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 3430581 - Browse repository at this point
Copy the full SHA 3430581View commit details -
Merge remote-tracking branch 'dorbanianas-fork/ad/fix-devin-benchmark…
…' into fix/sphinx-version-issues
Configuration menu - View commit details
-
Copy full SHA for 5595053 - Browse repository at this point
Copy the full SHA 5595053View commit details
Commits on Apr 7, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 925baa8 - Browse repository at this point
Copy the full SHA 925baa8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1f7f7e7 - Browse repository at this point
Copy the full SHA 1f7f7e7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 290071d - Browse repository at this point
Copy the full SHA 290071dView commit details
There are no files selected for viewing