SWE-Bench-Pro
Quick setup for running the SWE-Bench-Pro environment server.
Setup
Install dependencies:
pip install -r requirements.txt
Running the server
python server.py
Running tests
pytest tests.py
SWE Bench Pro
Fresh
SWE-Bench Pro is an environment of 1,865 long-horizon software engineering tasks across 41 repositories. The public set contains 731 instances from copyleft-licensed repositories, designed to resist training data contamination. Tasks span bug fixes, feature requests, optimizat…
- Type
- RL Env
- Publisher
- General Reasoning
- Capabilities
- Code Generation
- Runtime
ORS- License
- unknown
- Size
- 731 tasks
- Published
- Jan 2026
Cite
Notes
Only stored in your browser.