Welcome to PyBugHive website!

PyBugHive is a benchmark of 149 real, manually validated bugs from 11 Python projects.

Detailed Bugs

Each entry in our database contains the summary of the bug report, the corresponding patch, and the test cases that expose the given bug and the necessary commands to setup the environment and execute the test cases.

Rich Interface

PyBugHive features a rich command line interface for accessing the buggy and fixed versions of the programs and provides the abstraction for executing the corresponding test cases. The interface facilitates highly reproducible empirical research and tool comparisons in fields such as testing, automated program repair, or bug prediction.

How to cite?

@article{antal2024pybughive,
  title={PyBugHive: A Comprehensive Database of Manually Validated, Reproducible Python Bugs},
  author={Antal, G{\'a}bor and V{\'a}ndor, Norbert and Koll{\'a}th, Istv{\'a}n and Mosolyg{\'o}, Bal{\'a}zs and Heged{\H{u}}s, P{\'e}ter and Ferenc, Rudolf},
  journal={IEEE Access},
  year={2024},
  publisher={IEEE}
}