If its an open source project, the answer is to rebuild from the tagged source.
Eg: https://github.com/fastapi/fastapi/tree/0.112.4
With the right repo setup, you can pip install git+https://github.com/fastapi/fastapi.git@0.112.4
(example only, not sure it works), so pypi doesn't need to keep all previous wheels, its just easier for it to do so.