From fe79c9ff7b1bb6ab94ab6cdf32cf764b9fc29a9a Mon Sep 17 00:00:00 2001 From: Thomas Robitaille Date: Thu, 13 Nov 2025 12:03:57 +0000 Subject: [PATCH] Added proposal for benchmarking --- .../cycle5/aperio_benchmarking.md | 42 +++++++++++++++++++ 1 file changed, 42 insertions(+) create mode 100644 finance/proposal-calls/cycle5/aperio_benchmarking.md diff --git a/finance/proposal-calls/cycle5/aperio_benchmarking.md b/finance/proposal-calls/cycle5/aperio_benchmarking.md new file mode 100644 index 00000000..84e55195 --- /dev/null +++ b/finance/proposal-calls/cycle5/aperio_benchmarking.md @@ -0,0 +1,42 @@ +### Reliable performance benchmarking for the Astropy project + +### Project team + +This proposal is to fund the following people at [Aperio Software](https://aperiosoftware.com): +* Thomas Robitaille +* Stuart Mumford +This could also fund other individuals working at Aperio Software if required. + +### Project Description / Scope of Work + +The goal of this project is to set up a dedicated physical server in a way that can be used to run the astropy benchmarks. + +#### Roadmap Items + +This project will address the following roadmap item: + +- :large_orange_diamond: Maintain and improve robust performance benchmark reporting. + +#### Project / Work / Deliverables + +The main tasks in this project are: + +* Rent a commercially available dedicated physical server +* Set up the server as a GitHub self-hosted runner (taking care to bind the runner to a specific core if possible to ensure stable timings) +* Update the existing astropy core package continuous integration to use this runner for the pull request benchmark run, and tighten the threshold for performance regressions (since it should be possible to with more accurate timings) +* If time allows, add a new CI job which runs on ``main`` which will run the latest benchmarks and push the latest asv dashboard to GitHub pages to monitor + +The aim here is to keep the server configuration minimal and keep all the details about how to do the benchmarking in the CI configuration, to facilitate any potential future server migration, and ensure that project members can collaboratively work on improving how the benchmarking is done. + +### Approximate Budget + +The breakdown of the budget is as follows: + +* USD 50/month for server rental +* 40 hours @ USD 150/hour for server set-up and development work + +The total requested amount is USD 6600 + +### Period of Performance + +Jan 1, 2026 to Dec 31, 2026