When you’ve got a promising research idea but lack the engineering bandwidth to make it production-ready, knowing where to turn for help can be challenging. Anas Rana, a researcher from the Institute of Cancer and Genomic Science discovered that partnering with dedicated Research Software Engineers from the Advanced Research Computing Team (ARC) within IT Services, transformed their exploratory codebase into something truly reusable.
The Challenge
The team was working with fragmented molecular perturbation data, scattered across different species and assay types. Their prototype worked, but it wasn’t modular, tested, or documented well enough to scale. The team needed a way to demonstrate that heterogeneous transcriptomic and perturbation data can be integrated into a coherent graph representation with documented provenance. With an Institute for Data and AI (IDAI) Collision Grant, the ARC team was brought in to bring the expert help.
The Collaboration That Made a Difference
What stood out wasn’t just the code delivered. The real value came from working through the schema design together, forcing the research team to make their biological assumptions explicit. The versatile ingestion architecture created means adding new datasets is now straightforward.
But perhaps most crucially, the team produced exceptional documentation—something research groups rarely prioritise internally. This proved invaluable for bringing new people onboard and supporting future funding applications.
The Outcome
The team now have a documented, reproducible prototype with proper version control, testing, and extensible architecture. The pilot proved feasible and paved the way for scaling to additional species and modalities.
The takeaway? Good ideas deserve engineering discipline. Early engagement and realistic scope-setting make all the difference.
We were pleased to hear how Anas was able to use what is on offer from Advanced Research Computing. If you have any examples of how it has helped your research, please get in touch with us at bearinfo@contacts.bham.ac.uk.
We are always looking for good examples of the use of High Performance Computing to nominate for HPC Wire Awards – see our recent winner for more details.