16 July 2025
Science City Bahrenfeld
Europe/Berlin timezone

Enhancing Developer Experience in Near Real-Time Scientific Data Processing: The AsapoWorker Library

16 Jul 2025, 09:15
8h
AER Atrium (Science City Bahrenfeld)

AER Atrium

Science City Bahrenfeld

Albert-Einstein-Ring 8-10 22761 Hamburg

Speaker

Diana Rueda (Deutsches Elektronen-Synchrotron DESY)

Description

High-throughput scientific experiments generate massive data streams requiring near real-time processing for time-critical decision making. However, developing robust streaming workflows presents significant challenges in distributed computing environments.
We present AsapoWorker 1, a Python library that simplifies the development of processing workers on top of the Asapo 2 streaming framework. AsapoWorker enhances developer experience by providing automated error handling, seamless stream switching, and simplified interfaces that abstract streaming complexity.
This poster introduces AsapoWorker's core concepts and demonstrates its capabilities for scientific streaming applications. We aim to initiate a conversation with the broader developer community from research centers to discuss how the library can be improved to achieve higher adoption rates, lower introduction barriers, and facilitate easier integration of new features following established software development principles. In turn, enabling more efficient experimental workflows and accelerating scientific discovery.

I want to give a Lightning Talk no

Author

Diana Rueda (Deutsches Elektronen-Synchrotron DESY)

Co-authors

Aleksandra Tolstikova (Deutsches Elektronen-Synchrotron DESY) Anton Barty (Deutsches Elektronen-Synchrotron DESY) Marc-Olivier Andrez (Deutsches Elektronen-Synchrotron (DESY)) Mikhail Karnevskiy (Deutsches Elektronen-Synchrotron DESY) Parthasarathy Tirumalai (Deutsches Elektronen-Synchrotron DESY) Tim Schoof (Deutsches Elektronen-Synchrotron DESY)

Presentation materials

There are no materials yet.