A Computational Workflow for Interdisciplinary Deep Learning Projects utilizing bwHPC Infrastructure
Schilling, Marcel P.
Popova, Anna A.
Beitrag zu einer Konferenz
Proceedings of the 7th bwHPC Symposium ; 7 (2022). - S. 69-74. - Art.-Nr. 13. - ISBN 978-3-948303-29-7
InstitutionsKommunikations- und Informationszentrum (kiz)
Document versionpublished version (publisher's PDF)
7th bwHPC Symposium, 2021-11-08 - 2021-11-08, Ulm University (online event)
Deep neural networks have the capability to solve complex tasks through accurate function approximation. The process from submitting domain data and defining process requirements to analyzed data consists of multiple steps, disallowing a simplistic straightforward procedure. It follows that one of the core questions is: how does an application development process facilitating interaction between data scientists and domain experts look like? Practically, two connected challenges need to be addressed. Firstly, it requires a solution for handling large amounts of domain-specific data. Secondly, when dealing with complex deep neural networks, it is essential to find a concept of how model training can be designed in an computationally efficient manner. While tailored solutions for addressing these challenges in interdisciplinary deep learning projects exist, a comprehensive and structured approach is missing. Hence, we present a computational workflow to enhance these kinds of projects concerning data handling, integration of cluster computing resources such as bwHPC infrastructure, and development processes. We exemplify our proposal by means of a biomedical image analysis project.
Subject headings[GND]: Deep learning | High Temperature Capillarity | Hochleistungsrechnen
[LCSH]: Interdisciplinary research | High performance computing
[Free subject headings]: Computational Workflow | Interdisciplinary Projects | Biomedical Image Processing | Deep Neural Networks | HPC | HTC
[DDC subject group]: DDC 000 / Computer science, information & general works | DDC 620 / Engineering & allied operations
LicenseCC BY 4.0 International
MetadataShow full item record
DOI & citation
Please use this identifier to cite or link to this item: http://dx.doi.org/10.18725/OPARU-46069