TY - GEN
T1 - An Approach to Experiment Reproducibility Through MLOps and Semantic Web Technologies
AU - Seaman, Daniel
AU - Penafiel, David
AU - Palacio-Baus, Kenneth
AU - Saquicela, Victor
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - This article addresses the challenge of reproducing machine learning (ML) experiments by integrating processes based on MLOps and semantic technologies. The inherent complexity of experimentation in scientific research hinders reproducibility through conventional methods, which has led to the need to automate processes. In this work, a solution has been developed allowing the execution of ML experiments of other researchers and their reproducibility. The use of semantic technologies allows the complete description of the experiment, including the data and resources necessary for its execution. The approach proposed in this work contributes to the automation of the experimentation phases based on MLOps, demonstrating how it can be used to reproduce experiments and offer a solution to the complexity of experimentation in scientific research. The effectiveness of the solution proposed in this work is evaluated by means of a survey-based analysis carried out among researchers who currently use manual processes to perform machine learning experiments. The results indicate that manual processing is prone to errors and not scalable regarding the size and complexity of most experiments. Moreover, the solution proposed in this work, which combines MLOps-based processes and semantic technologies, has been well received by researchers and considered to significantly improve the efficiency, reproducibility, and scalability of machine learning experimentation.
AB - This article addresses the challenge of reproducing machine learning (ML) experiments by integrating processes based on MLOps and semantic technologies. The inherent complexity of experimentation in scientific research hinders reproducibility through conventional methods, which has led to the need to automate processes. In this work, a solution has been developed allowing the execution of ML experiments of other researchers and their reproducibility. The use of semantic technologies allows the complete description of the experiment, including the data and resources necessary for its execution. The approach proposed in this work contributes to the automation of the experimentation phases based on MLOps, demonstrating how it can be used to reproduce experiments and offer a solution to the complexity of experimentation in scientific research. The effectiveness of the solution proposed in this work is evaluated by means of a survey-based analysis carried out among researchers who currently use manual processes to perform machine learning experiments. The results indicate that manual processing is prone to errors and not scalable regarding the size and complexity of most experiments. Moreover, the solution proposed in this work, which combines MLOps-based processes and semantic technologies, has been well received by researchers and considered to significantly improve the efficiency, reproducibility, and scalability of machine learning experimentation.
KW - Experiment
KW - MLOps
KW - Reproducibility
KW - Semantic Web
KW - machine learning
UR - https://www.scopus.com/pages/publications/85182277987
U2 - 10.1109/CLEI60451.2023.10346140
DO - 10.1109/CLEI60451.2023.10346140
M3 - Contribución a la conferencia
AN - SCOPUS:85182277987
T3 - Proceedings - 2023 49th Latin American Computing Conference, CLEI 2023
BT - Proceedings - 2023 49th Latin American Computing Conference, CLEI 2023
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 49th Latin American Computing Conference, CLEI 2023
Y2 - 16 October 2023 through 20 October 2023
ER -