Deploying and Managing a Machine Learning Platform with Kubeflow at CERN
CERN is a particle physics research organisation based in Geneva, Switzerland, whose mission is to advance human knowledge by understanding the nature of the universe. CERN operates The Large Hadron Collider (LHC), world’s largest particle accelerator, measuring 27 km in circumference. The LHC accelerates beams of particles in opposite directions almost to the speed of light before making them collide. Collisions generate short-lived particles that are otherwise impossible to detect and observe in nature. Machine learning has been growing as a solution for challenges in different areas of development and operations at CERN. Areas where ML is being applied include particle classification using graph neural networks, 3DGANs for faster generation of simulation data, or reinforced learning for beam calibration. In this talk, we will present a centralised machine learning service based on Kubeflow that has been deployed at CERN with the goal of improving overall resource usage and providing researchers with a better user experience. We will discuss the open-source technology stack for deployment and management of the service on our private cloud, with the option of expanding to public clouds. We will talk about integration with other CERN services. We will present examples of ML in high-energy physics and talk about how Kubeflow facilitates workload scaling.
Dejan Golubovic is a software engineer working in the CERN IT department. Dejan works on the CERN private cloud machine learning infrastructure with Kubernetes and Kubeflow. His primary responsibilities include the upkeep of the ML platform, collaboration with scientific users, and the development of Kubeflow features. Interests include containerised applications, Python programming, and applying technology to socially and scientifically impactful projects. Prior to joining CERN IT, Dejan worked at the CMS experiment where he developed deep learning models for particle reconstruction. Previously, he developed software for the automotive and retail industries. He holds a Master's degree from the University of Belgrade.