Machine learning enables systems to learn automatically, based on patterns in data, and make better searches, decisions, or predictions. Machine learning has become increasingly important to scientific discovery. Indeed, the U.S. Department of Energy has stated that “machine learning has the potential to transform Office of Science research best practices in an age where extreme complexity and data overwhelm human cognitive and perception ability by enabling system autonomy to self-manage, heal and find patterns and provide tools for the discovery of new scientific insights.”
What have we been doing?
In the Mathematics and Computer Science Division at Argonne, we are exploring various projects involving machine learning, ranging from algorithm and software development to applications in science and the environment. The following are some examples:
- Predictive modeling of wide area data transfer
- Study of aquifer systems
- Creation of a lightweight thermal prediction system for runtime management
- Parallel I/O optimization for scalable machine learning
- Detection of silent data corruption
- Prediction models of system performance and power
- Load balancing of climate models
- Novel algorithms for Bayesian and blackbox optimization
- Scalable frameworks for neural network hyperparameter optimization and tuning
Stefan Wild chaired a session at SC17 on Machine Learning and Quantum Computing.
Where have we been publishing?
Here are some recent papers we have published in peer-reviewed journals or presented at conferences.
- MaLTESE -- Machine Learning Tool for Engine Simulations -- https://link.springer.com/chapter/10.1007%2F978-3-030-20656-7_10
- DeepHyper -- Scalable Neural Architecture and Hyperparameter Search for Deep Neural Networks -- https://www.alcf.anl.gov/user-guides/deephyper-0
We’ve also been involved in several outreach activities.
- 2017 Summer Student Symposium - This past summer several several students pursued projects in machine learning, including study of a smart pipeline for urban data science and use of deep neural networks for wind speed forecasting.
- Machine Learning Workshop for students and postdocs - at Argonne in July 2017.
- Machine Learning Workshop at Argonne in March 2017 - MCS Division researchers gave presentations on topics including application performance prediction on HPC systems
- NAISE internship program - Hosted undergraduate students from Northwestern University working on machine learning applications
- Deep Learning Workshop - at Argonne in January 2018
- Scientific Machine Learning Workshop - On Organizing Committee