Reproduce, Rerun, Repeat: The Fun Way to Learn Machine Learning!
- March 28, 2023
This month's user experiment blog discusses a group's experience in reproducing machine learning research on Chameleon!
This month's user experiment blog discusses a group's experience in reproducing machine learning research on Chameleon!
In today’s Tips & Tricks post we explore the idea of practical reproducibility: how to make experiments not only reproducible but reproducible in a practical way, i.e. making it as natural to play with science as it is today to read about it via publications. To make this happen we need your help – your experiments packaged in a way that will allow others to easily build upon them by extending them. Let us know what you think!
This changelog is packed! The Chameleon User Meeting Call for Presentations is out, and we have new storage FAST’23 experiment artifacts. We finally have an Ubuntu 22 appliance, and many upgrades to the images in general, more GUI improvements, a faster portal, and CHI-in-a-box is easier to get started with.
The Call for Presentations at the Chameleon User Meeting is out! We invite you to share your resaerch as well as your experiences working with the Chameleon testbed! As in prior years, to facilitate this discussion we are soliciting proposals for brief presentations (15-20 minutes) based on your resaerch or education work with Chameleon. The deadline to submit presentation proposals is April, 3rd, 2023 and as in prior years the top ten submissions will be awarded travel support to the meeting.
Today we share a very unique user experience -- a conversation with Rafael Tolosana Calasanz who is an Associate Professor in the Department of Informatics of the University of Zaragoza, Spain and has participated in the reproducibility initiative at SC. Rafael shares with us his experiences reproducing artifacts on Chameleon and his insights on reproducibility and its importance to the modern scientific process.
Chameleon will organize two BOFs on the topic of reproducibily at the USENIX FAST'23 conference.
The BOFs will be held on Tuesday and Wednesday 02/21-22 to discuss how to best package storage experiments on Chameleon for reproducibility. We will present several experiments patterns that should help you package your own experiments as well as actual packaged experiments for reproducing. Chameleon staff will be around to answer questions and provide technical help in packaging and reproducing experiments.
The date for the Chameleon User Meeting in Chicago has been set to May 2-3. We will be back very soon with a full announcement and call for presentations but in the meantime please block the time in your calendar because we are all looking forward to seeing you here!
Great news in Chameleon-land! We’re kicking off the new year with upgrades and fixes to JupyterHub, and usability improvements to the web dashboard Horizon – and save the date for the first post-pandemic in-person Chameleon User Meeting!
We go over the benefits of using a bastion host to administer your cluster. It's the easiest way to deploy a secure cluster of hosts for your experiments, and it also helps to save resources!
This month's user experiment blog covers some interesting work on tensor analysis from researchers at Arizona State University.