Papers and Tech Reports about Chameleon Project

Main Chameleon Reference

Lessons Learned from the Chameleon Testbed Keahey K., Anderson J., Zhen Z., Riteau P., Ruth P., Stanzione D., Cevik M., Colleran J., Gunawi H.S., Hammock C., Mambretti J., Barnes A., Halbach F., Rocha A., Stubbs J. In Proceedings of the 2020 USENIX Annual Technical Conference (USENIX ATC '20). USENIX Association. July 2020.

BibTex Entry:

@incollection{keahey2020lessons, title={Lessons Learned from the Chameleon Testbed}, author={Kate Keahey and Jason Anderson and Zhuo Zhen and Pierre Riteau and Paul Ruth and Dan Stanzione and Mert Cevik and Jacob Colleran and Haryadi S. Gunawi and Cody Hammock and Joe Mambretti and Alexander Barnes and Fran\c{c}ois Halbach and Alex Rocha and Joe Stubbs}, booktitle={Proceedings of the 2020 USENIX Annual Technical Conference (USENIX ATC '20)}, publisher={USENIX Association}, month={July}, year={2020}}

CHI@Edge Reference

Chameleon@Edge Community Workshop Report Keahey K., Anderson J., Sherman M., Zhen Z., Powers M., Brunkan I., and Cooper A. Chameleon@Edge Community Workshop. December 2021.

BibTex Entry:

@article{title={Chameleon@Edge Community Workshop Report}, author={Keahey, Kate and Anderson, Jason and Sherman, Michael and Zhen, Zhuo and Powers, Mark and Brunkan, Isabel and Cooper, Adam}, year={2021}, doi={10.5281/zenodo.5777344}

Papers

Three Pillars of Practical Reproducibility Keahey K., and Anderson J., Powers M., and Cooper A. In Proceedings of the Reproducible Workflows, Data Management, and Security (rewords32) During eScience'23. October 2023.

BibTex Entry:

@INPROCEEDINGS {,author = "Kate Keahey, Jason Anderson, Mark Powers, and Adam Cooper.", title = "Three Pillars of Practical Reproducibility", booktitle = "rewords23: 3rd Workshop on  Reproducible Workflows, Data Management, and Security During eScience'23", year = "2023", month = "oct", location = "Limassol, Cyprus" }

KheOps: Cost-effective Repeatability, Reproducibility, and Replicability of Edge-to-Cloud Experiments Rosendo D., Keahey K., Costan A., Simonin M., Valduriez P., and Antoniu R. In Proceedings of the 2023 ACM Conference on Reproducibility and Replicability (ACM REP '23). ACM, New York, NY, USA, 62–73. June 2023.

BibTex Entry:

@inproceedings{10.1145/3589806.3600032, title = {KheOps: Cost-Effective Repeatability, Reproducibility, and Replicability of Edge-to-Cloud Experiments}, author = {Rosendo, Daniel and Keahey, Kate and Costan, Alexandru and Simonin, Matthieu and Valduriez, Patrick and Antoniu, Gabriel}, year = 2023, booktitle = {Proceedings of the 2023 ACM Conference on Reproducibility and Replicability}, location = {Santa Cruz, CA, USA}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, series = {ACM REP '23}, pages = {62–73}, doi = {10.1145/3589806.3600032}, isbn = 9798400701764, url = {https://doi.org/10.1145/3589806.3600032}, numpages = 12 }

CHI-in-a-Box: Reducing Operational Costs of Research Testbeds Keahey K., Anderson J., Sherman M., Hammock C., Zhen Z., Tillotson J., Bargo T., Long L., Ul Islam T., Babu S., Zhang H., and Halbach F. 2022. In Practice and Experience in Advanced Research Computing (PEARC ’22), July 10–14, 2022, Boston, MA, USA. ACM, New York, NY, USA, 12 pages. https://doi.org/10.1145/3491418.3530768.

BibTex Entry:

@inproceedings{10.1145/3491418.3530768, author = {Keahey, Kate and Anderson, Jason and Sherman, Michael and Hammock, Cody and Zhen, Zhuo and Tillotson, Jenett and Bargo, Timothy and Long, Lance and Ul Islam, Taimoor and Babu, Sarath and Zhang, Hongwei and Halbach, Fran\c{c}ois}, title = {CHI-in-a-Box: Reducing Operational Costs of Research Testbeds}, year = {2022}, isbn = {9781450391610}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, url = {https://doi.org/10.1145/3491418.3530768}, doi = {10.1145/3491418.3530768}, abstract = {Making scientific instruments for computer science research available and open to all is more important than ever given the constantly increasing pace of opportunity and innovation – yet, such instruments are expensive to build and operate given their complexity and need for rapid evolution to keep pace with the advancing frontier of science. This paper describes how we can lower the cost of computer science testbeds by making them easier to deploy and operate. We present CHI-in-a-Box, a packaging of CHameleon Infrastructure (CHI) underlying the Chameleon testbed, describe the practices that went into its design and implementation, and present three case studies of its use.}, booktitle = {Practice and Experience in Advanced Research Computing}, articleno = {14}, numpages = {8}, keywords = {cloud computing, maintainability, testbeds}, location = {Boston, MA, USA}, series = {PEARC '22} }

Migrating towards Single Sign-On and Federated Identity Anderson J. and Keahey K. 2022. In Practice and Experience in Advanced Research Computing (PEARC ’22), July 10–14, 2022, Boston, MA, USA. ACM, New York, NY, USA, 12 pages. https://doi.org/10. 1145/3491418.3530770.

BibTex Entry

@inproceedings{10.1145/3491418.3530770, author = {Anderson, Jason and Keahey, Kate}, title = {Migrating towards Single Sign-On and Federated Identity}, year = {2022}, isbn = {9781450391610}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, url = {https://doi.org/10.1145/3491418.3530770}, doi = {10.1145/3491418.3530770}, abstract = {This paper describes a two-tier architecture and implementation for single sign-on (SSO) federated identity support in Chameleon and the rationale that shaped it. We also describe how we migrated our users to a new account management system in privacy-preserving ways, a community that numbered in several thousand users and had created hundreds of thousands of digital artifacts.}, booktitle = {Practice and Experience in Advanced Research Computing}, articleno = {8}, numpages = {8}, keywords = {cloud computing, access control, authentication, federation}, location = {Boston, MA, USA}, series = {PEARC '22} }

Overcast: Running Controlled Experiments Spanning Research and Commercial Clouds Ruth P., Keahey K., Cevik M., Zhen Z., Wang C., and Anderson J. In Proceedings of the IEEE Conference Computer and Networking Experimental Research using Testbeds (CNERT 2021). IEEE Press. May 2021

BibTex Entry:

@INPROCEEDINGS{9484517,  author={Ruth, Paul and Keahey, Kate and Cevik, Mert and Zhen, Zhuo and Wang, Cong and Anderson, Jason},  booktitle={IEEE INFOCOM 2021 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)},   title={Overcast: Running Controlled Experiments Spanning Research and Commercial Clouds},   year={2021},  volume={},  number={},  pages={1-6},  doi={10.1109/INFOCOMWKSHPS51825.2021.9484517}}

The Silver Lining Keahey K. IEEE Internet Computing. 24 no. 4 (2020): 55-59. August 2020

BibTex Entry:

@article{title={The Silver Lining}, author={Keahey, Kate}, journal={IEEE Internet Computing}, volume={24}, number={4}, pages={55-59}, month={Jul}, year={2020}, note={10.1109/MIC.2020.3013361}}

A Case for Integrating Experimental Containers with Notebooks Anderson J. and Keahey K. In Proceedings of the 11th IEEE International Conference on Cloud Computing Technology and Science (CloudCom 2019). IEEE Press. December 2019 (best paper runner-up)

BibTex Entry:

@INPROCEEDINGS{8968868,  title={A Case for Integrating Experimental Containers with Notebooks}, author={Anderson, Jason and Keahey, Kate},  booktitle={2019 IEEE International Conference on Cloud Computing Technology and Science (CloudCom)},  year={2019},  pages={151-158},  doi={10.1109/CloudCom.2019.00032}}

Experimenting with AWS Direct Connect using Chameleon, ExoGENI, and Internet2 Cloud Connect Ruth P. and Cevik M. In Proceedings of the Midscale Education and Research Infrastructure and Tools (MERIT 2019) at ICNP 2019. IEEE Press. October 2019

BibTex Entry:

@INPROCEEDINGS{8888095,  title={Experimenting with AWS Direct Connect using Chameleon, ExoGENI, and Internet2 Cloud Connect}, author={Ruth, Paul and Cevik, Mert},  booktitle={2019 IEEE 27th International Conference on Network Protocols (ICNP)},  year={2019},  pages={1-2},  doi={10.1109/ICNP.2019.8888095}}

Chameleon: A Large-Scale, Deeply Reconfigurable Testbed for Computer Science Research Keahey K., Mambretti J., Ruth P., and Stanzione D. In Proceedings of the Midscale Education and Research Infrastructure and Tools (MERIT 2019) at ICNP 2019. IEEE Press. October 2019

BibTex Entry:

@INPROCEEDINGS{8888067,  title={Chameleon: A Large-Scale, Deeply Reconfigurable Testbed for Computer Science Research}, author={Keahey, Kate and Mambretti, Joe and Ruth, Paul and Stanzione, Dan},  booktitle={2019 IEEE 27th International Conference on Network Protocols (ICNP)},  year={2019},  volume={},  number={},  pages={1-2},  doi={10.1109/ICNP.2019.8888067}}

Operational Lessons from Chameleon Keahey K., Anderson J., Ruth P., Colleran J, Hammock C., Stubbs J. and Zhen Z. In Proceedings of the Humanware Advancing Research in the Cloud (HARC'19) at PEARC'19. ACM July 2019

BibTex Entry:

@inproceedings{10.1145/3355738.3355750, title = {Operational Lessons from Chameleon}, author = {Keahey, Kate and Anderson, Jason and Ruth, Paul and Colleran, Jacob and Hammock, Cody and Stubbs, Joe and Zhen, Zhuo}, year = {2019}, isbn = {9781450372794}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, url = {https://doi.org/10.1145/3355738.3355750}, doi = {10.1145/3355738.3355750}, booktitle = {Proceedings of the Humans in the Loop: Enabling and Facilitating Research on Cloud Computing}, articleno = {5}, numpages = {7}, keywords = {cloud computing, DevOps, cloud operations}, location = {Chicago, IL, USA}, series = {HARC '19}}

Managing Allocatable Resources Keahey K., Riteau P., Anderson J. and Zhen Z In Proceedings of the IEEE 2019 International Conference on Cloud Computing (CLOUD 2019). IEEE Press. July 2019

BibTex Entry:

@INPROCEEDINGS{8814544, title={Managing Allocatable Resources}, author={Keahey, Kate and Riteau, Pierre and Anderson, Jason and Zhen, Zhuo}, booktitle={2019 IEEE 12th International Conference on Cloud Computing (CLOUD)}, year={2019}, volume={}, number={}, pages={41-49},  doi={10.1109/CLOUD.2019.00019}}

Chameleon: a Scalable Production Testbed for Computer Science Research Keahey K., Riteau P., Stanzione D., Cockerill T., Mambretti J., Rad P., Ruth P. In: Jeffrey Vetter (eds) Contemporary High Performance Computing: From Petascale toward Exascale, Volume 3. Chapman & Hall/CRC Computational Science, CRC Press, Boca Raton, FL: CRC Press, May 2019, vol. 3, ch. 5, pp. 123-148

BibTex Entry:

@inbook{inbook, title = {Chameleon: A Scalable Production Testbed for Computer Science Research}, author = {Keahey, Kate and Riteau, Pierre and Stanzione, Dan and Cockerill, Tim and Mambretti, Joe and Rad, Paul and Ruth, Paul}, year = {2019}, month = {05}, pages = {123-148}, isbn = {9781351036863},doi = {10.1201/9781351036863-5}}

Wide-area Software Defined Networking Experiments using Chameleon Cevik M., Ruth P., Keahey K., and Riteau P. In Proceedings of the IEEE Conference Computer and Networking Experimental Research using Testbeds (CNERT 2019). IEEE Press. April 2019

BibTex Entry:

@inproceedings{inproceedings, title = {Wide-area Software Defined Networking Experiments using Chameleon}, author = {Çevik, Mert and Ruth, Paul and Keahey, Kate and Riteau, Pierre}, year = {2019}, month = {04}, pages = {811-816}, doi = {10.1109/INFCOMW.2019.8845093}}

Application-based QoE support with P4 and OpenFlow Bhat D., Anderson J., Ruth P., Zink M., and Keahey K. In Proceedings of the IEEE Conference Computer and Networking Experimental Research using Testbeds (CNERT 2019). IEEE Press. April 2019

BibTex Entry:

@inproceedings{title = {Application-based QoE support with P4 and OpenFlow}, author = {Bhat, Divyashri and Anderson, Jason and Ruth, Paul and Zink, Michael and Keahey, Kate},   booktitle = {2019 Computer and Networking Experimental Research using Testbeds in conjunction with the 2019 IEEE International Conference on Computer Communications (Paris, FR, 04/29/2019 - 05/02/2019)}}

Posters

Future-Proof Your Research: Designing for Replicability and Reproducibility Brunkan, I., Keahey K., Zhen Z., and Toksoz L. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC’20 Poster). IEEE Press. November 2020
From IoT to Cloud: Research Platform for IoT/Cloud Experiments Lin J. and Keahey K. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC'19 Poster). IEEE Press. November 2019
Sharing and Replicability of Notebook-Based Research on Open Testbeds King M., Anderson J. and Keahey K. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC'19 Poster). IEEE Press. November 2019
Reproducibility as Side Effect Wang S., Zhen Z., Anderson J., Keahey K. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC'18 Poster). IEEE Press. November 2018