Rethinking the efficiency and privacy of AI datacenters.
AI’s growing demands for energy and data pose urgent challenges for efficiency and privacy. We rethink the foundations of AI datacenters, bridging operating systems, hardware, and privacy to unlock orders-of-magnitude gains in energy efficiency while protecting data at scale. We turn fundamental advances into real-world impact.
Meet the groupRecent news
Scroll to explore ↓Cerium accepted at SOSP 2026.
A scalable multi-GPU framework for encrypted large-model inference.
PowerWeave at ISCA 2026.
Unlocking energy-efficient ML on GPUs with OS-level spatial power management.
Three MICRO Top Picks Honorable Mentions.
LithOS, EMT, and Learning to Walk recognized for their contributions to computer architecture.
Dimitrios received a VMware Faculty Award!
TMO selected as a Communications of the ACM Research Highlight (CACM)!
•Read the full article.
•Technical Perspective article by Parthasarathy Ranganathan, VP/Technical Fellow at GoogleLithOS accepted at SOSP 2025!
Learn more about our work on an Operating System for Efficient Machine Learning on GPUs.
LVM accepted at MICRO 2025!
Learn more about our work on architecting Learned Virtual Memory Translation.
Dimitrios received the IEEE CS TCCA Young Computer Architect Award!
• Learn more about the award.
• CMU School of Computer Science news.Initial patches of Contiguitas have been upstreamed into Linux 6.15!
Dimitrios received an AMD Research Faculty Award!
Joshua was selected for the Allen Newell Award for Excellence in Undergraduate Research!
Dimitrios received the Amazon Research Faculty Award!
Dimitrios received the Wilton E. Scott Institute for Energy Innovation Faculty Award!
EMT accepted at OSDI 2025!
Learn more about our work on an OS framework for new nemory translation architectures.
Joshua was selected for the CRA Outstanding Undergraduate Research Honorable Mention!
Cinnamon accepted at ASPLOS 2025!
Learn more about our work on a framework for scale-out encrypted AI.
Dimitrios received the Intel Rising Star Faculty Award!
Dimitrios received the Linux and eBPF Foundation Faculty Award!
Eliot and Vasilis join the CAOS group!
Welcome!
Kaiyang won the Qualcomm Innovation Fellowship 2024!
• Learn more about the Qualcomm Innovation Fellowship.
• CMU School of Computer Science news.Perspective accepted at ISCA 2024!
•Learn more about our work on a principled framework for secure speculation in operating systems.
• CMU CyLab news.Contiguitas selected as an IEEE MICRO Top Picks!
Learn more about our work on the pursuit of physical memory contiguity in datacenters.
David Rudo was selected for the CRA Outstanding Undergraduate Research Honorable Mention!
Memento accepted at MICRO 2023!
Learn more about our work on ephemeral memory management in serverless environments.
Two papers, Siloz, and XFaaS, accepted at SOSP 2023!
Learn more about our work on:
• DRAM isolation.
• Hyperscale and frugal Function-as-a-Service.Contiguitas won the best paper ISCA 2023!
•Learn more about our work on the pursuit of physical memory contiguity in datacenters.
•CMU School of Computer Science news.Contiguitas accepted at ISCA 2023!
Learn more about our work on the pursuit of physical memory contiguity in datacenters.
ServiceRouter accepted at OSDI 2023!
Learn more about our work on a minimal service mesh for datacenters.
Dimitrios received the NSF CAREER Award!
Learn more about our work on rebuilding virtual memory across hardware and operating systems.
IOCost selected as an IEEE MICRO Top Picks!
Learn more about our work on block IO control for containers in datacenters.
Memory Efficent Hashed Page Tables accepted at HPCA 2023!
Learn more about our work on Memory Efficient Hashed Page Tables.
Siddharth and Patrick join the CAOS group!
Welcome!
Dimitrios received three Meta research awards to improve datacenter computing systems!
Learn more about the awards:
• Meta Security Research Award.
• Meta Systems Research Award.
• Meta AI Hardware/Software Codesing.
• CMU School of Computer Science news.TMO won the best paper award at ASPLOS 2022!
Learn more about our work on transparent memory offloading in datacenters.
Three papers, IOCost, TMO, and Nested ECPTs, accepted at ASPLOS 2022!
Learn more about our work on:
• Block IO control for containers in datacenters.
• Transparent memory offloading in datacenters.
• Parallel virtualized memory translation.Dimitrios selected as a Meta Academic of the Month!
Dimitrios received a Meta Faculty Award!
For his work on architectural and operating system support for lightweight virtualization.
Dimitrios received the David J. Kuck Outstanding Ph.D. Thesis Award!
Awarded to a single outstanding doctoral thesis from the computer science department at UIUC each year.
RAS accepted at SOSP 2021!
Learn more about our work on continuously optimized region-wide datacenter resource allocation.
Dimitrios received the ACM SIGARCH & IEEE CS TCCA Outstanding Dissertation Award!
For "contributions to redesigning the abstractions and interfaces that connect hardware and operating systems".
NVOverlay accepted at ISCA 2021!
Learn more about our work on efficient and scalable high-frequency snapshotting to NVM.
Kaiyang and Ziqi join the CAOS group!
Welcome!
BabelFish selected as an IEEE MICRO Top Picks!
Learn more about our work on fusing address translations for containers.
Elastic Cuckoo Page Tables selected as a a MICRO Top Picks Honarable Mention!
Learn more about our work on rethinking virtual memory translation for parallelism.
The upstreamed Draco is featured in Linux Security at Phoronix!
Jamais Vu accepted at ASPLOS 2021!
Learn more about our work on thwarting microarchitectural replay attacks.
Draco has been upstreamed in the Linux Kernel!
Learn more about our work on architectural and operating system support for system call security.
CAOS Group Established!
And so it begins...
Latest publications
All publications ↗Research Funding
