SOSP Cerium: A Scalable Multi-GPU Framework for Encrypted Large-Model Inference.
Dimitrios Skarlatos
Assistant Professor
Computer Science Department
Carnegie Mellon University
Co-founder & CEO of LithosAI
Leading the CAOS group
dskarlat@cs.cmu.edu CV Scholar 9125 Gates & Hillman Centers
Administrative support: Emi Perdan
I'm always looking for highly-motivated students, apply and reach out.
News
- 2026 Cerium accepted at SOSP 2026
- 2026 Received the Scott Institute Entrepreneurship Award
- 2026 LithOS, EMT, and LVM selected as MICRO Top Picks Honorable Mentions
- 2026 PowerWeave accepted at ISCA 2026
- 2026 Received the VMware Faculty Award!
- 2025 LithOS accepted at SOSP 2025
- 2025 LVM accepted at MICRO 2025
- 2025 TMO was selected as a CACM Research Highlight!
- 2025 Honored to receive the IEEE TCCA CS Young Computer Architect Award!
- 2025 Received the Intel Outstanding Researcher Award 2025!
- 2025 Initial patches of Contiguitas have been upstreamed into Linux 6.15!
- 2025 Received the Amazon Research Faculty Award
- 2025 Received the Wilton E. Scott Institute for Energy Innovation Faculty Award
- 2025 EMT accepted at OSDI 2025
- 2025 Organizing the first workshop on SAFE-AI at ASPLOS'25
- 2024 Cinnamon accepted at ASPLOS 2025
- 2024 Received the Intel Rising Star Faculty Award 2024
- 2024 Received the Linux and eBPF Foundation Faculty Award 2024
- 2024 Kaiyang and Yuan win the Qualcomm Innovation Fellowship 2024
- 2024 Perspective accepted at ISCA 2024
- 2024 Contiguitas selected as a MICRO Top Picks
- 2023 Memento accepted at MICRO 2023
- 2023 Two papers, Siloz, XFaaS, accepted at SOSP 2023!
- 2023 Contiguitas won the best paper ISCA 2023
- 2023 Contiguitas accepted at ISCA 2023
- 2023 ServiceRouter accepted at OSDI 2023
- 2023 Received the NSF CAREER Award
- 2023 IOCost selected as a MICRO Top Picks
- 2023 Memory Efficient Hashed Page Tables accepted at HPCA 2023
- 2022 Received three Meta Faculty Awards to improve datacenter systems
- 2022 TMO won the Best Paper Award at ASPLOS
- 2022 Three papers, IOCost, TMO, Nested ECPTs, accepted at ASPLOS 2022
- 2021 Selected as a Meta Academic of the Month
- 2021 Received a Meta Faculty Award!
- 2021 Received the David J. Kuck Outstanding Ph.D. Thesis Award
- 2021 RAS accepted at SOSP 2021
- 2021 Honored to receive the ACM SIGARCH & IEEE TCCA Outstanding Dissertation Award
- 2021 NVOverlay accepted at ISCA 2021
- 2021 BabelFish selected as a MICRO Top Picks
- 2021 Elastic Cuckoo Page Tables selected as a MICRO Top Picks HM
- 2020 The upstreamed Draco is featured in Linux Security at Phoronix!
- 2020 Jamais Vu accepted at ASPLOS 2021
- 2020 Draco has been upstreamed in the Linux Kernel
- 2020 Joined Facebook Research for a year
- 2020 Draco accepted at MICRO 2020
- 2020 Invited to the 8th Heidelberg Laureate Forum
- 2020 Received the C.W. Gear Outstanding Graduate Student Award
- 2020 Open-sourced Elastic Cuckoo Hashing
- 2020 BabelFish accepted at ISCA 2020
- 2020 Elastic Cuckoo Page Tables won the Best Paper Award at ASPLOS
- 2020 MicroScope selected as a MICRO Top Picks
- 2020 V-Combiner accepted at ICS
- 2019 Elastic Cuckoo Page Tables accepted at ASPLOS 2020
- 2019 Invited to Rising Stars in Computer Architecture at Georgia Tech
- 2019 Open-sourced MicroScope
- 2019 Received the Mavis Future Faculty Fellowship!
- 2019 Received the W. J. Poppelbaum Memorial Award
- 2019 MicroScope accepted at ISCA 2019
- 2019 InvisiSpec selected as a MICRO Top Picks Honorable Mention
- 2018 PageSeer accepted at HPCA 2019
- 2018 Open-sourced InvisiSpec
- 2018 InvisiSpec accepted at MICRO 2018
- 2018 HetCore accepted at ISCA 2018
- 2018 Received the David J. Kuck Outstanding MS Thesis Award
- 2017 PageForge accepted at MICRO 2017
- 2016 Snatch accepted at MICRO 2016
- 2014 Received the Computer Science Excellence fellowship
About
I'm an Assistant Professor in the Computer Science Department at Carnegie Mellon University where I lead the CAOS group. I'm also the co-founder and CEO of LithosAI. My research bridges computer architecture and operating systems with a focus on performance, security, and efficiency for AI datacenters. Before CMU, I spent a year at Meta Research. Several of our works have been released as open-source, upstreamed into Linux and Android, and deployed in production across millions of servers.
Life's too short for slow and insecure computers.
My work has been recognized with the IEEE CS TCCA Young Computer Architect Award, the NSF CAREER award, an Intel Outstanding Researcher Award, a Linux Foundation Faculty Award, the Intel Rising Star Faculty Award, the Scott Institute Entrepreneurship Award, industry awards from Amazon, AMD, VMware, Oracle, and Meta, an ISCA Best Paper award, two ASPLOS best paper awards, four IEEE MICRO Top Picks and five honorable mentions, and a CACM Research Highlight.
I earned my PhD in Computer Science at the University of Illinois at Urbana-Champaign, working with Prof. Josep Torrellas. My thesis received the David J. Kuck Outstanding Ph.D. Thesis Award and the ACM SIGARCH & IEEE CS TCCA Outstanding Dissertation Award. While at Illinois I also received the C.W. Gear Outstanding Graduate Student Award, the Mavis Future Faculty Fellowship, the David J. Kuck Outstanding MS Thesis Award, the W.J. Poppelbaum Memorial Award, and the Computer Science Excellence Fellowship.
My alma mater is the Technical University of Crete in Greece, where I studied Electrical and Computer Engineering. As an undergraduate, I received the Limmat Stiftung Academic Excellence Award and the Academic Excellence Award of the Technical Chamber of Greece.
Research
2026
ISCA PowerWeave: Unlocking Energy-Efficient ML on GPUs with OS-Level Spatial Power Management
arxiv Agentic Architect: An Agentic AI Framework for Architecture Design Exploration and Optimization.
2025
SOSP LithOS: An Operating System for Efficient Machine Learning on GPUs.
Received an IEEE Micro's Top Picks Honorable Mention as one of the "most significant papers in computer architecture based on novelty and long-term impact" for 2025!
MICRO Learning to Walk: Architecting Learned Virtual Memory Translation.
Received an IEEE Micro's Top Picks Honorable Mention as one of the "most significant papers in computer architecture based on novelty and long-term impact" for 2025!
CACM TMO: Transparent Memory Offloading in Datacenters.
Technical Perspective article by Parthasarathy Ranganathan, VP/Technical Fellow at Google
OSDI EMT: An OS Framework for New Memory Translation Architectures
Received an IEEE Micro's Top Picks Honorable Mention as one of the "most significant papers in computer architecture based on novelty and long-term impact" for 2025!
ASPLOS Cinnamon: A Framework for Scale-out Encrypted AI
PDFSlidesDOI Open-Source release
ACM Artifact Available, Functional, and Results Reproduced!
2024
ISCA Perspective: A Principled Framework for Pliable and Secure Speculation in Operating Systems.
MICRO Top Picks The Pursuit of Physical Memory Contiguity in Datacenters.
2023
MICRO Memento: Architectural Support for Ephemeral Memory Management in Serverless Environments.
SOSP Siloz: Leveraging DRAM Isolation Domains to Prevent Inter-VM Rowhammer.
SOSP XFaaS: Hyperscale and Low Cost Serverless Functions at Meta.
OSDI ServiceRouter: Hyperscale and Minimal Cost Service Mesh at Meta.
ISCA Contiguitas: The Pursuit of Physical Memory Contiguity in Datacenters.
Selected for the ISCA 2023 Best Paper Award!
Selected in IEEE Micro's Top Picks special issue of "most significant papers in computer architecture based on novelty and long-term impact" for 2023!
Initial patches of Contiguitas have been upstreamed in the Linux Kernel!
MICRO Top Picks IOCost: Block IO Control for Containers in Datacenters.
2022
ASPLOS TMO: Transparent Memory Offloading in Datacenters.
Selected for the ASPLOS 2022 Best Paper Award!
Selected as a Communications of the ACM Research Highlight (CACM RH) 2024!
ASPLOS IOCost: Block IO Control for Containers in Datacenters.
Selected in IEEE Micro's Top Picks special issue of "most significant papers in computer architecture based on novelty and long-term impact" for 2022!
ASPLOS Parallel Virtualized Memory Translation with Nested Elastic Cuckoo Page Tables.
2021
SOSP RAS: Continuously Optimized Region-wide Datacenter Resource Allocation.
ISCA NVOverlay: Enabling Efficient and Scalable High-Frequency Snapshotting to NVM.
ASPLOS Jamais Vu: Thwarting Microarchitectural Replay Attacks.
PDFSlidesDOI Open-Source release
ACM Artifact Available, Functional, and Results Reproduced!
MICRO Top Picks BabelFish: Fusing Address Translations for Containers.
2020
MICRO Draco: Architectural and Operating System Support for System Call Security.
Draco has been upstreamed in the Linux Kernel!
Draco has been adopted by Android!
ISCA BabelFish: Fusing Address Translations for Containers.
Selected in IEEE Micro's Top Picks special issue of "most significant papers in computer architecture based on novelty and long-term impact" for 2020!
ASPLOS Elastic Cuckoo Page Tables: Rethinking Virtual Memory Translation for Parallelism.
PDFSlidesDOIVideo Open-Source release
Selected for the ASPLOS 2020 Best Paper Award!
Received an IEEE Micro's Top Picks Honorable Mention as one of the "most significant papers in computer architecture based on novelty and long-term impact" for 2020!
MICRO Top Picks MicroScope: Enabling Microarchitectural Replay Attacks.
ICS V-Combiner: Speeding-up Iterative Graph Processing on a Shared-Memory Platform with Vertex Merging
2019
ISCA MicroScope: Enabling Microarchitectural Replay Attacks.
PDFSlidesDOI Open-Source release
Selected in IEEE Micro's Top Picks special issue of "most significant papers in computer architecture based on novelty and long-term impact" for 2019!
HPCA PageSeer: Using Page Walks to Trigger Page Swaps in Hybrid Memory Systems.
US Patent Secure Cloud-based Machine Learning.
2018
MICRO InvisiSpec: Making Speculative Execution Invisible in the Cache Hierarchy.
PDFSlidesDOI Open-Source release
Received an IEEE Micro's Top Picks Honorable Mention as one of the "most significant papers in computer architecture based on novelty and long-term impact" for 2018!
ISCA HetCore: TFET-CMOS Hetero-Device Architecture for CPUs and GPUs.
2017
MICRO PageForge: A Near-Memory Content-Aware Page-Merging Architecture.
2016
MICRO Snatch: Opportunistically Reassigning Power Allocation between Processor and Memory in 3D stacks.
2013
FPL-Altera Real Time Fractal Flame Rendering.
Won the First place for the "Most Impressive use of an FPGA" category, 2013 ALTERA (Intel) Innovate Europe Contest!
HiPEAC-DFR Towards Reliable Task Parallel Programs.
Theses
PhD Thesis Rethinking Computer Architecture and Operating Systems Abstractions for Good & Evil.
David J. Kuck Outstanding Ph.D. Thesis Award
ACM SIGARCH & IEEE CS TCCA Outstanding Dissertation Award
MSc Thesis Opportunistic Power Reassignment Between Processor and Memory in 3D Stacks.
David J. Kuck Outstanding MS Thesis Award
Teaching
I regularly teach 15-418: Parallel Computer Architecture and Programming and 15-740: Computer Architecture. I also often teach 15-793: Secure Computer Systems and 15-849: Datacenter Computing.