Research Statement
Broadly, I am interested in large-scale parallelism in computer systems and its implications on application performance, operating system design, fault tolerance and big data in cloud computing. My particular interests focus on secondary memory system technologies and optimization, scalable file and key-value storage systems, scalable machine learning and systematic testing for large scale systems. I have a strong interest in shepherding technological advances from blackboard through standards and to commercial reality
Biography
I joined the faculty of CMU's Computer Science Department in 1991. Previously I received a Ph.D. and a M.Sc. in Computer Science in 1991 and 1987, respectively, from the University of California at Berkeley. Prior to Berkeley, I received a Bachelor of Mathematics in Computer Science and Applied Mathematics in 1983 from the University of Waterloo in Ontario, Canada.
In 1993 I founded CMU's Parallel Data Laboratory (PDL) and led it until April 1999. Today the PDL is led by Dave Andersen and George Amvrosaidis. The PDL is a community that typically comprises between 6 to 9 faculty, 2 to 3 dozen students and 4 to 10 staff. It receives support and guidance from a consortium of 15 to 25 companies with interests in parallel data systems, the Parallel Data Consortium. This community holds biannual retreats and workshops to exchange technology ideas, analysis and future directions. The publications of the PDL are available for your inspection.
The principal contributions of my first twenty years of research: Redundant Arrays of Inexpensive Disks (RAID), Informed Prefetching and Caching (TIP) and Network-Attached Secure Disks (NASD), whose architectural basis shapes the Google File System and its descendents such as the Hadoop Distributed File System (HDFS) and the Parallel Network File System, pNFS, features in NFS v4.1 (video discussion), have all stimulated derivative research and development in academia and industry. RAID, in particular, is now the organizing concept of a 10+ billion-dollar marketplace (more on RAID in my 1995 RAID tutorial).
In 1999 I started Panasas Inc., a scalable storage cluster company using an object storage architecture and providing 100s of TB of high-performance storage in a single management domain for national laboratory, energy sector, auto/aero-design, life sciences, financial modeling, digital animation, and engineering design markets (USENIX FAST08, PDSW07, SC04).
In 2006 I founded a Petascale Data Storage Institute (PDSI) for the Department of Energy's Scientific Discovery through Advanced Computing (SciDAC). Led by CMU, with partners at Los Alamos, Sandia, Oak Ridge, Pacific Northwest and Lawrence Berkeley National Labs, and University of California, Santa Cruz and University of Michigan, Ann Arbor, this Institute gathers together leading experts in leadership class supercomputing storage systems to address the challenges involved in moving from today's terascale computers to the petascale computers of the next decade. PDSI has run its course, leaving ongoing collaboration among the community at the annual Parallel Data Storage Workshop (PDSW), between Los Alamos National Laboratory and CMU (IRHPIT), and an open source parallel checkpoint middleware file system (PLFS).
In 2008 I turned to Data Intensive Scalable Computing, Clouds, and Scalable Analytics, participating in the design and installation of 2 TF, 2TB, 1/2PB of computing in an OpenCirrus and an OpenCloud cluster. We installed and operate a Hadoop cluster for any and all researchers at CMU and have published observations on their use of this facility and benchmarking tools for it. Astrophysics was a strong early user, computational biology and geophysics filling out a natural science slate, but the heaviest users were doing variants of machine learning and big data and the major collaboration has been the Intel Science and Technology Center for Cloud Computing (ISTC-CC).
In 2011 I helped the New Mexico Consortium recycle retired Los Alamos National Laboratory supercomputing clusters into an NSF funded open platform for scalable systems development and testing (PRObE). PRObE offers multiple clusters with 1000s of cores in either low-core-count high-node-count clusters or high-core-count low-node-count clusters. Researchers at universities and labs from all around the country are using PRObE to demonstrate the scalability of their systems research ideas.
In 2012 I rallied a team of Machine Learning and Distributed Systems researchers to form a Big Learning research group. Our premise is that Machine Learning on Big Data presents both theoretical (exploitation of the inherent search-iness of machine learning and ensuring convergence given concurrency induced error) and a practical (distributed systems latency hiding and load balancing given unusually flexible tolerance for bounded error) challenges.
Also in 2012 I created the curriculum for and welcomed the first class of Big Data Systems masters students, now known as the Systems Major in the Master of Computational Data Sciences (MCDS). MCDS graduates are typically employed in the U.S. tech industry, earning an average salary of over $115,000 in their first post-MCDS job.
On Jan. 2 2018 I started with the Vector Institute for AI, founded in April 2017 by ACM Turing Award winner Geoffrey Hinton (Chief Scientific Advisor) and colleagues, as its first President and Chief Executive Officer. Over its first five years, I grew Vector from 20 employees (8 faculty and 12 staff) to over 150 (60 faculty and postdocs, 60 professional staff, and 30 interns) and a research community of over 700 faculty, affiliate (adjunct) faculty, postdocs, and graduate students drawn from 13 universities and 5 hospital and life sciences institutes, implemented an AI computing resource of over 1,000 GPUs and expanded Vector’s facilities from 18,000 to 33,000 sqft.
In the five years of my leadership total funding secured was increased from $135M CAD to $292M CAD. Affiliated with the University of Toronto and the University of Waterloo, among others, Vector facilitated AI research by extending the academic and computing support available in local universities, by annually sponsoring about 100 $17,500 scholarships for students pursuing AI-related master’s degrees at one of more than a dozen universities in Ontario, and by annually spending about $2M CAD topping up the stipends of graduate students and postdocs at partner universities. The other key to Vector’s mission was to assist and enable regional corporations, hospitals and entrepreneurial incubators to better use AI to compete nationally and internationally. Under my leadership, Vector annually provided over 4,000 training engagements involving multi-company collaborative projects, experiential workshops and courses, commercialization seminars, micro-advising on specific problems, and recruiting support through a facilitated talent hub. At the end of five years Vector had formal partnerships with over 200 organizations including 30 sponsoring enterprise companies (contributing over $9M CAD annually), more than 20 academic institutions, about 10 hospital and life-sciences research institutes, over 25 AI-related startup-scaleup companies, and a large and dynamic community of small and medium-sized fast growing companies involved in a variety of programs for upskilling AI in commercial uses.
After a 5 year term at Vector, I began to consult on AI Computing technology for industry and Canadian government ministries and research institutes, culminating in appointments on the Government of Canada's Advisory Council on Artificial Intelligence and its Minister of AI's 2025 Task Force on AI strategy where I contributed a set of recommendations for the country's strategy for AI Infrastructure.
In 2025 I returned to Panasas in its new incarnation as Vdura Inc as the Chief Technology and Artificial Intelligence Officer. It had recently made a set of big changes starting with its name and including a new management team and the conversion from an appliance vendor to a software defined storage vendor. I returned to lead the development of a suite of AI services and optimizations appropriate for the agentic era of modern computing.