SDI / ISTC Seminar

  • Mehrabian Collaborative Innovation Center
  • ISTC Panther Hollow Conference Room - 4th floor
  • YI LU
  • Assistant Professor
  • Department of Electrical and Computer Engineering
  • University of Illinois, Urbana-Champaign

To Wait Or Not To Wait: Near-data Scheduling in Hadoop Clusters

Maximizing utilization has been the approach for shared homogeneous clusters to achieve short job completion times (hence policies such as join-shortest-queue, least-work-left, etc.) With computing co-located with data, as in Hadoop / MapReduce clusters, jobs are scheduled, instead, to maximize data locality. But is utilization, or data locality, the right metric in this case?


Yi Lu is an assistant professor in the ECE department at UIUC. She is a recipient of the Stanford Graduate Fellowship, the Sigmetrics Best paper award in 2008, the Performance Best paper award in 2011 and the NSF Career award in 2012. Her work focuses on developing scalable architectures and algorithms for large networking systems such as modern web services with dynamic content, cloud computing, and social networks. Her work spans fundamental analysis and algorithm implementation, and emphasizes design of low-complexity distributed algorithms.

Faculty Host: Mor Harchol-Balter

For More Information, Please Contact: