Data Analysis Project (DAP) Presentation

Project Presentations
Machine Learning Department
Sigma-Optimality for Active Learning on Gaussian Random Fields
Wednesday, November 6, 2013 - 12:00pm
Luis von Ahn Awesome Classroom 4101 
Gates&Hillman Centers
Abstract:

A common classifier for unlabeled nodes on undirected graphs uses label propagation from the labeled nodes, equivalent to the harmonic predictor on Gaussian random fields (GRFs).  For active learning on GRFs, the commonly used V-optimality criterion queries nodes that reduce the L2 (regression) loss.  V-optimality satisfies a submodularity property showing that greedy reduction produces a (1-1/e) globally optimal solution.  However, L2 loss may not characterise the true nature of 0/1 loss in classification problems and thus may not be the best choice for active learning.

We consider a new criterion we call Sigma-optimality, which queries the node that minimizes the sum of the elements in the predictive covariance.  Sigma-optimality directly optimizes the risk of the surveying problem, which is to determine the proportion of nodes belonging to one class.  In this paper we extend submodularity guarantees from V-optimality to Sigma-optimality using properties specific to GRFs. We further show that GRFs satisfy the suppressor-free condition in addition to the conditional independence inherited from Markov random fields. We test Sigma-optimality on real-world graphs with both synthetic and real data and show that it outperforms V-optimality and other related methods on classification.

DAP Committee:
Jeff Schneider
Barnabas Poczos
Roy Maxion

Keywords:
For More Information, Please Contact:

diane [atsymbol] cs.cmu.edu