- M.F. Balcan and A. Blum. A Discriminative Model for Semi-Supervised Learning. Journal of the ACM, 2010.
- M.F. Balcan and A. Blum.
Open Problems in Efficient Semi-Supervised PAC Learning. Open
problem, COLT 2007. [
**Monetary reward!**] - X. Zhu. Semi-Supervised Learning. Encyclopedia of Machine Learning. Springer, to appear.
- A. Carlson, J. Betteridge, R. C. Wang, E. R. Hruschka Jr., and T. M. Mitchell. Coupled Semi-Supervised Learning for Information Extraction. International Conference on Web Search and Data Mining (WSDM), 2010.
- L. Xu, M. White, and D. Schuurmans. Optimal Reverse Prediction. Twenty-Sixth International Conference on Machine Learning (ICML), 2009.
- X. Zhu, Z. Ghahramani, and J. Lafferty. Semi-supervised learning using Gaussian fields and harmonic functions. The 20th International Conference on Machine Learning (ICML) 2003.

- S. Dasgupta. Coarse sample complexity bounds for active learning. Advances in Neural Information Processing Systems (NIPS), 2005.
- A. Beygelzimer, S. Dasgupta, and J. Langford. Importance-weighted active learning. Twenty-Sixth International Conference on Machine Learning (ICML), 2009.
- M.F. Balcan, A. Beygelzimer, J. Langford. Agnostic active learning. JCSS 2009.
- S. Fine, Y. Mansour. Active Sampling for Multiple Output Identification. COLT 2006.
- M.F. Balcan, S. Hanneke, and J. Wortman. The True Sample Complexity of Active Learning. Machine Learning Journal 2010.
- S. Hanneke's thesis Theoretical Foundations of Active Learning. CMU 2009
- A. Beygelzimer, D. Hsu, N. Karampatziakis, J. Langford, and T. Zhang. Efficient Active Learning. ICML 2011 Workshop on On-line Trading of Exploration and Exploitation.
- See also the NIPS 2009 Workshop on Adaptive Sensing, Active, Learning and Experimental Design: Theory, Methods, and Applications.

- R. Kannan, H. Salmasian, and S. Vempala. "The Spectral Method for General Mixture Models". COLT 2005.
- D. Achlioptas and F. McSherry. "On Spectral Learning of Mixtures of Distributions". COLT 2005.
- M.F. Balcan, A. Blum, and S. Vempala. A Discriminative Framework for Clustering via Similarity Functions. STOC 2008. See also full journal submission.
- M.F. Balcan and P. Gupta. Robust Hierarchical Clustering. COLT 2010.
- See also the NIPS 2009 Workshop on Clustering: Science or Art? Towards Principled Approaches .

- P.L. Bartlett, M.I. Jordan, J.D. McAuliffe. Convexity, classification, and risk bounds. Journal of the American Statistical Association, 2006.
- T.Zhang, Statistical behavior and consistency of classification methods based on convex risk minimization.
- I.Steinwart, How to compare different loss functions and their risks.

- I. Mukherjee and R. E. Schapire. A theory of multiclass boosting. Advances in Neural Information Processing Systems 23, 2011
- V. Feldman. Distribution-Specific Agnostic Boosting. Innovations in Computer Science (ICS), 2010.
- A. Tauman Kalai and R. Servedio. Boosting in the Presence of Noise . JCSS 2005.

- P. Awasthi, A. Blum, and O. Sheffet. Improved Guarantees for Agnostic Learning of Disjunctions. COLT 2010.
- A. Kalai, A. Klivans, Y. Mansour, and R. Servedio. Agnostically Learning Halfspaces. FOCS 2005.
- W. S. Lee, P. L. Bartlett, and R. C. Williamson. Efficient agnostic learning of neural networks with bounded fan-in. IEEE Trans Info Theory, 1996.

- M. Warmuth and S. V. N. Vishwanathan. Leaving the Span. COLT 2005.
- M. F. Balcan, A. Blum, and N. Srebro. A Theory of Learning with Similarity Functions. Machine Learning Journal, 2008.
- N. Srebro and S. Ben-David. Learning Bounds for Support Vector Machines with Learned Kernels. 19th Annual Conference on Learning Theory (COLT), 2006.
- G. Lanckriet, N. Cristianini, P. Bartlett, and Laurent El Ghaoui. Learning the Kernel Matrix with Semidefinite Programming, Journal of Machine Learning Research 2004.

**PAC-Bayes bounds, shell-bounds, other methods of obtaining
confidence bounds.** Some papers:

- D. McAllester. Simplified PAC-BAyesian Margin Bounds. COLT 2003.
- A. Ambroladze, E. Parrado-Hernandez, and J. Shawe-Taylor. Tighter PAC-Bayes Bounds. NIPS 2006.
- J. Langford and D. McAllester. Computable Shell Decomposition Bounds. COLT 2000.
- S. Mendelson and P. Philips. On the Importance of Small Coordinate Projection. Journal of Machine Learning Research 2004.

**Learning in Graphical Models (Bayes Nets)**