Active Learning for
Information Extraction via Bootstrap Learning

Andrew Carlson (acarlson)
Kevin Killourhy (ksk)
Sue Ann Hong (sahong)
Sophie Wang (sophie.wang)

Read the Web, Spring 2006
School of Computer Science
Carnegie Mellon University

Overview

One of the greatest weaknesses of information extraction through bootstrap learning is the tendency of bootstrapping to diverge over time in the "correctness" of extracted facts. Hence some form of quality control is crucial in order to sustain such a bootstrapping system. Our project addresses this issue in two tiers: first, we plan to develope metrics for scoring the correctness of extractions, and second, come up with corresponding active learning for scoring metrics in order to aid quality control.

Resources


Project Proposal [pdf]

  1. Introduction
  2. Objectives
  3. Methods
  4. Evaluation

Meeting Notes

Timeline

Date RtW Goals Our Goals
4/6-4/13
  • Module code ready.
  • Integration on code stubs.
  • Finish coding our interface functions. ("proj code")
  • Divide up probability estimation derivation and coding different versions of the core fuction.
4/13-4/20
  • Integrated system based on proj code.
  • Code different versions of the core function. Test with simple bootstrapper.
4/20-4/27
  • Experiments w/ integrated code.
  • Extensions
  • Merge with J&J?
4/27-5/4
  • Final evaluation (5/4)
  • Touch up on whatever needs to be done (alg, merging with J&J).
5/4-5/11
  • Entire system write-up due.
  • Write up about our module. Help merge.