info.ephyra.trec
Class EphyraTREC8To11

java.lang.Object
  info.ephyra.OpenEphyra
      info.ephyra.trec.OpenEphyraCorpus
          info.ephyra.trec.EphyraTREC8To11

public class EphyraTREC8To11
extends OpenEphyraCorpus

Runs and evaluates Ephyra on the data from the TREC 8-11 QA tracks.

This class extends OpenEphyraCorpus.

Version:

2007-07-11

Author:

Nico Schlaefer

Field Summary

protected static float	FACTOID_ABS_THRESH Absolute threshold for factoid question scores.
protected static int	FACTOID_MAX_ANSWERS Maximum number of factoid answers.
private static boolean	loadLog Load answers from log file?
private static java.lang.String	logFile Log file for the results returned by Ephyra.
protected static java.lang.String[]	qss Question strings.
protected static java.lang.String[]	regexs Corresponding regular expressions that describe correct answers.

Fields inherited from class info.ephyra.OpenEphyra

dir, LIST_REL_THRESH, NORMALIZER

Constructor Summary

EphyraTREC8To11()

Method Summary

private static void	loadTRECData(java.lang.String qFile, java.lang.String pFile) Loads questions and patterns from files.
static void	main(java.lang.String[] args) Runs and evaluates Epyhra on TREC data.
private static void	runAndEval() Initializes Ephyra, asks the questions and evaluates and logs the answers.

Methods inherited from class info.ephyra.trec.OpenEphyraCorpus

askFactoid, askList, initFactoidCorpus, initFactoidWeb

Methods inherited from class info.ephyra.OpenEphyra

askFactoid, commandLine, getDir, initFactoid, readLine, runPipeline

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

FACTOID_MAX_ANSWERS

protected static final int FACTOID_MAX_ANSWERS

Maximum number of factoid answers.

See Also:

Constant Field Values

FACTOID_ABS_THRESH

protected static final float FACTOID_ABS_THRESH

Absolute threshold for factoid question scores.

See Also:

Constant Field Values

logFile

private static java.lang.String logFile

Log file for the results returned by Ephyra.

loadLog

private static boolean loadLog

Load answers from log file?

qss

protected static java.lang.String[] qss

Question strings.

regexs

protected static java.lang.String[] regexs

Corresponding regular expressions that describe correct answers.

Constructor Detail

EphyraTREC8To11

public EphyraTREC8To11()

Method Detail

loadTRECData

private static void loadTRECData(java.lang.String qFile,
                                 java.lang.String pFile)

Loads questions and patterns from files.

Parameters:

qFile - name of the question file

pFile - name of the pattern file

runAndEval

private static void runAndEval()

Initializes Ephyra, asks the questions and evaluates and logs the answers.

main

public static void main(java.lang.String[] args)

Runs and evaluates Epyhra on TREC data.

Parameters:

args - argument 1: name of the question file
argument 2: name of the pattern file
[argument 3: log=logfile (if not set an unambiguous file name is generated automatically)]
[argument 5: load_log (answers are loaded from the log file instead of querying Ephyra)]