The following set comes from a document labeled "CMU low automatic scores" HOW TO READ: First set of sentences are the original reference translations. The one with the star in front of it is the one the system picked among them as "best" for the hypothesis sentence The second set of information is the score of the chosen original reference The third set of information is the score of the chosen overall reference (including psuedo-references) The last sentence is the overall chosen reference sentence. 1: ---------------------------------------------------------- painting and calligraphy competition of government employees to be held in celebration of the 5th anniversary of hong kong's return to china a painting and calligraphy competition is held to celebrate the fifth anniversary of hong kong's reversion * calligraphy and painting contest by civil servants to celebrate the 5th anniversary of hong kong's return a calligraphy and painting competition among civil cervants in the name of celebrating the fifth anniversary of hongkong return Matches,6 SentenceLength,19 ,0.3158 Recall,0.3750 1-Factor,0.3429 SortPenalty,0.8312 Score,0.2850 Matches,7 SentenceLength,19 Precision,0.3684 Recall,0.4375 1-Factor,0.4000 SortPenalty,0.9675 Score,0.3870 ref: calligraphy and painting calligraphy of is held cervants celebrate held 5th celebration of hong 5th reversion 2: ---------------------------------------------------------- china and japan's central banks signed agreement on currency exchange the central banks of china and japan signed a currency reciprocal agreement central banks of china and japan signed agreement on currency exchange * the central banks of china and japan signed currency exchange agreement Matches,5 SentenceLength,9 ,0.5556 Recall,0.4545 1-Factor,0.5000 SortPenalty,0.9330 Score,0.4665 Matches,5 SentenceLength,9 Precision,0.5556 Recall,0.4545 1-Factor,0.5000 SortPenalty,0.9330 Score,0.4665 ref: central and japans china and japan agreement on currency currency agreement 3: ---------------------------------------------------------- * georgia to withdraw troops from kodori canyon georgia is to withdraw troops from kodori gorge georgian troops to withdraw from kodori gorge georgia to withdraw from kodori gorge Matches,4 SentenceLength,14 ,0.2857 Recall,0.5714 1-Factor,0.3810 SortPenalty,0.8909 Score,0.3394 Matches,7 SentenceLength,14 Precision,0.5000 Recall,1 1-Factor,0.6667 SortPenalty,0.6730 Score,0.4486 ref: georgia to to troops kodori from gorge 4: ---------------------------------------------------------- * in october of last year , soon after both sides had another clash in kodori canyon , georgia sent troops to station there . last october , the two sides had several conflicts in the kodori gorge and georgia government deployed troops to the conflict area . conflicts between the two sides broke out again last october in kodori gorge and georgia sent its troops there shortly afterwards . the two sides clashed in oct . last year in kodori gorge sent troops there hereupon Matches,8 SentenceLength,23 ,0.3478 Recall,0.3810 1-Factor,0.3636 SortPenalty,0.9284 Score,0.3376 Matches,10 SentenceLength,23 Precision,0.4348 Recall,0.4545 1-Factor,0.4444 SortPenalty,0.9402 Score,0.4179 ref: last october of two in sides had after conflicts october the kodori sent in georgia hereupon deployed troops to troops to area 5: ---------------------------------------------------------- * it is learned that the radio station had also duped other celebrities in the past such as celine dion on april fool's day . it is understood that the radio station has also fooled celine dion and other celebrities on april fools' day . sources said the radio station once played hoax on fool's day on other celebrities like celine dion . it is reported that this radio station kidded other celebrities as celine dion on the past fools days . Matches,5 SentenceLength,22 ,0.2273 Recall,0.2174 1-Factor,0.2222 SortPenalty,0.8123 Score,0.1805 Matches,6 SentenceLength,22 Precision,0.2727 Recall,0.3333 1-Factor,0.3000 SortPenalty,0.8706 Score,0.2612 ref: sources is understood radio station once station has also fooled celine celine other on past such as days 6: ---------------------------------------------------------- karzai said on the 5th that turkey's concern over its troops' potential involvement in renewed unrest in other areas of afghanistan is redundant . karzai has dismissed concerns that turkish troops might be dragged into unrest in areas outside kabul . karzai said on the 5th turkey's worry about its troops involving into the tumult recurring in areas outside kabul was unnecessary * karzai said today that it is ununnecessary for turkey to worry about involving int the new turbulences taking place out of kabul . Matches,8 SentenceLength,28 ,0.2857 Recall,0.3636 1-Factor,0.3200 SortPenalty,0.8620 Score,0.2758 Matches,10 SentenceLength,28 Precision,0.3571 Recall,0.4762 1-Factor,0.4082 SortPenalty,0.9402 Score,0.3838 ref: karzai said today that it is worry for turkey its worry unrest in tumult renewed kabul turbulences outside place of unnecessary 7: ---------------------------------------------------------- bush says nato must forge new relationship with russia bush : nato must forge a new relationship with russia * bush says nato must establish new relationship with russia bush says nato should construct a new relationship with russia Matches,5 SentenceLength,10 ,0.5000 Recall,0.5556 1-Factor,0.5263 SortPenalty,0.9330 Score,0.4911 Matches,5 SentenceLength,10 Precision,0.5000 Recall,0.5556 1-Factor,0.5263 SortPenalty,0.9330 Score,0.4911 ref: bush : nato must establish new relationship with russia 8: ---------------------------------------------------------- former serbian interior minister of yugoslavia attempted suicide former serbian interior minister , vlajko stojiljkovic , attempts to commit suicide * former serbian interior minister of yugoslavia attempts suicide the interior minister of former serbia state of yugoslav federation tried to kill himself Matches,4 SentenceLength,10 ,0.4000 Recall,0.5000 1-Factor,0.4444 SortPenalty,0.8909 Score,0.3960 Matches,5 SentenceLength,10 Precision,0.5000 Recall,0.7143 1-Factor,0.5882 SortPenalty,0.9330 Score,0.5488 ref: former serbian minister of serbia attempts suicide 9: ---------------------------------------------------------- the bombing incident left one chinese worker dead , another two wounded , still another missing . in this bombing incident , one chinese worker was killed and two other chinese workers were injured . another chinese worker was reported missing . * a chinese worker died in the bombing attack , other two chinese workers wounded while another missing . in this bomb incident , a chinese worker was killed , two injure and one missing . Matches,7 SentenceLength,23 ,0.3043 Recall,0.4375 1-Factor,0.3590 SortPenalty,0.9675 Score,0.3473 Matches,9 SentenceLength,23 Precision,0.3913 Recall,0.6000 1-Factor,0.4737 SortPenalty,0.9082 Score,0.4302 ref: the chinese incident died in chinese bombing worker another two workers still workers another missing 10: ---------------------------------------------------------- ( detailed news ) chavez reinstated as president of venezuela comprehensive report -- chavez reclaims venezuela's presidency ( detailed reports ) chavez retakes office as president of venezuela * ( report ) chavez acceded president again Matches,2 SentenceLength,8 ,0.2500 Recall,0.4000 1-Factor,0.3077 SortPenalty,1 Score,0.3077 Matches,3 SentenceLength,8 Precision,0.3750 Recall,0.4286 1-Factor,0.4000 SortPenalty,0.7937 Score,0.3175 ref: detailed chavez retakes again president president of 11: ---------------------------------------------------------- * stocks plummet in new york exchange new york stock market closed lower new york stock market plunges nyse falls Matches,3 SentenceLength,4 ,0.7500 Recall,0.5000 1-Factor,0.6000 SortPenalty,0.7937 Score,0.4762 Matches,2 SentenceLength,4 Precision,0.5000 Recall,1 1-Factor,0.6667 SortPenalty,1 Score,0.6667 ref: new york 12: ---------------------------------------------------------- on that night , he briefed sharon on his meeting with arafat . * on that night , he briefed sharon with the details of the meeting with arafat . he informed sharon of the meeting with arafat the same night . he briefed sharon on his meeting with arafat that night . Matches,9 SentenceLength,17 ,0.5294 Recall,0.6429 1-Factor,0.5806 SortPenalty,0.8409 Score,0.4883 Matches,8 SentenceLength,17 Precision,0.4706 Recall,0.7273 1-Factor,0.5714 SortPenalty,0.9517 Score,0.5438 ref: he briefed night the meeting sharon on the night with arafat 13: ---------------------------------------------------------- except in the mixed doubles , seeds began being eliminated in all other individual competitions . with the exception of the mixed doubles , all other individual events eliminated some seeded players . * except the mixed doubles event , all other individual events witnessed elimination of seeded players . except for in mix double games , seed athletes began to be washed out in other games . Matches,5 SentenceLength,14 ,0.3571 Recall,0.3571 1-Factor,0.3571 SortPenalty,0.9330 Score,0.3332 Matches,5 SentenceLength,14 Precision,0.3571 Recall,0.3571 1-Factor,0.3571 SortPenalty,0.9330 Score,0.3332 ref: except the mixed doubles event all other individual events witnessed elimination of seeded players 14: ---------------------------------------------------------- * the seeds eliminated in women's doubles are felicity gallup / joanne muggeridge from wales they were defeated by a pair of polish and belarus-russian partners . in women's doubles , the wales seeded pair felicity gallup / joanne muggeridge was eliminated by a polish / belaruse pair . seeded pairs elminated from the women's doubles event are p . gallop / j . magretch of wales . losing to a doubles pair from poland and belarus . in the women's doubles , welsh seed f . gallop and j . margrech were defeated by a polish and belarian pair . Matches,11 SentenceLength,32 ,0.3438 Recall,0.4400 1-Factor,0.3860 SortPenalty,0.9156 Score,0.3534 Matches,12 SentenceLength,32 Precision,0.3750 Recall,0.4800 1-Factor,0.4211 SortPenalty,0.9488 Score,0.3995 ref: in womens eliminated in the wales seeded pair are gallup muggeridge muggeridge wales they were of a and belarian a pair from poland and belarus 15: ---------------------------------------------------------- we welcome all the above positive prepositions . * we welcome such positive views . we welcome the above positive suggestions . we welcome the above possitive points . Matches,2 SentenceLength,7 ,0.2857 Recall,0.4000 1-Factor,0.3333 SortPenalty,0.5000 Score,0.1667 Matches,2 SentenceLength,7 Precision,0.2857 Recall,0.4000 1-Factor,0.3333 SortPenalty,0.5000 Score,0.1667 ref: we welcome the positive views 16: ---------------------------------------------------------- taiwan dpp lefislator chen chin-teh visits beijing with fishing delegation * taiwan democratic progressive party legislator chen chin-teh to visit beijing together with fishing associations legislative yuan member from dpp chen jin-te visits beijing with fishing organizations taiwan democratic progressive party law maker chen jinde visits beijing with fishing group Matches,5 SentenceLength,14 ,0.3571 Recall,0.3333 1-Factor,0.3448 SortPenalty,0.8123 Score,0.2801 Matches,5 SentenceLength,14 Precision,0.3571 Recall,0.3846 1-Factor,0.3704 SortPenalty,0.9330 Score,0.3456 ref: taiwan dpp member chen dpp chen beijing to visit beijing fishing with group 17: ---------------------------------------------------------- serious sandstorm hit beijing again beijing attacked by another serious sandstorm severe sandstorm hits beijing again * serious sandstorm in beijing again Matches,1 SentenceLength,6 ,0.1667 Recall,0.2000 1-Factor,0.1818 SortPenalty,1 Score,0.1818 Matches,1 SentenceLength,6 Precision,0.1667 Recall,0.2000 1-Factor,0.1818 SortPenalty,1 Score,0.1818 ref: beijing sandstorm hit another serious 18: ---------------------------------------------------------- more than half of britons disapprove government's support of us assault on iraq over half of all british voters disapprove british support for an american attack on iraq over half britons oppose government's backing of us attack on iraq * more than half britons disagree the government to strike iraq Matches,3 SentenceLength,13 ,0.2308 Recall,0.3000 1-Factor,0.2609 SortPenalty,0.7937 Score,0.2071 Matches,4 SentenceLength,13 Precision,0.3077 Recall,0.4000 1-Factor,0.3478 SortPenalty,0.8909 Score,0.3099 ref: over than of britons british the government to strike iraq 19: ---------------------------------------------------------- the palestinian islamic jihad has claimed responsibility for this attack . * the palestinian militant group of islamic jihad claimed responsibility of the attack . the radical group islamic jihad of palestine has claimed responsibility for the attack . paletinian group , islamic jihad claimed responsibility of the bomb attack . Matches,2 SentenceLength,12 ,0.1667 Recall,0.1667 1-Factor,0.1667 SortPenalty,1 Score,0.1667 Matches,2 SentenceLength,12 Precision,0.1667 Recall,0.2222 1-Factor,0.1905 SortPenalty,1 Score,0.1905 ref: paletinian palestinian jihad has of palestine claimed the attack 20: ---------------------------------------------------------- six airlines suspended flights six air routes were disrupted . flights on six air routes were cancelled . * 6 flight courses stopped flying . Matches,1 SentenceLength,5 ,0.2000 Recall,0.2000 1-Factor,0.2000 SortPenalty,1 Score,0.2000 Matches,1 SentenceLength,5 Precision,0.2000 Recall,0.2500 1-Factor,0.2222 SortPenalty,1 Score,0.2222 ref: 6 air courses were