Mayfield, JamesFinin, Tim2018-11-052018-11-052012-06-07James Mayfield and Tim Finin, Evaluating the Quality of a Knowledge Base Populated from Text, AKBC-WEKEX '12 Proceedings of the Joint Workshop on Automatic Knowledge Base Construction and Web-scale Knowledge Extraction Pages 68-73.http://hdl.handle.net/11603/11866AKBC-WEKEX '12: Proceedings of the Joint Workshop on Automatic Knowledge Base Construction and Web-scale Knowledge Extraction, June 2012The steady progress of information extraction systems has been helped by sound methodologies for evaluating their performance in controlled experiments. Annual events like MUC, ACE and TAC have developed evaluation approaches enabling researchers to score and rank their systems relative to reference results. Yet these evaluations have only assessed component technologies needed by a knowledge base population system; none has required the construction of a knowledge base that is then evaluated directly. We describe an approach to the direct evaluation of a knowledge base and an instantiation that will be used in a 2012 TAC Knowledge Base Population track.6 pagesen-USThis item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author.cold startentity linkinginformation extractionknowledge base populationknowledge basemachine readingnatural language processingsemantic webslot fillingtext analysis conferenceUMBC Ebiquity Research GroupText