ERSS 2005: Coreference-Based Summarization Reloaded

Abstract

Friendly Meetings in Vancouver
We present ERSS 2005, our entry to this year's DUC competition. With only slight modifications from last year's version to accommodate the more complex context information present in DUC 2005, we achieved a similar performance to last year's entry, ranking roughly in the upper third when examining the ROUGE-1 and Basic Element score.

We also participated in the additional manual evaluation based on the new Pyramid method and performed further evaluations based on the Basic Elements method and the automatic generation of Pyramids. Interestingly, the ranking of our system differs greatly between the different measures; we attempt to analyse this effect based on correlations between the different results using the Spearman coefficient.

Reference

René Witte, Ralf Krestel, and Sabine Bergler, ERSS 2005: Coreference-Based Summarization Reloaded. Document Understanding Workshop (DUC) at HLT/EMNLP 2005, October 9-10, 2005, Vancouver, B.C., Canada.

Bibtex entry (also for download):

@InProceedings{WKB05,
  author =       {Ren{\'{e}} Witte and Ralf Krestel and Sabine Bergler},
  title =        {{ERSS 2005: Coreference-Based Summarization Reloaded}},
  booktitle =    {Proceedings of Document Understanding Workshop (DUC)},
  year =         {2005},
  month =        {October 9--10},
  address =      {Vancouver, B.C., Canada},
  note =         {\url{http://duc.nist.gov/pubs/2005papers/ukarlsruhe.witte.pdf}}
}

You can also visit the DUC 2005 proceedings website.

Download

URL: http://duc.nist.gov/pubs/2005papers/ukarlsruhe.witte.pdf. Also available: local copy.
MD5 checksum: d9b4027a2ce24060f974c7eafbf800f6

Copyright © 2005 René Witte, Ralf Krestel, and Sabine Bergler. All rights reserved.