第一章

Transcription

1 N-gram

2 Rong Jin[7] TF*IDF - SARS SARS SARS SARS 61

3 62

4 [1] Michele Banko, Vibhu O. Mittal, and Michael J. Witbrock Headline Generation Based on Statistical Translation. 38th Annual Meeting of the Association for Computational Linguistics, Hong Kong, China, 1-8 October. [2] Peter F. Brown, Stephen A. Della Pietra, Vincent J. Della Pietra, and Robert L. Mercer The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, (2): [3] Brown, Cocke, Della-Pietra, Della-Pietra, Jelinek, Lafferty, Mercer, Roossin A Statistical Approach to Machine Translation. Computational Linguistics, 16(2) June. [4] Kuang-hua Chen and Hsin-Hsi Chen The Chinese Text Retrieval Tasks of NTCIR Workshop 2. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization (NTCIR 2), pp [5] G. D. Forney The Viterbi Algorithm. Proc of the IEEE, pp [6] Rong Jin and Alexander G. Hauptmann Headline Generation using a Training Corpus. Second International Conference on Intelligent Text Text Processing and Computational Linguistics. [7] R. Jin and A. G. Hauptmann Title Generation for Spoken Broadcast News using a Training Corpus.Proceedings of ICSLP 2000, Beijing China. [8] S. Katz Estimation of probabilities from sparse data for the language model component of a speech recognizer. IEEE Transactions on Acoustics Speech and Signal 63

5 Processing, pp. 24. [9] Paul E. Kennedy and Alexander G. Hauptmann Automatic Title Generation for EM. Proceedings of the fifth ACM conference on Digital libraries. [10] G..J. McLachlan and K. E. Basford Mixture Models. Marcel Dekker, NY. [11] M. Mitra, Amit Sighal, and Chris Buckley Automatic text summarization by paragraph extraction. In Proceedings of the ACL 97/EACL 97 Workshop on Intelligent Scalable Text Summarization, Madrid, Spain. [12] Papineni, Kishore papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu IBM Research Division Technical Report. RC22176(W ), Yorktown Heights, New York. [13] Gernard Salton, A.Singhal, M. Mitra, and C. Buckley Automatic text structuring and summary. Info. Proc. And Management, 33(2): [14] T. Strzalkowski, J. Wang, and B.Wise A robust practical text summarization system. In AAAI Intelligent Text Summarization Workshop, pp , Stanford, CA. [15] M. Witbrock and V. Mittal Ultra-Summarization: A Statistical Approach to Generating Highly Condensed Non-Extractive Summaries. Proceedings of SIGIR 99, Berkeley, CA, August. [16] David Zajic, Bonnie Dorr, and Richard Schwartz Automatic headline generation for newspaper stories. In Proceedings of the Workshop on Text Summarization Postconference workshop of ACL-02, Philadelphia, PA. [17] NSC E T 9 64

6 1 <?xml version="1.0" encoding="big5"?> <xml> <doc> <id>ctc_tec_ </id> <date> </date> <title> Rambus </title> <text> Rambus Rambus DRAM Intel 820 Rambus DRAM SDRAM MHz 133 MHZ CPU Rambus DRAM SDRAM MHz MHz Rambus DRAM Rambus DRAM RIMMSDRAM DIMM RIMM DIMM

7 820 SDRAM DIMM RIMM DIMM RIMM SRIMM SRIMM SRIMM RIMM 133 MHz </text> </doc> </xml> 66

8 2 <?xml version="1.0" encoding="big5"?> <xml> <doc> <id>cts_int_ </id> <date> </date> <title> </title> <text> 67

9 SPASO-HOUSE </text> </doc> </xml> 68

10 3 <?xml version="1.0" encoding="big5"?> <xml> <doc> <id>cts_int_ </id> <date> </date> <title> </title> <text> (Oscar Wells) (Orson Welles)

11 </text> </doc> </xml> 70

12 4 <?xml version="1.0" encoding="big5"?> <xml> <doc> <id>cts_int_ </id> <date> </date> <title>46 </title> <text> </text> </doc> </xml> 71

13 5 <?xml version="1.0" encoding="big5"?> <xml> <doc> <id>ctc_sto_ </id> <date> </date> <title> </title> <text> 72

14 SOGO SOGO </text> </doc> </xml> 73

15 6 <?xml version="1.0" encoding="big5"?> <xml> <doc> <id>ctc_tec_ </id> <date> </date> <title> </title> <text> International Mobile Telecommunications200 0 WB CDMA WLL DCS-1800 Mobile Unit 10Mbps High Speed WLAM WLL 74

16 CDMA WLL WLL </text> </doc> </xml> 75

17 7 <?xml version="1.0" encoding="big5"?> <xml> <doc> <id>ctc_tec_ </id> <date> </date> <title> </title> <text> 76

18 </text> </doc> </xml> 77

19 8 <?xml version="1.0" encoding="big5"?> <xml> <doc> <id>cts_soc_ </id> <date> </date> <title> </title> <text> 78

20

21 80

22 </text> </doc> </xml> 81

23 9 <?xml version="1.0" encoding="big5"?> <xml> <doc> <id>cts_soc_ </id> <date> </date> <title> </title> <text> 82

24 </text> </doc> </xml> 10 <?xml version="1.0" encoding="big5"?> <xml> <doc> <id>cts_int_ </id> <date> </date> <title> </title> <text> </text> </doc> </xml> 83