- PDF Free Download

Size: px

Start display at page:

Download ""

格丁
7 years ago
Views:

5 摘要随着 Internet 的迅猛发展和日益普及, 网络文本信息急剧增长, 如何有效的组织和管理这些海量信息, 并能够快速准确全面地获得用户所需要的信息是当今信息科学技术领域面临的一大挑战文本分类作为处理和组织大量文本数据的关键技术, 可以在较大程度上解决信息杂乱现象的问题, 方便用户准确地定位所需要的信息和分流信息而且作为信息过滤信息检索搜索引擎文本数据库数字化图书馆等技术基础, 文本分类技术的研究具有重要的理论意义和广泛的应用价值然而目前大多对文本分类对象还仅是文本内容, 而忽略了网络文本的标题关键字摘要等信息对文本类别的贡献, 如何综合利用这些信息提出高效准确的分类算法是本文的热点研究内容之一本文提出了通过 KNN 算法对文本各要素进行分类, 再使用贝叶斯定理综合多分类器, 最后通过模拟退火算法协调各要素比重的多要素中文文本分类算法实验证明该算法能够有效的解决多要素文本分类问题并且与传统的文本分类方法相比有更高的分类准确率基于 KNN 的多要素中文文本分类协调算法主要包括以下三各方面 : 基于 KNN 算法的中文文本分类研究与实现主要研究了不同特征维数和不同特征选择算法对分类器的影响, 不同 K 值下 KNN 算法的分类性能最后根据实验结果, 选择最优的特征维数特征选择算法以及 K 值对各要素构造分类器, 再使用分类器得到测试文本集的类别信息, 最后对分类结果进行评估提出并实现基于 Bayes 定理的多分类器协调算法该算法将 Bayes 定理运用到多分类器的协调上来, 主要根据各分类器的分类结果以及分类器的分类性能, 结合 Bayes 定理重新计算文本分为各个类别的概率完成模拟退火算法在多要素文本分类上的应用由于多要素文本中各个要素对文本类别信息的贡献度互不相同, 因此提出将模拟退火算法应用到协调多要素的权重上, 并通过实验证明该方法的可行性与有效性关键字 :KNN 算法 ; 多要素 ; 文本分类 I

7 Abstract With the rapid development and spread of Internet, the text information on the Internet grows rapidly. It is a big challenge faced by current information science technology that how to effectively organize and manage this information and get the information user needs quickly, accurately, and comprehensively. Text classification, as the key technology to organize and process large amount of text data, can solve the problem of information disorder and be convenient for the user to accurately locate the information they need. What is more, text classification is the foundation of information filtering, information retrieval, search engines, text database, and digital library. Thus the study of text classification has important theoretical significance and application value. However, the current text classification object is just the text contents. It ignores the importance of text title, keywords, abstract and so on. Therefore, how to comprehensively utilize these information and put forward an efficient and accurate classification algorithm is the research content of this paper. This paper put forward to classify various elements of the text using KNN algorithm, and then synthesize the multiple classifiers by Bayes theorem. Finally, we coordinate the proportion of different elements by simulated annealing algorithm. The experimental results show that our algorithm could effectively solve multiple elements text classification problems and has higher accuracy than traditional algorithm. The multiple elements text classification coordinate algorithm based on KNN contains three parts. The study and implementation of Chinese text classification based on KNN. We studied the influence of different feature selection methods to classifier and the classification performance with different K values. We choose the best feature selection method and K after experiments to conduct KNN classification. We also evaluated the results of classification. III

8 Put forward and implemented the multiple classifiers coordinate algorithm based on Bayes theorem. This algorithm applies the Bayes theorem in the coordinate of multiple classifiers. According to the classification results and classifier s performance, recalculate the class of the text and get the results. Applied the simulated annealing algorithm into the multiple elements text classification. Because each element in multiple elements text contribute to text classification is different, so bring forward apply the simulated annealing algorithm into the coordinate of different elements. We validate the feasibility and effectiveness of the method by many experiments. Key words: KNN algorithm;multiple elements;text Categorization IV

9 目录第一章绪论研究背景及意义研究内容国内外研究现状国外研究现状国内研究现状本文主要工作... 6 第二章文本分类相关技术文本分类系统的工作原理文本预处理中文文本分类的特点文档集文档表示模型中文分词技术中文停用词处理文本特征选择方法信息增益 (Information Gain) 互信息 (Mutual Information) 统计 ( 2 ) 交叉熵 (Cross Entropy) 文本频率 (Document Frequency) 特征权重算法布尔加权法 (Boolean Weighting) 词频权重 TFIDF 权重 V

10 2.5 基于统计方法的分类算法类中心向量算法朴素贝叶斯算法 (Navie Bayes) 支持向量机分类算法 (SVM) K 近邻算法 (KNN) 分类性能评估单类赋值多类排序本章小结第三章基于 KNN 的多要素中文文本分类协调算法基于 KNN 的中文文本分类系统构建训练阶段测试阶段分类器评估阶段基于 Bayes 定理的多分类器协调算法 Bayes 理论相关知识基于 Bayes 定理的多分类结果协调算法模拟退火算法在多要素文本分类上的应用模拟退火算法模拟退火算法在多要素文本分类上的应用本章小结第四章实验结果与分析语料库说明文本分类算法特征数目对分类效果的影响特征选择算法对分类效果的影响 KNN 算法中 K 值对分类效果的影响基于 KNN 算法的多要素文本分类算法分类效果 KNN 算法对多要素中文文本的分类结果 VI

11 4.3.2 经协调后的多要素分类算法与传统分类方法对比本章小结第五章结论总结后续工作参考文献攻读硕士学位期间发表的论文致谢 VII

13 Contents Chapter 1 Introduction Backgroud and Signification Problem Description Research Status Research Status Abroad Research Status in China Main Work... 6 Chapter 2 Text Categorization Technology Text Categorization's Characteristic Text PreTreatments Chinese Text Categorization's Characteristic Text Set Text Describe Model Word Split Stop Word Feature Select Algorithm Information Gain Mutual Information Statistics Cross Entropy Document Frequency Feature Weight Algorithm Boolean Weighting Word Frequency Weighting TFIDF Weighting Text Categorization Algorithm based on Statistics Class Center Vector Algorithm IX

14 2.5.2 Navie Bayes Algorithm SVM KNN Evaluation Single class assignment Multi class sort Summary of This Chapter Chapter 3 Multiple elements Text categorization Coordinate Algorithm Based on KNN Multiple elements Text categorization Algorithm based on KNN The training phase The testing phase Evaluation Multiple classifier Coordinate Algorithm Base on Bayes Theory Bayes Theory Multiple classifier Coordinate Algorithm Base on Bayes Theory Multiple elements Text Categorization Coordinate Algorithm Base on SA SA Multiple elements Text Categorization Coordinate Algorithm Base on SA Summary of This Chapter Chapter 4 Experimental Results and Analysis Corpus Description Text Categorization Algorithm Effect of the number of feature on the classifier The influence of feature select algorithm on the classifier The influence of the K value Multiple elements Text CoordinateAlgorithm based on KNN The result of Multi element text categorization based on KNN X

15 4.3.2 Comparison Multi element text categorization Summary of This Chapter Chapter 5 Conclusions Conclusions Prospections of the Future Work References Publiction Acknowledgement XI

17 Degree papers are in the Xiamen University Electronic Theses and Dissertations Database. Full texts are available in the following ways: 1. If your library is a CALIS member libraries, please log on and submit requests online, or consult the interlibrary loan department in your library. 2. For users of non-calis member libraries, please mail to etd@xmu.edu.cn for delivery details.

5 5 7 5 4 4 6 9 8 40

5 5 7 5 4 4 6 9 8 40 4 5 0 959 68 959 55 959 4 957 4 5 998 4 9 959 98 8 980 8 84 4 987 4 5 6 7 8 9 986 998 989 4 977 8 5 988 6 985 8 7 98 990 5 8 998 4 9 987 4 5 4 96 9 959 8 959 4 986 4 5 5 8 96 4 5