Please use this identifier to cite or link to this item:
https://research.matf.bg.ac.rs/handle/123456789/1220
Title: | Hierarchical vs. Flat n-gram-based text categorization: Can we do better? | Authors: | Graovac, Jelena Kovačević, Jovana Pavlović-Lažetić, Gordana |
Affiliations: | Informatics and Computer Science Informatics and Computer Science |
Keywords: | Hierarchical text categorization;KNN;N-grams;SVM | Issue Date: | 1-Jan-2017 | Journal: | Computer Science and Information Systems | Abstract: | Hierarchical text categorization (HTC) refers to assigning a text document to one or more most suitable categories from a hierarchical category space. In this paper we present two HTC techniques based on kNN and SVM machine learning techniques for categorization process and byte n-gram based document representation. They are fully language independent and do not require any text preprocessing steps, or any prior information about document content or language. The effectiveness of the presented techniques and their language independence are demonstrated in experiments performed on five tree-structured benchmark category hierarchies that differ in many aspects: Reuters-Hier1, Reuters-Hier2, 15NGHier and 20NGHier in English and TanCorpHier in Chinese. The results obtained are compared with the corresponding flat categorization techniques applied to leaf level categories of the considered hierarchies. While kNN-based flat text categorization produced slightly better results than kNN-based HTC on the largest TanCorpHier and 20NGHier datasets, SVM-based HTC results do not considerably differ from the corresponding flat techniques, due to shallow hierarchies; still, they outperform both kNN-based flat and hierarchical categorization on all corpora except the smallest Reuters-Hier1 and Reuters-Hier2 datasets. Formal evaluation confirmed that the proposed techniques obtained state-of-the-art results. |
URI: | https://research.matf.bg.ac.rs/handle/123456789/1220 | ISSN: | 18200214 | DOI: | 10.2298/CSIS151017030G |
Appears in Collections: | Research outputs |
Show full item record
SCOPUSTM
Citations
12
checked on Dec 21, 2024
Page view(s)
11
checked on Dec 24, 2024
Google ScholarTM
Check
Altmetric
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.