Improving imbalanced question classification using structured smote based approach

Alaa Mohasseb; Mohamed Bader-El-Den; Mihaela Cocea; Han Liu

doi:10.1109/ICMLC.2018.8527028

Improving imbalanced question classification using structured smote based approach

Alaa Mohasseb, Mohamed Bader-El-Den, Mihaela Cocea, Han Liu

Cardiff University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

145 Downloads (Pure)

Abstract

Questions Classification (QC) is one of the most popular text classification applications. QC plays an important role in question-answering systems. However, as in many real-world classification problems, QC may suffer from the problem of class imbalance. The classification of imbalanced data has been a key problem in machine learning and data mining. In this paper, we propose a framework that deals with the class imbalance using a hierarchical SMOTE algorithm for balancing different types of questions. The proposed framework is grammar-based, which involves using the grammatical pattern for each question and using machine learning algorithms to classify them. Experimental
results imply that the proposed framework demonstrates a good level of accuracy in identifying different question types and handling class imbalance.

Original language	English
Title of host publication	Proceedings of the 2018 International Conference on Machine Learning and Cybernetics (ICMLC)
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	593-597
Number of pages	6
Volume	2
ISBN (Electronic)	978-1-5386-5214-5
ISBN (Print)	978-1-5386-5215-2
DOIs	https://doi.org/10.1109/ICMLC.2018.8527028
Publication status	Published - 12 Nov 2018
Event	2018 International Conference on Machine Learning and Cybernetics - http://www.icmlc.com/icmlc/welcome.html, Chengdu, China Duration: 15 Jul 2018 → 18 Jul 2018

Publication series

Name	International Conference on Machine Learning and Cybernetics (ICMLC)
Publisher	IEEE
ISSN (Print)	2160-133X
ISSN (Electronic)	2160-1348

Conference

Conference	2018 International Conference on Machine Learning and Cybernetics
Abbreviated title	ICMLC 2018
Country/Territory	China
City	Chengdu
Period	15/07/18 → 18/07/18

Keywords

Information Retrieval
Text classification
Question classification
Machine Learning
Class Imbalance

Access to Document

10.1109/ICMLC.2018.8527028

Class_Imbalance___ALAA
© © 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Accepted author manuscript (Post-print), 181 KB

Cite this

Mohasseb, A., Bader-El-Den, M., Cocea, M., & Liu, H. (2018). Improving imbalanced question classification using structured smote based approach. In Proceedings of the 2018 International Conference on Machine Learning and Cybernetics (ICMLC) (Vol. 2, pp. 593-597). (International Conference on Machine Learning and Cybernetics (ICMLC)). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICMLC.2018.8527028

Mohasseb, Alaa ; Bader-El-Den, Mohamed ; Cocea, Mihaela et al. / Improving imbalanced question classification using structured smote based approach. Proceedings of the 2018 International Conference on Machine Learning and Cybernetics (ICMLC). Vol. 2 Institute of Electrical and Electronics Engineers Inc., 2018. pp. 593-597 (International Conference on Machine Learning and Cybernetics (ICMLC)).

@inproceedings{1a57b209e00a4e4abcf725801d5e99f2,

title = "Improving imbalanced question classification using structured smote based approach",

abstract = "Questions Classification (QC) is one of the most popular text classification applications. QC plays an important role in question-answering systems. However, as in many real-world classification problems, QC may suffer from the problem of class imbalance. The classification of imbalanced data has been a key problem in machine learning and data mining. In this paper, we propose a framework that deals with the class imbalance using a hierarchical SMOTE algorithm for balancing different types of questions. The proposed framework is grammar-based, which involves using the grammatical pattern for each question and using machine learning algorithms to classify them. Experimentalresults imply that the proposed framework demonstrates a good level of accuracy in identifying different question types and handling class imbalance.",

keywords = "Information Retrieval, Text classification, Question classification, Machine Learning, Class Imbalance",

author = "Alaa Mohasseb and Mohamed Bader-El-Den and Mihaela Cocea and Han Liu",

year = "2018",

month = nov,

day = "12",

doi = "10.1109/ICMLC.2018.8527028",

language = "English",

isbn = "978-1-5386-5215-2",

volume = "2",

series = "International Conference on Machine Learning and Cybernetics (ICMLC)",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "593--597",

booktitle = "Proceedings of the 2018 International Conference on Machine Learning and Cybernetics (ICMLC)",

address = "United States",

note = "2018 International Conference on Machine Learning and Cybernetics, ICMLC 2018 ; Conference date: 15-07-2018 Through 18-07-2018",

}

Mohasseb, A , Bader-El-Den, M , Cocea, M & Liu, H 2018, Improving imbalanced question classification using structured smote based approach. in Proceedings of the 2018 International Conference on Machine Learning and Cybernetics (ICMLC). vol. 2, International Conference on Machine Learning and Cybernetics (ICMLC), Institute of Electrical and Electronics Engineers Inc., pp. 593-597, 2018 International Conference on Machine Learning and Cybernetics, Chengdu, China, 15/07/18. https://doi.org/10.1109/ICMLC.2018.8527028

Improving imbalanced question classification using structured smote based approach. / Mohasseb, Alaa ; Bader-El-Den, Mohamed ; Cocea, Mihaela et al.
Proceedings of the 2018 International Conference on Machine Learning and Cybernetics (ICMLC). Vol. 2 Institute of Electrical and Electronics Engineers Inc., 2018. p. 593-597 (International Conference on Machine Learning and Cybernetics (ICMLC)).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Improving imbalanced question classification using structured smote based approach

AU - Mohasseb, Alaa

AU - Bader-El-Den, Mohamed

AU - Cocea, Mihaela

AU - Liu, Han

PY - 2018/11/12

Y1 - 2018/11/12

N2 - Questions Classification (QC) is one of the most popular text classification applications. QC plays an important role in question-answering systems. However, as in many real-world classification problems, QC may suffer from the problem of class imbalance. The classification of imbalanced data has been a key problem in machine learning and data mining. In this paper, we propose a framework that deals with the class imbalance using a hierarchical SMOTE algorithm for balancing different types of questions. The proposed framework is grammar-based, which involves using the grammatical pattern for each question and using machine learning algorithms to classify them. Experimentalresults imply that the proposed framework demonstrates a good level of accuracy in identifying different question types and handling class imbalance.

AB - Questions Classification (QC) is one of the most popular text classification applications. QC plays an important role in question-answering systems. However, as in many real-world classification problems, QC may suffer from the problem of class imbalance. The classification of imbalanced data has been a key problem in machine learning and data mining. In this paper, we propose a framework that deals with the class imbalance using a hierarchical SMOTE algorithm for balancing different types of questions. The proposed framework is grammar-based, which involves using the grammatical pattern for each question and using machine learning algorithms to classify them. Experimentalresults imply that the proposed framework demonstrates a good level of accuracy in identifying different question types and handling class imbalance.

KW - Information Retrieval

KW - Text classification

KW - Question classification

KW - Machine Learning

KW - Class Imbalance

UR - http://www.icmlc.com/

UR - https://ieeexplore.ieee.org/xpl/conhome.jsp?punumber=1000424

U2 - 10.1109/ICMLC.2018.8527028

DO - 10.1109/ICMLC.2018.8527028

M3 - Conference contribution

SN - 978-1-5386-5215-2

VL - 2

T3 - International Conference on Machine Learning and Cybernetics (ICMLC)

SP - 593

EP - 597

BT - Proceedings of the 2018 International Conference on Machine Learning and Cybernetics (ICMLC)

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2018 International Conference on Machine Learning and Cybernetics

Y2 - 15 July 2018 through 18 July 2018

ER -

Mohasseb A , Bader-El-Den M , Cocea M, Liu H. Improving imbalanced question classification using structured smote based approach. In Proceedings of the 2018 International Conference on Machine Learning and Cybernetics (ICMLC). Vol. 2. Institute of Electrical and Electronics Engineers Inc. 2018. p. 593-597. (International Conference on Machine Learning and Cybernetics (ICMLC)). doi: 10.1109/ICMLC.2018.8527028

Improving imbalanced question classification using structured smote based approach

Abstract

Publication series

Conference

Keywords

Access to Document

Fingerprint

Cite this