An entropy-based evaluation for sentiment analysis of stock market prices using Twitter data

Andreas Kanavos; Gerasimos Vonitsanos; Alaa Mohasseb; Phivos Mylonas

doi:10.1109/SMAP49528.2020.9248440

An entropy-based evaluation for sentiment analysis of stock market prices using Twitter data

Andreas Kanavos, Gerasimos Vonitsanos, Alaa Mohasseb, Phivos Mylonas

School of Computing

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

308 Downloads (Pure)

Abstract

Stock markets prediction is considered a considerably demanding task due to its notable returns as well as due to the high randomness within the stock market. Moreover, stock price alternations are primarily related to the capital circumstances and hot occasions/events. Nowadays, researchers have sufficiently improved prediction accuracy by taking into consideration news and social media. However, the existing strategies do not employ the different impacts that events may pose. Streaming data proves to be a perpetual real-time source of data analysis as information from different web sources can be carried. In this paper, we explore whether estimations, in terms of sentiment analysis derived from Twitter posts, can be correlated to the stock market prices. Initially, the daily Twitter posts are analyzed and different n-grams along with two strategies that are utilized to increase the accuracy of the classification, are applied. Spark streaming has been employed for the processing of Twitter data, while Apache Flume has been utilized for the analysis.

Original language	English
Title of host publication	Proceedings of 2020 15th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP)
Publisher	Institute of Electrical and Electronics Engineers Inc.
Number of pages	7
DOIs	https://doi.org/10.1109/SMAP49528.2020.9248440
Publication status	Published - 9 Nov 2020
Event	15th International Workshop on Semantic and Social Media Adaptation and Personalization - Virtual Event, Zakynthos, Greece Duration: 29 Oct 2020 → 30 Oct 2020

Workshop

Workshop	15th International Workshop on Semantic and Social Media Adaptation and Personalization
Country/Territory	Greece
City	Zakynthos
Period	29/10/20 → 30/10/20

Keywords

stock market
social networks
sentiment analysis
spark streaming
Apache Flume
Apache Cassandra

Access to Document

10.1109/SMAP49528.2020.9248440

Kanavos_et_al_2020_AAM
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Accepted author manuscript (Post-print), 1.12 MB

https://smap2020.eu/

Cite this

Kanavos, A., Vonitsanos, G., Mohasseb, A., & Mylonas, P. (2020). An entropy-based evaluation for sentiment analysis of stock market prices using Twitter data. In Proceedings of 2020 15th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP) Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SMAP49528.2020.9248440

@inproceedings{28026ab27fe243b7be065bce5ae1e42f,

title = "An entropy-based evaluation for sentiment analysis of stock market prices using Twitter data",

abstract = "Stock markets prediction is considered a considerably demanding task due to its notable returns as well as due to the high randomness within the stock market. Moreover, stock price alternations are primarily related to the capital circumstances and hot occasions/events. Nowadays, researchers have sufficiently improved prediction accuracy by taking into consideration news and social media. However, the existing strategies do not employ the different impacts that events may pose. Streaming data proves to be a perpetual real-time source of data analysis as information from different web sources can be carried. In this paper, we explore whether estimations, in terms of sentiment analysis derived from Twitter posts, can be correlated to the stock market prices. Initially, the daily Twitter posts are analyzed and different n-grams along with two strategies that are utilized to increase the accuracy of the classification, are applied. Spark streaming has been employed for the processing of Twitter data, while Apache Flume has been utilized for the analysis.",

keywords = "stock market, social networks, sentiment analysis, spark streaming, Apache Flume, Apache Cassandra",

author = "Andreas Kanavos and Gerasimos Vonitsanos and Alaa Mohasseb and Phivos Mylonas",

year = "2020",

month = nov,

day = "9",

doi = "10.1109/SMAP49528.2020.9248440",

language = "English",

booktitle = "Proceedings of 2020 15th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP)",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

address = "United States",

note = "15th International Workshop on Semantic and Social Media Adaptation and Personalization ; Conference date: 29-10-2020 Through 30-10-2020",

}

Kanavos, A, Vonitsanos, G, Mohasseb, A & Mylonas, P 2020, An entropy-based evaluation for sentiment analysis of stock market prices using Twitter data. in Proceedings of 2020 15th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP). Institute of Electrical and Electronics Engineers Inc., 15th International Workshop on Semantic and Social Media Adaptation and Personalization, Zakynthos, Greece, 29/10/20. https://doi.org/10.1109/SMAP49528.2020.9248440

An entropy-based evaluation for sentiment analysis of stock market prices using Twitter data. / Kanavos, Andreas; Vonitsanos, Gerasimos; Mohasseb, Alaa et al.
Proceedings of 2020 15th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP). Institute of Electrical and Electronics Engineers Inc., 2020.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - An entropy-based evaluation for sentiment analysis of stock market prices using Twitter data

AU - Kanavos, Andreas

AU - Vonitsanos, Gerasimos

AU - Mohasseb, Alaa

AU - Mylonas, Phivos

PY - 2020/11/9

Y1 - 2020/11/9

N2 - Stock markets prediction is considered a considerably demanding task due to its notable returns as well as due to the high randomness within the stock market. Moreover, stock price alternations are primarily related to the capital circumstances and hot occasions/events. Nowadays, researchers have sufficiently improved prediction accuracy by taking into consideration news and social media. However, the existing strategies do not employ the different impacts that events may pose. Streaming data proves to be a perpetual real-time source of data analysis as information from different web sources can be carried. In this paper, we explore whether estimations, in terms of sentiment analysis derived from Twitter posts, can be correlated to the stock market prices. Initially, the daily Twitter posts are analyzed and different n-grams along with two strategies that are utilized to increase the accuracy of the classification, are applied. Spark streaming has been employed for the processing of Twitter data, while Apache Flume has been utilized for the analysis.

AB - Stock markets prediction is considered a considerably demanding task due to its notable returns as well as due to the high randomness within the stock market. Moreover, stock price alternations are primarily related to the capital circumstances and hot occasions/events. Nowadays, researchers have sufficiently improved prediction accuracy by taking into consideration news and social media. However, the existing strategies do not employ the different impacts that events may pose. Streaming data proves to be a perpetual real-time source of data analysis as information from different web sources can be carried. In this paper, we explore whether estimations, in terms of sentiment analysis derived from Twitter posts, can be correlated to the stock market prices. Initially, the daily Twitter posts are analyzed and different n-grams along with two strategies that are utilized to increase the accuracy of the classification, are applied. Spark streaming has been employed for the processing of Twitter data, while Apache Flume has been utilized for the analysis.

KW - stock market

KW - social networks

KW - sentiment analysis

KW - spark streaming

KW - Apache Flume

KW - Apache Cassandra

U2 - 10.1109/SMAP49528.2020.9248440

DO - 10.1109/SMAP49528.2020.9248440

M3 - Conference contribution

BT - Proceedings of 2020 15th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP)

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 15th International Workshop on Semantic and Social Media Adaptation and Personalization

Y2 - 29 October 2020 through 30 October 2020

ER -

An entropy-based evaluation for sentiment analysis of stock market prices using Twitter data

Abstract

Workshop

Keywords

Access to Document

Fingerprint

Cite this