SQL or NoSQL?: contrasting approaches to the storage, manipulation and analysis of spatio-temporal online social network data

Adrian Tear

doi:10.1007/978-3-319-09144-0_16

SQL or NoSQL? contrasting approaches to the storage, manipulation and analysis of spatio-temporal online social network data

Adrian Tear

Research output: Chapter in Book/Report/Conference proceeding › Other chapter contribution

449 Downloads (Pure)

Abstract

Researchers are now accessing millions of Online Social Network (OSN) interactions. These are available at no or low cost through Application Programming Interfaces (APIs) or data custodians including DataSift and GNIP. Records held in Extensible Markup Language (XML) or JavaScript Object Notation (JSON) are well structured but often inconveniently formatted for use in popular Relational Database Management Systems (RDBMS) or Geographic Information Systems (GIS) software. In contrast, emerging NoSQL (Not-only Structured Query Language) technologies are specially designed to ‘ingest’ unstructured data. Extract/Transform/Load (ETL) procedures for the storage and subsequent analysis of two OSN datasets in SQL/NoSQL databases are examined. The fixed data model of the relational approach may prove problematic when loading unpredictable document-based structures arising from extended periods of data collection. Although relational databases are far from obsolete the spatial analysis community seems likely to benefit from experimentation with new software explicitly designed for handling spatio-temporal Big Data.

Original language	English
Title of host publication	Computational science and its applications – ICCSA 2014
Subtitle of host publication	14th international conference, Guimarães, Portugal, June 30 – July 3, 2014, proceedings, Part I
Editors	Beniamino Murgante, Sanjay Misra, Ana Maria A. C. Rocha, Carmelo Torre, Jorge Gustavo Rocha, Maria Irene Falcao, David Taniar, Bernady O. Apduhan, Osvaldo Gervasi
Place of Publication	Berlin
Publisher	Springer
Pages	221-236
ISBN (Electronic)	9783319091440
ISBN (Print)	9783319091433
DOIs	https://doi.org/10.1007/978-3-319-09144-0_16
Publication status	Published - 2014
Event	ICCSA 14th International Conference - Guimaraes, Portugal Duration: 30 Jun 2014 → 3 Jul 2014

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	8579
ISSN (Print)	0302-9743

Conference

Conference	ICCSA 14th International Conference
Country/Territory	Portugal
City	Guimaraes
Period	30/06/14 → 3/07/14

Access to Document

10.1007/978-3-319-09144-0_16

SQL or NoSQL
The final publication is available at Springer via http://dx.doi.org/10.1007/978-3-319-09144-0_16
Accepted author manuscript (Post-print), 269 KB

http://link.springer.com/10.1007/978-3-319-09144-0_16

Cite this

Tear, A. (2014). SQL or NoSQL? contrasting approaches to the storage, manipulation and analysis of spatio-temporal online social network data. In B. Murgante, S. Misra, A. M. A. C. Rocha, C. Torre, J. G. Rocha, M. I. Falcao, D. Taniar, B. O. Apduhan, & O. Gervasi (Eds.), Computational science and its applications – ICCSA 2014: 14th international conference, Guimarães, Portugal, June 30 – July 3, 2014, proceedings, Part I (pp. 221-236). (Lecture Notes in Computer Science; Vol. 8579). Springer. https://doi.org/10.1007/978-3-319-09144-0_16

Tear, Adrian. / SQL or NoSQL? contrasting approaches to the storage, manipulation and analysis of spatio-temporal online social network data. Computational science and its applications – ICCSA 2014: 14th international conference, Guimarães, Portugal, June 30 – July 3, 2014, proceedings, Part I. editor / Beniamino Murgante ; Sanjay Misra ; Ana Maria A. C. Rocha ; Carmelo Torre ; Jorge Gustavo Rocha ; Maria Irene Falcao ; David Taniar ; Bernady O. Apduhan ; Osvaldo Gervasi. Berlin : Springer, 2014. pp. 221-236 (Lecture Notes in Computer Science).

@inbook{f1fcee1588ee4289b029a52ac8fbabe8,

title = "SQL or NoSQL?: contrasting approaches to the storage, manipulation and analysis of spatio-temporal online social network data",

abstract = "Researchers are now accessing millions of Online Social Network (OSN) interactions. These are available at no or low cost through Application Programming Interfaces (APIs) or data custodians including DataSift and GNIP. Records held in Extensible Markup Language (XML) or JavaScript Object Notation (JSON) are well structured but often inconveniently formatted for use in popular Relational Database Management Systems (RDBMS) or Geographic Information Systems (GIS) software. In contrast, emerging NoSQL (Not-only Structured Query Language) technologies are specially designed to {\textquoteleft}ingest{\textquoteright} unstructured data. Extract/Transform/Load (ETL) procedures for the storage and subsequent analysis of two OSN datasets in SQL/NoSQL databases are examined. The fixed data model of the relational approach may prove problematic when loading unpredictable document-based structures arising from extended periods of data collection. Although relational databases are far from obsolete the spatial analysis community seems likely to benefit from experimentation with new software explicitly designed for handling spatio-temporal Big Data.",

author = "Adrian Tear",

year = "2014",

doi = "10.1007/978-3-319-09144-0_16",

language = "English",

isbn = "9783319091433",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "221--236",

editor = "Beniamino Murgante and Sanjay Misra and Rocha, {Ana Maria A. C.} and Carmelo Torre and Rocha, {Jorge Gustavo} and Falcao, {Maria Irene} and David Taniar and Apduhan, {Bernady O.} and Osvaldo Gervasi",

booktitle = "Computational science and its applications – ICCSA 2014",

note = "ICCSA 14th International Conference ; Conference date: 30-06-2014 Through 03-07-2014",

}

Tear, A 2014, SQL or NoSQL? contrasting approaches to the storage, manipulation and analysis of spatio-temporal online social network data. in B Murgante, S Misra, AMAC Rocha, C Torre, JG Rocha, MI Falcao, D Taniar, BO Apduhan & O Gervasi (eds), Computational science and its applications – ICCSA 2014: 14th international conference, Guimarães, Portugal, June 30 – July 3, 2014, proceedings, Part I. Lecture Notes in Computer Science, vol. 8579, Springer, Berlin, pp. 221-236, ICCSA 14th International Conference, Guimaraes, Portugal, 30/06/14. https://doi.org/10.1007/978-3-319-09144-0_16

SQL or NoSQL? contrasting approaches to the storage, manipulation and analysis of spatio-temporal online social network data. / Tear, Adrian.
Computational science and its applications – ICCSA 2014: 14th international conference, Guimarães, Portugal, June 30 – July 3, 2014, proceedings, Part I. ed. / Beniamino Murgante; Sanjay Misra; Ana Maria A. C. Rocha; Carmelo Torre; Jorge Gustavo Rocha; Maria Irene Falcao; David Taniar; Bernady O. Apduhan; Osvaldo Gervasi. Berlin: Springer, 2014. p. 221-236 (Lecture Notes in Computer Science; Vol. 8579).

Research output: Chapter in Book/Report/Conference proceeding › Other chapter contribution

TY - CHAP

T1 - SQL or NoSQL?

T2 - ICCSA 14th International Conference

AU - Tear, Adrian

PY - 2014

Y1 - 2014

N2 - Researchers are now accessing millions of Online Social Network (OSN) interactions. These are available at no or low cost through Application Programming Interfaces (APIs) or data custodians including DataSift and GNIP. Records held in Extensible Markup Language (XML) or JavaScript Object Notation (JSON) are well structured but often inconveniently formatted for use in popular Relational Database Management Systems (RDBMS) or Geographic Information Systems (GIS) software. In contrast, emerging NoSQL (Not-only Structured Query Language) technologies are specially designed to ‘ingest’ unstructured data. Extract/Transform/Load (ETL) procedures for the storage and subsequent analysis of two OSN datasets in SQL/NoSQL databases are examined. The fixed data model of the relational approach may prove problematic when loading unpredictable document-based structures arising from extended periods of data collection. Although relational databases are far from obsolete the spatial analysis community seems likely to benefit from experimentation with new software explicitly designed for handling spatio-temporal Big Data.

AB - Researchers are now accessing millions of Online Social Network (OSN) interactions. These are available at no or low cost through Application Programming Interfaces (APIs) or data custodians including DataSift and GNIP. Records held in Extensible Markup Language (XML) or JavaScript Object Notation (JSON) are well structured but often inconveniently formatted for use in popular Relational Database Management Systems (RDBMS) or Geographic Information Systems (GIS) software. In contrast, emerging NoSQL (Not-only Structured Query Language) technologies are specially designed to ‘ingest’ unstructured data. Extract/Transform/Load (ETL) procedures for the storage and subsequent analysis of two OSN datasets in SQL/NoSQL databases are examined. The fixed data model of the relational approach may prove problematic when loading unpredictable document-based structures arising from extended periods of data collection. Although relational databases are far from obsolete the spatial analysis community seems likely to benefit from experimentation with new software explicitly designed for handling spatio-temporal Big Data.

U2 - 10.1007/978-3-319-09144-0_16

DO - 10.1007/978-3-319-09144-0_16

M3 - Other chapter contribution

SN - 9783319091433

T3 - Lecture Notes in Computer Science

SP - 221

EP - 236

BT - Computational science and its applications – ICCSA 2014

A2 - Murgante, Beniamino

A2 - Misra, Sanjay

A2 - Rocha, Ana Maria A. C.

A2 - Torre, Carmelo

A2 - Rocha, Jorge Gustavo

A2 - Falcao, Maria Irene

A2 - Taniar, David

A2 - Apduhan, Bernady O.

A2 - Gervasi, Osvaldo

PB - Springer

CY - Berlin

Y2 - 30 June 2014 through 3 July 2014

ER -

Tear A. SQL or NoSQL? contrasting approaches to the storage, manipulation and analysis of spatio-temporal online social network data. In Murgante B, Misra S, Rocha AMAC, Torre C, Rocha JG, Falcao MI, Taniar D, Apduhan BO, Gervasi O, editors, Computational science and its applications – ICCSA 2014: 14th international conference, Guimarães, Portugal, June 30 – July 3, 2014, proceedings, Part I. Berlin: Springer. 2014. p. 221-236. (Lecture Notes in Computer Science). doi: 10.1007/978-3-319-09144-0_16