Unified framework for control of machine learning tasks towards effective and efficient processing of big data

Research output: Chapter in Book/Report/Conference proceedingChapter (peer-reviewed)peer-review


Big data can be generally characterised by 5 Vs – Volume, Velocity, Variety, Veracity and Variability. Many studies have been focused on using machine learning as a powerful tool of big data processing. In machine learning context , learning algorithms are typically evaluated in terms of accuracy, efficiency, interpretability and stability. These four dimensions can be strongly related to veracity, volume, variety and variability and are impacted by both the nature of learning algorithms and characteristics of data. This chapter analyses in depth how the quality of computational models can be impacted by data characteristics as well as strategies involved in learning algorithms. This chapter also introduces a unified framework for control of machine learning tasks towards appropriate employment of algorithms and efficient processing of big data. In particular, this framework is designed to achieve effective selection of data pre-processing techniques towards effective selection of relevant attributes, sampling of representative training and test data, and appropriate dealing with missing values and noise. More importantly, this framework allows the employment of suitable machine learning algorithms on the basis of the training data provided from the data pre-processing stage towards building of accurate, efficient and interpretable computational models.
Original languageEnglish
Title of host publicationData Science and Big Data
Subtitle of host publicationAn Environment of Computational Intelligence
EditorsWitold Pedrycz, Shyi-Ming Chen
Number of pages18
ISBN (Electronic)978-3-319-53474-9
ISBN (Print)978-3-319-53473-2
Publication statusPublished - 2017

Publication series

NameStudies in Big Data
ISSN (Print)2197-6503
ISSN (Electronic)2197-6511


  • big data
  • computational intelligence
  • data mining
  • machine learning
  • data processing
  • predictive modelling


Dive into the research topics of 'Unified framework for control of machine learning tasks towards effective and efficient processing of big data'. Together they form a unique fingerprint.

Cite this