Induction of modular classification rules by information entropy based rule generation

Research output: Chapter in Book/Report/Conference proceedingChapter (peer-reviewed)peer-review

215 Downloads (Pure)


Prism has been developed as a modular classification rule generator following the separate and conquer approach since 1987 due to the replicated sub-tree problem occurring in Top-Down Induction of Decision Trees (TDIDT). A series of experiments have been done to compare the performance between Prism and TDIDT which proved that Prism may generally provide a similar level of accuracy as TDIDT but with fewer rules and fewer terms per rule. In addition, Prism is generally more tolerant to noise with consistently better accuracy than TDIDT. However, the authors have identified through some experiments that Prism may also give rule sets which tend to underfit training sets in some cases. This paper introduces a new modular classification rule generator, which follows the separate and conquer approach, in order to avoid the problems which arise with Prism. In this paper, the authors review the Prism method and its advantages compared with TDIDT as well as its disadvantages that are overcome by a new method using Information Entropy Based Rule Generation (IEBRG). The authors also set up an experimental study on the performance of the new method in classification accuracy and computational efficiency. The method is also evaluated comparatively with Prism.
Original languageEnglish
Title of host publicationInnovative issues in intelligent systems
EditorsVassil Sgurev, Ronald Yager, Janusz Kacprzyk, Vladimir Jotsov
Place of PublicationSwitzerland
ISBN (Electronic)978-3-319-27267-2
ISBN (Print)978-3-319-27266-5
Publication statusPublished - Feb 2016
Event6th International IEEE Conference in Intelligent Systems - Technical University of Sofia, Sofia, Bulgaria
Duration: 6 Sept 20128 Sept 2012

Publication series

NameStudies in Computational Intelligence, Vol. 623
PublisherSpringer International Publishing
ISSN (Electronic)1860-949X


Conference6th International IEEE Conference in Intelligent Systems


  • data mining
  • machine learning
  • rule based classification
  • information theory


Dive into the research topics of 'Induction of modular classification rules by information entropy based rule generation'. Together they form a unique fingerprint.

Cite this