Scilab Home Page | Wiki | Bug Tracker | Forge | Mailing List Archives | Scilab Online Help | File Exchange
ATOMS : Mutual Information Toolbox details
Login with GitLab

Mutual Information Toolbox

Mutual Information computation and minimum-redundancy maximum-relevance feature selection
(2690 downloads for this version - 6920 downloads for all versions)
A more recent valid version exists: 1.0.1
Hanchuan Peng
Owner Organization
Janelia Farm Research Campus
Holger Nahrstaedt
Creation Date
December 15, 2011
Source created on
Scilab 5.3.x
Binaries available on
Scilab 5.3.x:
Linux 32-bit macOS Linux 64-bit
Install command
--> atomsInstall("mi")
Report a bug
            A self-contained, cross-platform, package for computing mutual information,
joint/conditional probability, entropy, and more. This package has also been
used for general machine learning and data mining purposes such as feature
selection, Bayesian network construction, signal processing, etc.

This package contains also two functions for minimal redundancy feature
selection. But both function only supports discretized data, thus if you have
continuous data in "d", you will need to discretize them first. 

Two source code files of the mRMR (minimum-redundancy maximum-relevancy) feature
selection method in (Peng et al, 2005 and Ding & Peng, 2005, 2003), whose
better performance over the conventional top-ranking method has been
demonstrated on a number of data sets in recent publications. This version uses
mutual information as a proxy for computing relevance and redundancy among
variables (features). Other variations such as using correlation or F-test or
distances can be easily implemented within this framework, too.

Hanchuan Peng, Fuhui Long, and Chris Ding, "Feature selection based on
mutual information: criteria of max-dependency, max-relevance, and
IEEE Transactions on Pattern Analysis and Machine Intelligence,
Vol. 27, No. 8, pp.1226-1238, 2005.

Ding C., and Peng HC, "Minimum redundancy feature selection from microarray
gene expression data," Journal of Bioinformatics and Computational
Vol. 3, No. 2, pp.185-205, 2005.

Ding, C and Peng HC, Proc. 2nd IEEE Computational Systems Bioinformatics
Conference (CSB 2003),
pp.523-528, Stanford, CA, Aug, 2003.             
Files (4)
[15.69 kB]
Source code archive

[48.07 kB]
Linux 32-bit binary for Scilab 5.3.x
Linux 32-bit
Automatically generated by the ATOMS compilation chain

[49.98 kB]
macOS binary for Scilab 5.3.x
MacOSX version
Automatically generated by the ATOMS compilation chain

[48.49 kB]
Linux 64-bit binary for Scilab 5.3.x
Linux 64-bit
Automatically generated by the ATOMS compilation chain

News (0)
Comments (0)
Leave a comment
You must register and log in before leaving a comment.
Login with GitLab
Email notifications
Send me email when this toolbox has changes, new files or a new release.
You must register and log in before setting up notifications.