Incremental Linear Discriminant Analysis for Classification of Data Streams

19 September 2005

journal article
research article
Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics)

Vol. 35 (5) , 905-914
https://doi.org/10.1109/tsmcb.2005.847744

Abstract

This paper presents a constructive method for deriving an updated discriminant eigenspace for classification when bursts of data that contains new classes is being added to an initial discriminant eigenspace in the form of random chunks. Basically, we propose an incremental linear discriminant analysis (ILDA) in its two forms: a sequential ILDA and a Chunk ILDA. In experiments, we have tested ILDA using datasets with a small number of classes and small-dimensional features, as well as datasets with a large number of classes and large-dimensional features. We have compared the proposed ILDA against the traditional batch LDA in terms of discriminability, execution time and memory usage with the increasing volume of data addition. The results show that the proposed ILDA can effectively evolve a discriminant eigenspace over a fast and large data stream, and extract features with superior discriminability in classification, when compared with other methods.

Keywords

This publication has 14 references indexed in Scilit:

One-Pass Incremental Membership Authentication by Face Classification
Published by Springer Nature ,2004
Candid covariance-free incremental principal component analysis
Published by Institute of Electrical and Electronics Engineers (IEEE) ,2003
Face recognition using LDA-based algorithms
IEEE Transactions on Neural Networks, 2003
Membership authentication in the dynamic group by face classification using SVM ensemble
Pattern Recognition Letters, 2003
PCA versus LDA
Published by Institute of Electrical and Electronics Engineers (IEEE) ,2001
Merging and splitting eigenspace models
Published by Institute of Electrical and Electronics Engineers (IEEE) ,2000
An Eigenspace Update Algorithm for Image Analysis
Graphical Models and Image Processing, 1997
Eigenfaces vs. Fisherfaces: recognition using class specific linear projection
Published by Institute of Electrical and Electronics Engineers (IEEE) ,1997
Using discriminant eigenfeatures for image retrieval
Published by Institute of Electrical and Electronics Engineers (IEEE) ,1996
Efficient, numerically stabilized rank-one eigenstructure updating (signal processing)
IEEE Transactions on Acoustics, Speech, and Signal Processing, 1990