Incremental Linear Discriminant Analysis Using Sufficient Spanning Set Approximations
- 1 June 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 1-8
- https://doi.org/10.1109/cvpr.2007.382985
Abstract
This paper presents a new incremental learning solution for linear discriminant analysis (LDA). We apply the concept of the sufficient spanning set approximation in each update step, i.e. for the between-class scatter matrix, the projected data matrix as well as the total scatter matrix. The algorithm yields a more general and efficient solution to incremental LDA than previous methods. It also significantly reduces the computational complexity while providing a solution which closely agrees with the batch LDA result. The proposed algorithm has a time complexity of O(Nd2) and requires O(Nd) space, where d is the reduced subspace dimension and N the data dimension. We show two applications of incremental LDA: First, the method is applied to semi-supervised learning by integrating it into an EM framework. Secondly, we apply it to the task of merging large databases which were collected during MPEG standardization for face image retrieval.Keywords
This publication has 8 references indexed in Scilit:
- Incremental Kernel PCA for Efficient Non-linear Feature ExtractionPublished by British Machine Vision Association and Society for Pattern Recognition ,2006
- Incremental Linear Discriminant Analysis for Classification of Data StreamsIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2005
- IDR/QR: an incremental dimension reduction algorithm via QR decompositionIEEE Transactions on Knowledge and Data Engineering, 2005
- Component-based LDA face description for image retrieval and MPEG-7 standardisationImage and Vision Computing, 2005
- Weighted and robust incremental method for subspace learningPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Successive learning of linear discriminant analysis: Sanger-type algorithmPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Merging and splitting eigenspace modelsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2000