Gradient adaptation under unit-norm constraints
- 27 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 144-147
- https://doi.org/10.1109/ssap.1998.739355
Abstract
We study gradient-based adaptive algorithms within parameter spaces specified by /spl par/w/spl par/=1, where /spl par//spl middot//spl par/ is any vector norm. Several approximate algorithms for this task have already been developed when /spl par/w/spl par/ is the L/sub 2/ norm. We derive general algorithm forms for arbitrary vector norms and relate them to true gradient procedures via their geometric structures. We also give algorithms that mitigate an inherent numerical instability for tangent-vector L/sub 2/-norm methods. Simulations showing the performance of the techniques for minor component analysis are provided.Keywords
This publication has 14 references indexed in Scilit:
- Adaptive data orthogonalizationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- On bias removal and unit norm constraints in equation error adaptive IIR filtersPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Why natural gradient?Published by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Extraction of independent components from hybrid mixture: KuicNet learning algorithm and applicationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Performance analysis of adaptive eigenanalysis algorithmsIEEE Transactions on Signal Processing, 1998
- Natural Gradient Works Efficiently in LearningNeural Computation, 1998
- Bias removal in equation-error adaptive IIR filtersIEEE Transactions on Signal Processing, 1995
- An unbiased equation error identifier and reduced-order approximationsIEEE Transactions on Signal Processing, 1994
- Independent component analysis, A new concept?Signal Processing, 1994
- On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrixJournal of Mathematical Analysis and Applications, 1985