An efficient method for the numerical evaluation of partial derivatives of arbitrary order
- 1 June 1992
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Mathematical Software
- Vol. 18 (2) , 159-173
- https://doi.org/10.1145/146847.146924
Abstract
For any typical multivariable expression f , point a in the domain of f , and positive integer maxorder, this method produces the numerical values of all partial derivatives at a up through order maxorder. By the technique known as automatic differentiation, theoretically exact results are obtained using numerical (as opposed to symbolic) manipulation. The key ideas are a hyperpyramid data structure and a generalized Leibniz's rule. Any expression in n variables corresponds to a hyperpyramid array, in n -dimensional space, containing the numerical values of all unique partial derivatives (not wasting space on different permutations of derivatives). The arrays for simple expressions are combined by hyperpyramid operators to form the arrays for more complicated expressions. These operators are facilitated by a generalized Leibniz's rule which, given a product of multivariable functions, produces any partial derivative by forming the minimum number of products (between two lower partials) together with a product of binomial coefficients. The algorithms are described in abstract pseudo-code. A section on implementation shows how these ideas can be converted into practical and efficient programs in a typical computing environment. For any specific problem, only the expression itself would require recoding.Keywords
This publication has 9 references indexed in Scilit:
- An algorithm for exact evaluation of multivariate functions and their derivatives to any orderComputational Statistics & Data Analysis, 1988
- Indexing and merging in APLACM SIGAPL APL Quote Quad, 1987
- Automatic evaluation of derivativesApplied Mathematics and Computation, 1987
- The polyadic structure of factorable function tensors with applications to high-order minimization techniquesJournal of Optimization Theory and Applications, 1986
- Electron Paramagnetic Resonance of the two-dimensional system Mn(HCOO)2·2H2OJournal of Magnetism and Magnetic Materials, 1986
- Differentiation in PASCAL-SC: type GRADIENTACM Transactions on Mathematical Software, 1984
- A finite algorithm for the exact evaluation of higher order partial derivatives of functions of many variablesJournal of Mathematical Analysis and Applications, 1983
- Automatic Differentiation of Computer ProgramsACM Transactions on Mathematical Software, 1980
- A simple automatic derivative evaluation programCommunications of the ACM, 1964