A comparison between fixed-basis and variable-basis schemes for function approximation and functional optimization

Fixed-basis and variable-basis approximation schemes are compared for the problems of function approximation and functional optimization (also known as infinite programming). classes of problems are investigated for which variable-basis schemes with sigmoidal computational units perform better than fixed-basis ones,in terms of the minimum number of computational units needed to achieve a desired error in function approximation or approximate optimization. previously known bounds on the accuracy are extended,with better rates,to families of d-variable functions whose actual dependence is on a subset of d ′ d variables,where the indices of these d ′ variables are not known a priori. © 2012 giorgio gnecco.