In my last post about optimization, I’ve derived my function analytically. Sometimes, it’s not as easy. Sometimes also, a simple gradient optimization is not enough.
scikits.optimization has a special class for handling numerical differentiation, and several tools for conjugate gradients.