0. Differentiation of Vectors

Jacobian

Multivariate Taylor approx.

$$f(x)=f(x_0)+J_f(x_0)(x-x_0)+o(\Vert x-x_0\Vert )$$

Multivariate chain rule