Abstract: First-order optimization algorithms, often preferred for large problems, require the gradient of the differentiable terms in the objective function. These gradients often involve linear ...

A Hilbert space is a vector space with an inner product that allows you to measure angles and lengths of vectors. A dual space is a set of linear functionals, which are functions that map vectors to ...