Abstract: Recent results in the adaptive control literature have made connections to methods in optimization and have led to new adaptive update laws based on accelerated gradient methods. Accelerated ...

Abstract: Recent connections in the adaptive control literature to continuous-time analogs of Nesterov’s accelerated gradient method have led to the development of new real-time adaptation laws based ...

ABSTRACT: Proximal gradient descent and its accelerated version are resultful methods for solving the sum of smooth and non-smooth problems. When the smooth function can be represented as a sum of ...

This repository contains code implementations for several research papers, including [LSAM], [ESGD], [LSGD], [DP-SAM] and [DP-SGD]. These methods can be interpreted from a sampling-based perspective, ...

These python scripts evaluate and plot the discretized accelerated Stein variational gradient flow (with Wasserstein-2 regularization) as described in the preprint ...