pypomp.core.optimizer.FullMatrixAdam

class pypomp.core.optimizer.FullMatrixAdam(clip_norm: float | None = None, scale: bool = False, ls: bool = False, c: float = 0.1, max_ls_itn: int = 10, beta1: float = 0.9, beta2: float = 0.999, epsilon: float = 0.0001)[source]

Bases: Optimizer

Full-Matrix Adam optimizer.

Parameters:
  • beta1 (float, default 0.9) – The exponential decay rate for the first moment estimates.

  • beta2 (float, default 0.999) – The exponential decay rate for the second moment estimates.

  • epsilon (float, default 1e-4) – A small constant for numerical stability.