pypomp.core.optimizer.Adam¶

class pypomp.core.optimizer.Adam(clip_norm: float | None = None, scale: bool = False, ls: bool = False, c: float = 0.1, max_ls_itn: int = 10, beta1: float = 0.9, beta2: float = 0.999, epsilon: float = 1e-08)[source]¶

Bases: Optimizer

Adam optimizer.

Parameters:

beta1 (float, default 0.9) – The exponential decay rate for the first moment estimates (momentum).
beta2 (float, default 0.999) – The exponential decay rate for the second moment estimates (variance).
epsilon (float, default 1e-8) – A small constant for numerical stability.