Optimizer {Microsoft.VisualBasic.MachineLearning.Transformer}

.NET clr documentation

Optimizer

Description

实现 Adam 优化器（参数 + 同形梯度累加器）。

Declare

            
# namespace Microsoft.VisualBasic.MachineLearning.Transformer
export class Optimizer {
   # 一阶矩估计张量（与参数同形）。仅供 checkpoint 持久化读取，请勿直接改写其内容。
   FirstMoment: Tensor;
   # 与参数同形的梯度累加器；反向传播阶段由调用方往里原地累加。
   Gradient: Tensor;
   # 二阶矩估计张量（与参数同形）。仅供 checkpoint 持久化读取，请勿直接改写其内容。
   SecondMoment: Tensor;
}

        

.NET clr type reference tree

1. use by property member FirstMoment: Tensor
2. use by property member Gradient: Tensor
3. use by property member SecondMoment: Tensor

---