jactorch.optim.optimizer_group

Classes

OptimizerGroup

A group of optimizers.

Class OptimizerGroup

class OptimizerGroup

Bases: CustomizedOptimizer

A group of optimizers. Useful when using multiple optimizers for different parts of the model.

__init__(**optimizers)

Initialize the optimizer group.

Parameters:

**optimizers – the list of optimizers.

__new__(**kwargs)

load_state_dict(state_dict)

Load the state of the optimizer from a dictionary.

state_dict()

A dictionary that contains the state of the optimizer.

step(closure=None)

Performs a single optimization step.

zero_grad()

Clear the gradients of all optimized parameters.

property param_groups

The parameter groups of the optimizer.

property state

The state of the optimizer.