terminator.utils.model.optim.NoamOpt

class terminator.utils.model.optim.NoamOpt(model_size, factor, warmup, optimizer)[source]

Bases: object

Optim wrapper that implements rate.

__init__(model_size, factor, warmup, optimizer)[source]

Methods

__init__(model_size, factor, warmup, optimizer)

load_state_dict(state_dict)

rate([step])

Implement lrate above

state_dict()

step()

Update parameters and rate

zero_grad()

rate(step=None)[source]

Implement lrate above

step()[source]

Update parameters and rate