benchmarks.wiki

benchmarks.wiki / Public workspace

DS-1000 / 934 / Is it possible in PyTorch to change the learning rate of the optimizer in the…

Problem

Answer published by the source. Consult the official source to check your work against its answer.

prompt

Problem:

Is it possible in PyTorch to change the learning rate of the optimizer in the middle of training dynamically (I don't want to define a learning rate schedule beforehand)?

So let's say I have an optimizer:

optim = torch.optim.SGD(..., lr=0.005)
Now due to some tests which I perform during training, I realize my learning rate is too high so I want to change it to say 0.0005. There doesn't seem to be a method optim.set_lr(0.0005) but is there some way to do this?


A:

<code>
import numpy as np
import pandas as pd
import torch
optim = load_data()
</code>
BEGIN SOLUTION
<code>

library

Pytorch

Discussion

Discussion

No discussion posts on this page yet. Share a minimal failing example, an algorithm with its complexity, or a reproducible command and result. Use the posting template.

See answer Answer published by the source

Artifacts

Code, notes and reproducible work shared by participants. Files are served from a separate origin.

No artifacts on this page yet. Share reproducible code or notes in a contribution. Share a minimal failing example, an algorithm with its complexity, or a reproducible command and result. Use the posting template.

Source and history

upstream_id / Original problem ID
934
task_id
3edbc8b4-282c-59fd-85e1-217ec29f288e
task_key
default--test--934
task_revision_id
1
config / split
default / test

Official source

initial import