Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

1 vote335 views2 answers
Sns figsize
Python
1 vote289 views1 answer
32 bit binary in python
Python
0 vote343 views1 answer
Python dns pip
Python
0 vote315 views1 answer
Read json file python utf8
Python
0 vote330 views1 answer
Import matplotlib submodule 'style'
Python
0 vote364 views1 answer
Pandas average of vectors after groupby
Python
0 vote340 views1 answer
Django user refistration
Python
1 vote404 views1 answer
How to make pyautogui faster
Python
0 vote329 views1 answer
Break
Python
0 vote339 views1 answer
Substituir valor simbólico por valor real em uma equação Python
Python