Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

1 vote346 views1 answer
Show image in tkinter pillow
Python
0 vote353 views2 answers
Set operators
Python
1 vote330 views2 answers
Calculator python tutorial
Python
0 vote334 views1 answer
Python getter decorator
Python
2 votes325 views1 answer
Python buffer
Python
16 votes348 views3 answers
How to code music in python
Python
0 vote313 views1 answer
Python empty constructor
Python
0 vote325 views1 answer
Django check if get parameter exists
Python
5 votes327 views4 answers
Dropna for specific column pandas
Python
0 vote321 views1 answer
Pandas groupby without reset index
Python