Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

5 votes205 views2 answers
Code challenges python
Python
8 votes198 views1 answer
Creating dynamic variable in python
Python
44 votes212 views6 answers
Plt figsize
Python
1 vote212 views1 answer
File handling modes in python
Python
0 vote201 views1 answer
Pss signatures python
Python
0 vote191 views1 answer
Bag of word scikit learn
Python
1 vote199 views1 answer
Jupyter notebook attach image
Python
1 vote249 views1 answer
How to add two different times in python
Python
1 vote211 views1 answer
Separate words in a text to make a list python
Python
0 vote187 views1 answer
Sys executable juypter is incorrect visual code
Python