Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

0 vote143 views1 answer
Python concatenate dictionaries
Python
1 vote175 views2 answers
Python int16
Python
8 votes220 views2 answers
Flask.pocoo.org quickstart
Python Flask
0 vote176 views1 answer
Why tensorflow not working in .py file
Python
0 vote189 views1 answer
Type object 'object' has no attribute 'dtype' when create dataframe from pandas
Python
9 votes195 views2 answers
Python: remove specific values in a dataframe
Python
0 vote178 views1 answer
If number Of Players == >=4 python
Python
2 votes177 views3 answers
Print output python to file
Python
8 votes178 views5 answers
Django message framework
Python
0 vote177 views1 answer
How to make a random int in python
Python