Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

10 votes158 views5 answers
Find nan values in a column pandas
Python
0 vote169 views2 answers
Python counter least common
Python
0 vote159 views1 answer
Django get group users
Python
0 vote170 views1 answer
Set a Widget size to the parent size from python in kivy
Python
6 votes166 views2 answers
How to append two numpy arrays
Python
1 vote171 views1 answer
Pandas determine percentage of nans in column
Python
6 votes158 views4 answers
Calculate area of circle
Python
0 vote169 views1 answer
Show post id on django admin interface
Python
0 vote169 views1 answer
How to find 2 similar words in atext python
Python
0 vote163 views1 answer
Pandas load dataframe without header
Python