Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

2 votes197 views2 answers
Remove steam from ubuntu
Python
0 vote237 views1 answer
Python read file to eof
Python
0 vote176 views1 answer
List comprehesion python
Python
0 vote191 views2 answers
Copy only some columns to new dataframe in r
Python
0 vote207 views1 answer
Python yield from
Python
0 vote152 views1 answer
Divide array into equal parts/slices python
Python
1 vote193 views1 answer
Enumerate string pythonm
Python
1 vote254 views2 answers
One hot encoding numpy
Python
0 vote189 views1 answer
Python get current class name
Python
0 vote183 views1 answer
Lims
Python