Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

79 votes284 views6 answers
Read csv python
Python
0 vote281 views1 answer
How to add subtitle matplotlib
Python
0 vote282 views1 answer
Get node name dynamo revit
Python
4 votes345 views4 answers
Python find factors of a number
Python
1 vote304 views1 answer
Pandas percentage change across 3 periods
Python
0 vote291 views1 answer
For in pthon
Python
2 votes296 views2 answers
How to get dummies in a dataframe pandas
Python
0 vote239 views1 answer
Read large SAS file ilarger than memory n Python
Python
-2 votes275 views1 answer
Come scaricare moduli pyton
Python
0 vote278 views1 answer
Python random real
Python