Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

1 vote363 views1 answer
How to remove arrays in python from a specific place
Python
0 vote416 views1 answer
Python selenium teardown class
Python
0 vote315 views1 answer
Bytestring python
Python
0 vote311 views1 answer
Np.linspace() in python
Python
0 vote351 views1 answer
Pandas Columns Calling
Python
4 votes365 views3 answers
Pandas remove row if missing value in column
Python
2 votes325 views1 answer
Set django static root
Python
2 votes320 views1 answer
Genspider scrapy
Python
0 vote372 views1 answer
Python save console state
Python
0 vote334 views1 answer
Pandas add value to excel column and save
Python