Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

68 votes317 views6 answers
Create folders in python
Python
15 votes301 views3 answers
Divide list into equal parts python
Python
0 vote323 views1 answer
Migrate using other database django
Python
17 votes269 views1 answer
Strip all spaces python
Python
0 vote284 views1 answer
Python square all numbers in list
Python
1 vote310 views1 answer
Series to numpy array
Python
0 vote300 views1 answer
Tensor.expand_as
Python
-1 vote301 views3 answers
How to create a new file in terminal
Python
15 votes304 views2 answers
Python install package from code
Python
0 vote297 views1 answer
Fastest way to Convert Integers to Strings in Pandas DataFrame
Python