Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

0 vote222 views1 answer
Infinity range or infinity looping
Python
1 vote225 views1 answer
Reverse row order pandas
Python
0 vote234 views1 answer
Python get response from url
Python
15 votes220 views3 answers
Save numpy array to csv
Python
0 vote251 views1 answer
Kinesis Client put_record
Python
9 votes220 views1 answer
Can only concatenate str (not "int") to str
Python
0 vote264 views1 answer
How to add static files in django 3.2.9
Python Django
1 vote212 views1 answer
Save image requests python
Python
15 votes221 views3 answers
Numpy to csv
Python
5 votes224 views2 answers
Pandas convert index to column
Python