Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

0 vote234 views1 answer
List generation for python
Python
0 vote231 views1 answer
Num=operator.index(num) name 'num' is not defined
Python
11 votes229 views5 answers
Python sorted lambda
Python
0 vote242 views1 answer
How to open camre aopencv
Python
-1 vote234 views2 answers
Hierarchical clustering Agglomerative
Python
1 vote213 views1 answer
Python for/else
Python
0 vote236 views1 answer
Pls work
Python
0 vote227 views1 answer
Timestamp to date time till milliseconds python
Python
31 votes235 views6 answers
Python string remove whitespace
Python
0 vote234 views2 answers
Convert iterator to list python
Python