Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

0 vote333 views1 answer
Resize qpushbutton pyqt
Python
18 votes410 views4 answers
Flask page
Python Flask
28 votes317 views2 answers
Python string slicing
Python
1 vote313 views1 answer
For each value in column pandas
Python
0 vote355 views1 answer
Django model make the field caseinsensitive
Python Django
0 vote316 views1 answer
Young C so new(pro.cashmoneyap x nazz music) soundcloud
Python
0 vote312 views1 answer
What is a good django orm cookbook
Python
0 vote317 views1 answer
Pandas 3d set camara cords
Python
0 vote346 views1 answer
Tensor to int python
Python
0 vote338 views1 answer
Set defualt to none django
Python Django