Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

0 vote344 views2 answers
How to get every character in a string python
Python
0 vote307 views1 answer
Pyqt5 book
Python
0 vote374 views1 answer
How to send Email verification codes to user in Firebase using Python
Python
-1 vote395 views1 answer
ImportError: DLL load failed while importing win32file: The specified module could not be found.
Python
0 vote355 views2 answers
Python sorting array without inbuilt sort
Python
3 votes378 views1 answer
For e in p.event.get(): pygame.error: video system not initialized
Python
0 vote471 views2 answers
How to close a flask web server with python
Python Flask
1 vote364 views1 answer
Data Compression in python
Python
0 vote397 views1 answer
Cv2 blue color range
Python
0 vote391 views2 answers
What is fn.call
Python