Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

3 votes257 views2 answers
Request.get_json() return in flask
Python
2 votes270 views1 answer
Python string remove whitespace and newlines
Python
0 vote248 views1 answer
Deine dict with same values
Python
3 votes265 views1 answer
How to insert item last in list python
Python
2 votes278 views5 answers
How to kill
Python
16 votes244 views4 answers
How to reverse array in python
Python
8 votes285 views4 answers
How to calculate the age from date of birth in python
Python
1 vote236 views1 answer
Get the system boot time in python
Python
0 vote259 views1 answer
Arduino - Send Commands with Serial Communication with python
Python
1 vote274 views1 answer
Python cv2 resize keep aspect ratio
Python