Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

3 votes267 views3 answers
Take pictures from webcam python
Python
0 vote263 views1 answer
Question 2 Let's create a function that turns text into pig latin: a simple text transformation that modifies each word moving the first character to the end and appending "ay" to the end. For example, python ends up as ythonpay.
Python
3 votes259 views1 answer
Remove commas from string python
Python
0 vote260 views1 answer
Static files not loading 404 error django
Python
3 votes260 views3 answers
String list to list
Python
11 votes238 views3 answers
Python random choice int
Python
29 votes252 views6 answers
Count unique values pandas
Python
0 vote263 views1 answer
Python tkinter dynamic toggle button
Python
1 vote260 views2 answers
N-largest and n-smallest in list in python
Python
1 vote279 views1 answer
Np confidence interval
Python