Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

0 vote263 views2 answers
Legend matplotlib twinx
Python
0 vote265 views1 answer
Pandas melt and stack
Python
1 vote242 views1 answer
Punctuation list python
Python
0 vote259 views2 answers
Check null all column pyspark
Python
34 votes243 views4 answers
Reindex pandas dataframe from 0
Python
1 vote247 views1 answer
Python discord discord.py disable remove help command
Python
2 votes250 views1 answer
Remove comma from string python column
Python
12 votes308 views4 answers
How to add array in python
Python
1 vote239 views1 answer
Python open new chrome tab
Python
3 votes231 views2 answers
Count how many vowels in a string python
Python