/Python/Learningrate scheduler tensorflow

Learningrate scheduler tensorflow

tf.keras.callbacks.LearningRateScheduler(
    schedule, verbose=0)

# This function keeps the initial learning rate for the first ten epochs
# and decreases it exponentially after that.

def scheduler(epoch, lr):
  if epoch < 10:
    return lr
  else:
    return lr * tf.math.exp(-0.1)

model = tf.keras.models.Sequential([tf.keras.layers.Dense(10)])
model.compile(tf.keras.optimizers.SGD(), loss='mse')

callback = tf.keras.callbacks.LearningRateScheduler(scheduler)
history = model.fit(np.arange(100).reshape(5, 20), np.zeros(5),
                    epochs=15, callbacks=[callback], verbose=0)

Similar codes

5 votes248 views1 answer
Translate english to japanese
Python
0 vote271 views1 answer
Get next element while looping
Python
0 vote223 views1 answer
Pyttsx3 speech to mp3
Python
1 vote253 views1 answer
Scrapy user agent
Python
0 vote285 views1 answer
Discord python application bot
Python
0 vote284 views1 answer
Python requests pass auth token
Python
0 vote258 views1 answer
Not want to assign all values of a collection of values in python
Python
0 vote262 views1 answer
COMBINE TWO 2-D NUMPY ARRAYS WITH NP.VSTACK
Python
0 vote272 views1 answer
NotJSONError('Notebook does not appear to be JSON: \'\\ufeff{\\n "cells": [\\n {\\n "cell_typ...',)
Python
1 vote267 views1 answer
UnavailableInvalidChannel error in conda
Python