/Python/Learningrate scheduler tensorflow

Learningrate scheduler tensorflow

tf.keras.callbacks.LearningRateScheduler(
    schedule, verbose=0)

# This function keeps the initial learning rate for the first ten epochs
# and decreases it exponentially after that.

def scheduler(epoch, lr):
  if epoch < 10:
    return lr
  else:
    return lr * tf.math.exp(-0.1)

model = tf.keras.models.Sequential([tf.keras.layers.Dense(10)])
model.compile(tf.keras.optimizers.SGD(), loss='mse')

callback = tf.keras.callbacks.LearningRateScheduler(scheduler)
history = model.fit(np.arange(100).reshape(5, 20), np.zeros(5),
                    epochs=15, callbacks=[callback], verbose=0)

Similar codes

82 votes222 views4 answers
Python read json file array
Python
1 vote190 views1 answer
How to make a hidden file in python
Python
0 vote198 views1 answer
Numpy distance of consecutive elements
Python
0 vote196 views1 answer
Not want to assign all values of a collection of values in python
Python
5 votes233 views2 answers
Df.shape 0
Python
1 vote199 views1 answer
>>> import numpy Illegal instruction (core dumped)
Python
1 vote184 views1 answer
Serving static audio files with flask in react
Python
0 vote196 views1 answer
Filter Top 5 Python
Python
0 vote239 views3 answers
ModuleNotFoundError: No module named 'numpy.testing.decorators'
Python
0 vote216 views1 answer
PY | websocket - client
Python