/Python/Learningrate scheduler tensorflow

Learningrate scheduler tensorflow

tf.keras.callbacks.LearningRateScheduler(
    schedule, verbose=0)

# This function keeps the initial learning rate for the first ten epochs
# and decreases it exponentially after that.

def scheduler(epoch, lr):
  if epoch < 10:
    return lr
  else:
    return lr * tf.math.exp(-0.1)

model = tf.keras.models.Sequential([tf.keras.layers.Dense(10)])
model.compile(tf.keras.optimizers.SGD(), loss='mse')

callback = tf.keras.callbacks.LearningRateScheduler(scheduler)
history = model.fit(np.arange(100).reshape(5, 20), np.zeros(5),
                    epochs=15, callbacks=[callback], verbose=0)

Similar codes

2 votes270 views2 answers
Slow print python
Python
0 vote266 views1 answer
Flask on gevent over https
Python
-35 votes262 views5 answers
Python type hints
Python
0 vote316 views1 answer
How to work with jupyterlab and conda environments
Python
6 votes300 views3 answers
Python numphy how to use fractions
Python
0 vote267 views1 answer
How to not round numbers in python
Python
0 vote282 views1 answer
Ordenar lista python
Python
0 vote295 views1 answer
Pathlib check is file
Python
0 vote268 views10 answers
Scrapy itemloader example
Python
0 vote331 views1 answer
Run django using nssm
Python Django