/Python/Learningrate scheduler tensorflow

Learningrate scheduler tensorflow

tf.keras.callbacks.LearningRateScheduler(
    schedule, verbose=0)

# This function keeps the initial learning rate for the first ten epochs
# and decreases it exponentially after that.

def scheduler(epoch, lr):
  if epoch < 10:
    return lr
  else:
    return lr * tf.math.exp(-0.1)

model = tf.keras.models.Sequential([tf.keras.layers.Dense(10)])
model.compile(tf.keras.optimizers.SGD(), loss='mse')

callback = tf.keras.callbacks.LearningRateScheduler(scheduler)
history = model.fit(np.arange(100).reshape(5, 20), np.zeros(5),
                    epochs=15, callbacks=[callback], verbose=0)

Similar codes

16 votes282 views4 answers
Dataframe find nan rows
Python
1 vote330 views2 answers
Flask socketio send
Python Flask
0 vote299 views1 answer
Split the string using the default arguments
Python
0 vote271 views1 answer
Basic script
Python
3 votes284 views2 answers
Python remove cached package
Python
118 votes302 views6 answers
Python download
Python
48 votes307 views4 answers
Console clear python
Python
0 vote335 views1 answer
Initial TypedMultipleChoiceField django
Python Django
3 votes326 views1 answer
Join two numpy 2d array
Python
0 vote321 views1 answer
Blender python get current filename
Python