/Python/Learningrate scheduler tensorflow

Learningrate scheduler tensorflow

tf.keras.callbacks.LearningRateScheduler(
    schedule, verbose=0)

# This function keeps the initial learning rate for the first ten epochs
# and decreases it exponentially after that.

def scheduler(epoch, lr):
  if epoch < 10:
    return lr
  else:
    return lr * tf.math.exp(-0.1)

model = tf.keras.models.Sequential([tf.keras.layers.Dense(10)])
model.compile(tf.keras.optimizers.SGD(), loss='mse')

callback = tf.keras.callbacks.LearningRateScheduler(scheduler)
history = model.fit(np.arange(100).reshape(5, 20), np.zeros(5),
                    epochs=15, callbacks=[callback], verbose=0)

Similar codes

-4 votes146 views1 answer
Hello world python 2
Python
3 votes109 views2 answers
How to check if text is in upper case in python
Python
6 votes111 views1 answer
Numpy round
Python
26 votes126 views4 answers
Python ceiling
Python
2 votes111 views2 answers
Programm the fibonacci sequence
Python
1 vote130 views1 answer
Reload all extensions discord.py
Python
0 vote138 views1 answer
Modify a list with for loop and range function in python
Python
142 votes125 views6 answers
Write to file python
Python
2 votes117 views2 answers
How to get the amount of nan values in a data fram
Python
1 vote113 views1 answer
Not getting spanish characters python
Python