/Python/Learningrate scheduler tensorflow

Learningrate scheduler tensorflow

tf.keras.callbacks.LearningRateScheduler(
    schedule, verbose=0)

# This function keeps the initial learning rate for the first ten epochs
# and decreases it exponentially after that.

def scheduler(epoch, lr):
  if epoch < 10:
    return lr
  else:
    return lr * tf.math.exp(-0.1)

model = tf.keras.models.Sequential([tf.keras.layers.Dense(10)])
model.compile(tf.keras.optimizers.SGD(), loss='mse')

callback = tf.keras.callbacks.LearningRateScheduler(scheduler)
history = model.fit(np.arange(100).reshape(5, 20), np.zeros(5),
                    epochs=15, callbacks=[callback], verbose=0)

Similar codes

1 vote273 views2 answers
How to get the number of rows and columns in a numpy array
Python
0 vote265 views1 answer
Streaming upload requests python
Python
8 votes291 views1 answer
Positive lookahead regex python
Python
0 vote284 views1 answer
Pytorch multiply tensors element by elementwise
Python
0 vote253 views1 answer
Userregisterform
Python
0 vote275 views1 answer
PYTHON 3.0 MAKE A HEART
Python
9 votes282 views6 answers
Convert dataframe to float
Python
0 vote277 views2 answers
Beautifulsoup get parent element
Python
-1 vote256 views2 answers
Sequence python
Python
1 vote264 views1 answer
How to get total number of rows in listbox tkinter
Python