/Python/Learningrate scheduler tensorflow

Learningrate scheduler tensorflow

tf.keras.callbacks.LearningRateScheduler(
    schedule, verbose=0)

# This function keeps the initial learning rate for the first ten epochs
# and decreases it exponentially after that.

def scheduler(epoch, lr):
  if epoch < 10:
    return lr
  else:
    return lr * tf.math.exp(-0.1)

model = tf.keras.models.Sequential([tf.keras.layers.Dense(10)])
model.compile(tf.keras.optimizers.SGD(), loss='mse')

callback = tf.keras.callbacks.LearningRateScheduler(scheduler)
history = model.fit(np.arange(100).reshape(5, 20), np.zeros(5),
                    epochs=15, callbacks=[callback], verbose=0)

Similar codes

1 vote296 views1 answer
Make csv lowercase python
Python
6 votes287 views3 answers
Argparse type
Python
0 vote296 views1 answer
Excelwriter python
Python
11 votes322 views1 answer
Iis betwwen in python
Python
0 vote292 views1 answer
Pass in 2 numbers, A and B. You should create a list with A rows and B columns, then populate each cell
Python
14 votes349 views4 answers
Python delete directory even if not empty
Python
1 vote333 views1 answer
Numpy complex number
Python
0 vote296 views1 answer
Readme python convert to pdf
Python
0 vote285 views1 answer
ValueError: invalid PNG header
Python
-1 vote322 views1 answer
Python - Slicing Strings
Python