experiments/STT-tensorflow
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Use get_cosine_decay_fn to match the description

Browse Source
This commit is contained in:
Rholais Lii 2018-04-29 15:44:46 +08:00 committed by GitHub
parent 6f3cc9d368
commit ac15dfe64e
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
tensorflow/contrib/opt/python/training/powersign.py
View File

@ -65,7 +65,7 @@ class PowerSignOptimizer(optimizer.Optimizer):
Example usage for PowerSign-cd (PowerSign with cosine sign decay)
```
decay_steps = 1000
linear_decay_fn = sign_decays.get_linear_decay_fn(decay_steps)
linear_decay_fn = sign_decays.get_cosine_decay_fn(decay_steps)
opt = PowerSignOptimizer(learning_rate=0.1, sign_decay_fn=linear_decay_fn)
```