experiments/STT-tensorflow
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Fix internal ftrl doc.

Browse Source 
PiperOrigin-RevId: 247043085
This commit is contained in:
Alexandre Passos 2019-05-07 10:19:31 -07:00 committed by TensorFlower Gardener
parent 94187bc3f6
commit c1b4525808
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
tensorflow/core/api_def/base_api/api_def_ResourceSparseApplyFtrl.pbtxt
View File

@ -66,7 +66,7 @@ END
description: <<END description: <<END
That is for rows we have grad for, we update var, accum and linear as follows: That is for rows we have grad for, we update var, accum and linear as follows:
accum_new = accum + grad * grad accum_new = accum + grad * grad
linear += grad + (accum_new^(-lr_power) - accum^(-lr_power)) / lr * var linear += grad - (accum_new^(-lr_power) - accum^(-lr_power)) / lr * var
quadratic = 1.0 / (accum_new^(lr_power) * lr) + 2 * l2 quadratic = 1.0 / (accum_new^(lr_power) * lr) + 2 * l2
var = (sign(linear) * l1 - linear) / quadratic if |linear| > l1 else 0.0 var = (sign(linear) * l1 - linear) / quadratic if |linear| > l1 else 0.0
accum = accum_new accum = accum_new