Commit Graph

603 Commits

Author SHA1 Message Date
A. Unique TensorFlower
1e59f00c48 Extend tfprof to associate op stats with Python codes.
It's backward compatible. Stats of a source code line
are aggregated from all ops created by that line.

A example.
_TFProfRoot (0us/22.44ms)
  model_analyzer_test.py:149:run_filename_as_m...:none (0us/22.44ms)
    model_analyzer_test.py:33:_run_code_in_main:none (0us/22.44ms)
      model_analyzer_test.py:208:<module>:test.main() (0us/22.44ms)
        model_analyzer_test.py:132:testComplexCodeView:x = lib.BuildFull... (0us/22.44ms)
          model_analyzer_testlib.py:63:BuildFullModel:return sgd_op.min... (0us/21.83ms)
          model_analyzer_testlib.py:54:BuildFullModel:seq.append(array_... (0us/254us)
            model_analyzer_testlib.py:42:BuildSmallModel:x = nn_ops.conv2d... (0us/134us)
            ...
          model_analyzer_testlib.py:61:BuildFullModel:loss = nn_ops.l2_... (0us/28us)
        model_analyzer_test.py:134:testComplexCodeView:sess.run(variable... (0us/0us)
Change: 155258346
2017-05-05 17:30:49 -07:00
Dan Ringwalt
692fad20f9 Merge changes from github.
Change: 155209832
2017-05-05 10:26:00 -07:00
Brennan Saeta
f28935a7d2 Implement ClusterSpec Propagation in TF Master
ClusterSpec propagation is a capability upgrade for TensorFlow that should make
it much easier to (1) build distributed TensorFlow clusters, and (2) handle
node failures. The ClusterSpec propagation capability allows TensorFlow workers
to be booted independently of each other, and with no knowledge about others.
The client can then construct a ClusterDef (ClusterSpec), and then send it
to the TF master at session creation. The master in turn then propagates the
ClusterDef along to all of the workers.
Change: 155159972
2017-05-04 21:08:47 -07:00
Shanqing Cai
44cf98028b RNN checkpoint migration tool
Change: 155158477
2017-05-04 20:31:42 -07:00
Anna R
f696b5d439 Added traceback_with_start_lines property to op that includes function start line number as the last element in each traceback tuple.
Change: 155136334
2017-05-04 15:46:49 -07:00
Anna R
e98357a9fd Internal change.
Change: 155135670
2017-05-04 15:45:13 -07:00
A. Unique TensorFlower
94e7325bbf Making the pip smoke test warning clearer.
Change: 155094164
2017-05-04 10:53:06 -07:00
A. Unique TensorFlower
42c7659edd Add categorical_column_with_vocabulary_file.
Move lookup_ops implementation from tensorflow/contrib/lookup to tensorflow/python/feature_column.
Change: 155079825
2017-05-04 08:30:20 -07:00
A. Unique TensorFlower
00bfa9069e fixed a bug passing two flag values: show_type and show_summary, they currently override the value of show_time
Change: 154967526
2017-05-03 10:03:55 -07:00
Shanqing Cai
3af03be757 tfdbg: internal-only changes
Change: 154914490
2017-05-02 20:10:03 -07:00
Mark Daoust
883e32600e Fix a bunch of bad links and missing docs in contrib.
Change: 154820641
2017-05-02 05:32:10 -07:00
A. Unique TensorFlower
7c561e09c0 Explain when callables passed to tf.cond & tf.while_loop are run.
Rename the parameters to tf.cond.
Change: 154774725
2017-05-01 16:31:00 -07:00
Skye Wanderman-Milne
fcfb5482da Update "Using TensorFlow via Docker" README to mention memory limits.
Fixes 
Change: 154721550
2017-05-01 09:29:13 -07:00
Pete Warden
ad3c84b58b Added graph structure output to summarize_graph
Change: 154606362
2017-04-28 19:05:08 -07:00
Mark Daoust
bdd03de303 Make Python API TOC sort deterministic.
Change: 154579657
2017-04-28 14:25:33 -07:00
Peter Hawkins
163613d82e Clean up constant-folder API. No functional changes.
Cleanups:
* Remove a deprecated entry point, update callers to use the Status-returning entry point. Rename DoConstantFoldingWithStatus to ConstantFold, now that we have removed the "without Status" API.
* Hide an internal function from the header.
* Move ConstantFoldingOptions into constant_folding.h
Change: 154462306
2017-04-27 13:49:20 -07:00
Suharsh Sivakumar
4f525819b6 Add support for variable number of bits to FakeQuant* ops.
Change: 154377062
2017-04-26 19:29:15 -07:00
Geoffrey Irving
9845d0e822 Add tf.log_sigmoid
This is a numerically stable version of tf.log(tf.sigmoid(x)).  It's just
-tf.nn.softplus(-x), but it's easy to add and the identity is easy to mistype.

RELNOTES: Add tf.log_sigmoid(x) = tf.log(tf.sigmoid(x)) = -tf.nn.softplus(-x).

Fixes .
Change: 154308666
2017-04-26 10:08:35 -07:00
A. Unique TensorFlower
7536c7edde Use pylint 1.6.4 for sanity for now.
Change: 154235161
2017-04-25 16:26:16 -07:00
Benoit Steiner
58fe576e20 Added a python API to the meta graph optimizer
Change: 154232702
2017-04-25 16:08:07 -07:00
A. Unique TensorFlower
a5cc879abb Upgrade buildifier to the latest.
Change: 154212512
2017-04-25 13:47:37 -07:00
A. Unique TensorFlower
1c287dbaae Added docker containers to ci_build that use clang as a CUDA compiler
Change: 154111461
2017-04-24 16:30:24 -07:00
Shanqing Cai
326942394e Merge changes from github.
Change: 153925676
2017-04-22 07:28:38 -07:00
Charles Nicholson
8e5041918f Introduce TFDecorator, a base class for Python TensorFlow decorators. Provides basic introspection and "unwrap" services, allowing tooling code to fully 'understand' the wrapped object.
Change: 153854044
2017-04-21 12:09:42 -07:00
Derek Murray
858e0afcc4 Switch DirectSession to use _Arg and _Retval ops for feeding and fetching.
This change reduces the overhead imposed by string processing and
rendezvous invocation in the DirectSession::Run() call by 1--2 microseconds
per value fed or fetched.

RELNOTES: Improved DirectSession::Run() overhead and error checking. Feeding a value of the wrong type will now synchronously raise an INVALID_ARGUMENT error instead of asynchronously raising an INTERNAL error. Code that depends on the (undefined) behavior when feeding a tensor of the wrong type may need to be updated.
Change: 153797943
2017-04-20 23:49:19 -07:00
A. Unique TensorFlower
20a52139ef Add unreduced NONE, and reduced MEAN options for losses.
Remove "WEIGHTED_" prefix from other Reduction constants.
Change: 153758104
2017-04-20 14:51:04 -07:00
Andrew Harp
4c493e97fe Android: Create TensorFlow AAR as part of nightly build, so that it will be downloadable at https://ci.tensorflow.org/view/Nightly/job/nightly-android/
This contains TensorFlowInferenceInterface and the Java API, as well as all of the native prebuilt libraries. This means that TF can be integrated into an Android Studio app simply by downloading the AAR file to e.g. aar/, and then adding the following into a gradle build file:

allprojects {
    repositories {
        jcenter()
        flatDir {
            dirs 'aar'
        }
    }
}

dependencies {
    compile(name:'tensorflow', ext:'aar')
}
Change: 153741338
2017-04-20 12:30:04 -07:00
A. Unique TensorFlower
92bf4b3927 Fix graph_transform documentation:
- remove \ from within strings
  - remove :0 from inputs and outputs, so fold_constants works
  - make sure fold_(old_)batch_norms runs before quantize_weigths
    and round_weights.
Change: 153728959
2017-04-20 11:12:48 -07:00
Asim Shankar
149553af78 libtensorflow: Fix typo
Windows: Fix typo in C API binary release script.
(Not that the C API binary release for Windows is ready to release yet)

Linux/Mac: Fix typo in libtensorflow_proto.zip location
Change: 153656805
2017-04-19 17:50:34 -07:00
Jonathan Hseu
fd14d0ac6a Support the whence parameter in GFile's .seek() to match Python's file
semantics. Also rename position to offset to match Python's file parameter
naming.

Fixes numpy.load() from gfile.
Change: 153655962
2017-04-19 17:35:30 -07:00
A. Unique TensorFlower
82da113f05 Add SavedModel CLI(Command-line Interface) tool.
Change: 153652492
2017-04-19 17:09:12 -07:00
A. Unique TensorFlower
721c48c611 Expand pip_smoke test to contrib.
Change: 153614629
2017-04-19 12:08:38 -07:00
Mark Daoust
95c5d7e880 Generalize LazyLoader for use by ffmpeg
Add __dir__ method so the docs generator doesn't need to
 do anything special to activate the loading
Change: 153583515
2017-04-19 07:29:05 -07:00
Dan Ringwalt
4b57da4ced Move weights to be the second argument in tf.bincount.
This matches np.bincount(x, weights, minlength).
Change: 153476565
2017-04-18 10:31:20 -07:00
Patrick Nguyen
69a4cf80a1 Merge changes from github.
Change: 153426348
2017-04-17 22:15:14 -07:00
A. Unique TensorFlower
949d457dc9 Add utility to get current name scope in tf.contrib.framework.
Change: 153409845
2017-04-17 17:32:44 -07:00
Francois Chollet
fd561221d2 Refactor Keras initializers to rely on core TF initializers; add serialization methods to core TF initializers.
Change: 153403157
2017-04-17 16:39:05 -07:00
Sergio Guadarrama
4b046fb5aa Add Huber Loss to tf.losses
Change: 153400856
2017-04-17 16:25:46 -07:00
A. Unique TensorFlower
94a2da3905 Add a GPUOPTIONS option to force all tensors to be gpu_compatible
Change: 153386455
2017-04-17 14:36:03 -07:00
Asim Shankar
1ae60b652a Release: Package public API protocol buffer files into an archive
Change: 153363147
2017-04-17 11:28:09 -07:00
Jianwei Xie
283789792f Add model_dir in RunConfig. Estimator will read it also.
Change: 153233683
2017-04-14 20:30:43 -07:00
Patrick Nguyen
ba4bfd9208 Add sdca ops to tf.train.
This adds:
  * tf.train.sdca_optimizer
  * tf.train.sdca_fprint
  * tf.train.sdca_shrink_l1
which were previously documented, and prior to 1.0, in tf.sdca.
In 1.0, they were absent from tf.sdca, so this does not break
compatibility.

The module tf.sdca is removed.
Change: 153176548
2017-04-14 10:17:10 -07:00
A. Unique TensorFlower
7d4aaddaad Automated rollback of change 153039058
Change: 153045639
2017-04-13 03:48:00 -07:00
A. Unique TensorFlower
b4396632f7 Add a GPUOPTIONS option to force all tensors to be gpu_compatible
Change: 153039058
2017-04-13 02:09:42 -07:00
Asim Shankar
26b5e3cdea libtensorflow.sh: Delete old artifacts before attempting the build
Otherwise the previous artifacts show up in the Jenkins list of artifacts
even when the build fails.
Change: 153011768
2017-04-12 18:09:46 -07:00
Pete Warden
7c9d2a458e Add AudioSpectrogram op to TensorFlow for audio feature generation
Change: 152872386
2017-04-11 16:08:23 -07:00
A. Unique TensorFlower
8ab0ce8f86 Adding license headers to cmake files.
Change: 152835531
2017-04-11 11:32:09 -07:00
A. Unique TensorFlower
0f7df20b2c Allow callers to control the names of the slot variables.
Other optimizers which have only a single slot variable allow control through
the 'name' constructor parameter, but the FtrlOptimizer has two variables.
Because they both are created with the same 'name' parameter, one of them has
name as a suffix, and the other has name + "_1" as a suffix.  This change
allows them to be specified in a more controllable way.
Change: 152802478
2017-04-11 06:05:13 -07:00
Derek Murray
c0095c9709 Adds tf.Session.make_callable().
This method returns a Python callable that has the same semantics as
`tf.Session.run()`, but can cache some of the work that must be done
to map Tensor-like objects to the arguments of the underlying C API
function.

The initial implementation is optimized for single-`Tensor` and
single-`Operation` fetches, and delegates to `tf.Session.run()` for
handling feeds. Since most queue runners use a single-`Operation`
`run()` call, switch the `tf.train.QueueRunner` implementation to use
`make_callable()`

Using this new interface can improve the latency of small steps (measurements from my workstation):

* The median time to fetch a 4-byte tensor decreases from 99us to 52us (-47us).
* The median time to run a trivial op decreases from 80us to 31us (-49us).
Change: 152757301
2017-04-10 17:45:05 -07:00
A. Unique TensorFlower
ace2aa7b6f Add option to return loss as batch sum, or divided by number of non-zero weights.
Change: 152754313
2017-04-10 17:10:55 -07:00