Some test methods are disabled, but all tests now have a new "_xla" version of the test for XLA:GPU testing. This will run 2 different tests. One with XLA and one without.
PiperOrigin-RevId: 229149574
Currently, we set the tag "local" for GPU tests in order to be able to execute
remote CPU and local GPU tests within the same bazel invocation.
This change introduces the possibility to set REMOTE_GPU_TESTING to enable
GPU tests to also run remotely; given that tags cannot use starlark's select,
we use an autoconfig rule that defines a function returning the tags we want:
"local" by default and "remote-gpu" if REMOTE_GPU_TESTING is set.
The platform is set via exec_compatible_with constraints, so we select on the
"remote-gpu" tag to add a constraint that is only fulfilled by GPU-enabled
platforms.
PiperOrigin-RevId: 229141861
The old pattern did an implicit iteration over a depset which will be forbidden in the future since it is potentially expensive. The new to_list() call is still expensive but it will be more visible.
PiperOrigin-RevId: 222189113
More tf_kernel_library are suffering from #10521
So we apply EIGEN_STRONG_INLINE to all tf_kernel_library if --define=override_eigen_strong_inline=true, this reduce the maximum presubmit time from 2h to 50 mins
For release build, EIGEN_STRONG_INLINE is still turned off so that performance is not damaged.
PiperOrigin-RevId: 220470017
The command: `python -c 'from tensorflow.contrib import tensorrt as trt'` fails
with:
File "/xxx/lib/python2.7/site-packages/tensorflow/contrib/tensorrt/wrap_conversion.py", line 24, in swig_import_helper
_mod = imp.load_module('_wrap_conversion', fp, pathname, description)
ImportError: dynamic module does not define init function (init_wrap_conversion)
➜ 1534993632 nm /xxx/lib/python2.7/site-packages/tensorflow/contrib/tensorrt/_wrap_conversion.so | grep wrap_conversion
0000000000003670 t _init_wrap_conversion <---------- symbol defined, but local, not exposed
U init_wrap_conversion
I init_wrap_conversion (indirect for init_wrap_conversion)
Happens because the linker version script has: `init_wrap_conversion` instead of `_init_wrap_conversion`
xref: https://github.com/tensorflow/tensorflow/issues/21818
xref: https://stackoverflow.com/a/37534357
Currently, we run tests on machines with GPUs based on the "gpu" tag, and the
tests automatically adapt to whether a GPU is available. Creating two targets,
one tagged with "gpu" and one not, will make us run the tests in both modes.
PiperOrigin-RevId: 215045035
This change reduce the size of //tensorflow/tools/pip_package:simple_console_windows's zip file from 1000027677 bytes to 47690474 bytes for a CPU build. For GPU build, it will avoid going over 4GB when multiple CUDA compatibility are specified.
To fix#22390
PiperOrigin-RevId: 214764423
Bazel does not allow python rules to directly depend on c++ rules.
So I have to separately manage static dependencies, unfortunately avoiding
"kernels" option for now.
PiperOrigin-RevId: 214532631
The commit contains following components to support TensorFlow on ROCm platform
- bazel build system
- continuous integration logic
Authors:
- Jack Chung: jack.chung@amd.com
- Jeffrey Poznanovic: Jeffrey.Poznanovic@amd.com
- Peng Sun: Peng.Sun@amd.com
Previously, specifying --define=using_mkl_dnn_only=true would cause
MKL-ML-dependent code to be #ifdef'd out, but dependencies on MKL-ML itself
would still be present. This change makes all library dependencies on MKL
properly select MKL-ML, MKL-DNN, or both, depending on the selected
configuration.
PiperOrigin-RevId: 208710102
The existing feature macros are named INTEL_MKL to indicate that any flavor of
MKL is available, INTEL_MKL_ML to indicate that *only* MKL-ML is available
(i.e. MKL-DNN is not), and DO_NOT_USE_ML to indicate that *only* MKL-DNN is
available (i.e. MKL-ML is not).
This change renames INTEL_MKL_ML to INTEL_MKL_ML_ONLY and DO_NOT_USE_ML to
INTEL_MKL_DNN_ONLY. The meanings of the macros have not changed.
This change also adds a few sanity checks to mkl_util.h that ensures that the
combination of INTEL_MKL, INTEL_MKL_ML_ONLY, and INTEL_MKL_DNN_ONLY is
logically consistent: the *_ONLY macros may not both be defined, and if either
of them is defined, bare INTEL_MKL must also be defined.
PiperOrigin-RevId: 208313735
* Added nGraph bridge as a third_party to be built with TensorFlow based on user selection.
* Added a limited set of C++ unit tests to verify the correctness of the computation
These checks were necessary when we used RTLD_GLOBAL to expose TF symbols to custom ops, since :framework and :lib pulled in implementations. They're now header-only. Ideally we'd switch the checks to framework_internal_impl and lib_internal_impl, but that would require visibility for those rules (thus making it more likely they'd get included in silly places). So this change disables the check for dynamic builds, on the theory that accidentally relying on implementation rules is much more difficult than it was with a static build.
Should allow tf_custom_op_libraries to depend on GPU kernels (which depend on core:gpu_lib which depends on :framework).
PiperOrigin-RevId: 205472434
Revert #18413. Too many internal test failures due to the name scope change caused by this change.
Revert #18192. Cannot use re2::StringPiece internally. Need alternative for set call. Will pull and clean this up in a separate change.
PiperOrigin-RevId: 197991247
NVFlex.o in cuda_9_0/lib64/libculibos.a has buggy .eh_frame, which overlaps with .rela.rodata R_X86_64_PC32 relocations and makes it not able to be linked with LLD.
PiperOrigin-RevId: 196155873
The implementation of tensorflow/core/platform/default/mutex.h uses the nsync
library, so mutex.h has included nsync header files.
This has been awkward, because each TensorFlow build (bazel, cmake, make, plus
the instructions for compiling individual custom ops, on all the various
platforms) has needed to handle the include paths correctly, reaching into a
package that is downloaded separately from TensorFlow itself.
This change avoids that awkwardness, instead taking on two different
irritations:
- mutex.h now defines two structs that are large enough and aligned enough to
contain an nsync_mu and an nsync_cv. This is an abstraction violation,
because TensorFlow's source should not need to know how big these data
structures are. However, this is unlikely to cause problems because:
1) this is checked by a static assertion in mutex.cc, so we will notice
immediately should a change be needed, and
2) this will likely never fail because we have no intent of allowing nsync's
data strcutures to get bigger.
- The methods of mutex and condition_variable can no longer be inlined, because
that too would require mutex.h to include the nsync header files. (Or we'd
need to declare the nsync functions directly in mutex.h, which would be
another abstraction violation.) However, this is a small imposition
because the overhead of a procedure call is typically small.
The assumption behind this CL is that these irritations are less important than
the ongoing frustration of maintaining the complex include path in multiple build
systems.
PiperOrigin-RevId: 189079523
This change adjusts the build options for tf_cc_test targets so that
they can be built for Android devices by default. Many targets will
still need additional options on a per-target basis.
Android requires that executables be compiled with `-pie`.
PiperOrigin-RevId: 179729092
--copts are passed to both c++ and c (so is redundent with --cxxopts).
Configs passed to "bazel build" are inherited by "bazel run" and "bazel test".
Also removed some unused configs.
PiperOrigin-RevId: 175326697
END_PUBLIC
---
Commit ee0fdc296 authored by Gunhan Gulsoy<gunan@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add noasan tag to estimator_test
PiperOrigin-RevId: 171075499
---
Commit a02116882 authored by Justin Lebar<jlebar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA:CPU] Put the HLO name in IR values that hold the HLO's value.
PiperOrigin-RevId: 171075449
---
Commit 89aaac4bc authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Allow Layer.add_update() in Eager mode.
PiperOrigin-RevId: 171070861
---
Commit 840dcae57 authored by Amit Patankar<amitpatankar@google.com>
Committed by gunan<gunan@google.com>:
Updating the install sources file with a supported configs table (#13450)
* Updating the install sources file with a supported configs page.
* Implementing Gunan's suggestions.
* Adding GCC string to Linux compiler.
* Updating the bazel/cmake column.
---
Commit 89df2e336 authored by Igor Saprykin<isaprykin@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add the 'is_the_final_export' signal to Exporters. Use them in training.
When the training ends, the final export is performed via `Exporter.export()` call. That final export is going to have is_the_final_export parameter being set to true.
If `TrainSpec.max_steps` is `None`, then "when training ends" is undefined. We are going to train forever. In that case, `is_the_final_export` is going to be always False. I added a note about it.
PiperOrigin-RevId: 171070760
---
Commit 4486b4f69 authored by Akshay Agrawal<akshayka@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Make graph_callable compatible with functions that do not return anything
PiperOrigin-RevId: 171067061
---
Commit 39565c0cb authored by Martin Wicke<wicke@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Publish train_and_evaluate and associated classes.
PiperOrigin-RevId: 171066379
---
Commit 3b4477000 authored by Saurabh Saxena<srbs@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Make VariantTensorData::tensors_size() const.
PiperOrigin-RevId: 171063397
---
Commit 53cc63a2d authored by Dhananjay Nakrani<dhananjayn@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[part 1] Add support for int32 & int64 in RandomPoissonOp.
This computes int32/int64-precision poisson samples with double precision intermediate calculations (same as it's done for `half`) respectively.
part 2 will switch over python calls to new op once forward compatibility period has passed.
PiperOrigin-RevId: 171058336
---
Commit 70fc9bf9b authored by Asim Shankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Java: Add support for loading op libraries dynamically.
This change adds the equivalent of tf.load_op_library in Python to Java.
(5c7f9e316d
was required to make this possible)
Though, TensorFlow.loadLibrary() is likely to fail on Windows as symbols
required by custom op libraries (those exported by the tensorflow_framework library)
are not exported by the monolithic JNI library yet.
This should help with #10454 and #13476
PiperOrigin-RevId: 171054707
---
Commit e7c53698e authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Internal cleanup
PiperOrigin-RevId: 171053770
---
Commit cc8ee6c0f authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fast path for tf.conj when it should be pass-through.
PiperOrigin-RevId: 171053662
---
Commit c41dbc3c1 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adding TF Boosted trees regression example on boston dataset, minor fix for mnist example.
PiperOrigin-RevId: 171052367
---
Commit d66e77f7c authored by Mustafa Ispir<ispir@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Added get variable utils to tf.estimator.Estimator.
PiperOrigin-RevId: 171052121
---
Commit 083bd5dde authored by Asim Shankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Java: Add support for loading op libraries dynamically.
This change adds the equivalent of tf.load_op_library in Python to Java.
(5c7f9e316d
was required to make this possible)
Though, TensorFlow.loadLibrary() is likely to fail on Windows as symbols
required by custom op libraries (those exported by the tensorflow_framework library)
are not exported by the monolithic JNI library yet.
This should help with #10454 and #13476
PiperOrigin-RevId: 171054707
---
Commit 2fe6cf285 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Internal cleanup
PiperOrigin-RevId: 171053770
---
Commit 15155493b authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fast path for tf.conj when it should be pass-through.
PiperOrigin-RevId: 171053662
---
Commit 6c954d0b3 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adding TF Boosted trees regression example on boston dataset, minor fix for mnist example.
PiperOrigin-RevId: 171052367
---
Commit ad69076eb authored by Mustafa Ispir<ispir@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Added get variable utils to tf.estimator.Estimator.
PiperOrigin-RevId: 171052121
---
Commit 3cf41b2ed authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Test save/restore variable from graph_callable.
PiperOrigin-RevId: 171051237
---
Commit cf17ec96e authored by Yangzihao Wang<yangzihao@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add V2 versions of output window size computation functions for convolution.
These V2 versions take arbitrary dilation rates.
In preparation for the support of native cudnn dilated convolution.
PiperOrigin-RevId: 171048878
---
Commit 491584ff4 authored by Asim Shankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
eager: Always run dataset iterator operations on CPU.
It has no kernels for other devices.
With an explicit "tf.device()" before invoking the kernel we ensure
that Iterator.next() functions even when placed inside a:
with tf.device("/device:GPU:0")
PiperOrigin-RevId: 171048558
---
Commit 3b354016e authored by Igor Saprykin<isaprykin@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Rename SavedModelExporter to LatestExporter.
PiperOrigin-RevId: 171048345
---
Commit 943c6d7af authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
errors out if the evaluator has task id > 0.
PiperOrigin-RevId: 171047652
---
Commit 8c9ef4466 authored by Mark Heffernan<meheff@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Expand set of 64-bit type tests in LocalClientExecuteTest.ShapeBufferToLiteralConversion64bit and factor out into their own test.
PiperOrigin-RevId: 171043047
---
Commit cc521eb06 authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Place all the nodes created by the trivial_test_graph_input_yielder
PiperOrigin-RevId: 171045878
---
Commit 9b9301240 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA:CPU] Factor out parallel task assignment from cpu parallelization prep (no functional changes).
PiperOrigin-RevId: 171045137
---
Commit 558d878d9 authored by Allen Lavoie<allenl@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
TFTS: Move normalization to the base class, start using it for state space models
Preivously, state space models adjusted their priors based on the data
(e.g. setting initial variances to match sample variance) but did not normalize
the data itself. When the data has a rather extreme scale, this runs into
precision issues. After this CL, state space models will first normalize, then
use adjusted statistics on top of that normalization to estimate initial
observation/transition noise.
Also fixes an issue where start-of-series statistics were incorrect for the first
batch (which only shows up with large input scales).
PiperOrigin-RevId: 171044863
---
Commit 266f77156 authored by Mark Heffernan<meheff@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Expand set of 64-bit type tests in LocalClientExecuteTest.ShapeBufferToLiteralConversion64bit and factor out into their own test.
PiperOrigin-RevId: 171043047
---
Commit c9915d1a2 authored by Shanqing Cai<cais@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[tf-signal] Fix pip tests by including test_util in signal_py
PiperOrigin-RevId: 171042732
---
Commit f8550f4e9 authored by Mark Heffernan<meheff@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Expand set of 64-bit type tests in LocalClientExecuteTest.ShapeBufferToLiteralConversion64bit and factor out into their own test.
PiperOrigin-RevId: 171043047
---
Commit 87dc532cd authored by Shanqing Cai<cais@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[tf-signal] Fix pip tests by including test_util in signal_py
PiperOrigin-RevId: 171042732
---
Commit 0578dd65e authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add more debugging output for XLA send/recv.
PiperOrigin-RevId: 171041978
---
Commit 23992bb09 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Several minor documentation fixes.
PiperOrigin-RevId: 171038610
---
Commit af14ed3f3 authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Some docstring twists and argument validations.
PiperOrigin-RevId: 171037949
---
Commit 6b90a65f6 authored by Mark Heffernan<meheff@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove "hybrid" HloModuleConfig option. The option was used to generate executables which only generated the array values of tuple-shaped outputs, not the tuple index tables.. With cl/170133015, ShapedBuffers which hold the computation output now have materialized tuples with these index tables so this option is no longer desired or necessary.
No functional change. Just cleanup.
PiperOrigin-RevId: 171035738
---
Commit 41a0264ab authored by Mustafa Ispir<ispir@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Added utilities to make global step reading deterministic. Used them in Estimator.
Enabled/Fixed some tests.
PiperOrigin-RevId: 171035291
---
Commit 9d7843c0a authored by Skye Wanderman-Milne<skyewm@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add optional unused_input_map_keys output param to ImportGraphDef
This is a more general feature than that in the Python importer, which
raises an exception if the input map contains unused names.
PiperOrigin-RevId: 171029316
---
Commit 4f10a6597 authored by Mark Heffernan<meheff@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add vlogging of HloModule before and after fusion.
PiperOrigin-RevId: 171029054
---
Commit 9e658545a authored by Reed Wanderman-Milne<reedwm@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Document what dtype tf.image.resize_images returns.
For consistency, tf.image.resize_images now will always return a float32 when method != ResizeMethod.NEAREST_NEIGHBOR. Before, it returned the same dtype as its input if it could be determined statically that the height and width would not be changed.
PiperOrigin-RevId: 171028825
---
Commit 4d70239f0 authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Replace the contrib FC with core FC in canned Estimator docstring.
PiperOrigin-RevId: 171027602
---
Commit 6a1b867ff authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adds the docstring with details for tf.estimator.train_and_evaluate
PiperOrigin-RevId: 171027527
---
Commit 7209c1602 authored by Peter Hawkins<phawkins@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[TF:XLA] Mark IdentityN as CompilationOnly().
PiperOrigin-RevId: 171025171
---
Commit 8e22eb874 authored by FAIJUL<md.faijul.amin@intel.com>
Committed by Benoit Steiner<benoitsteiner@users.noreply.github.com>:
Eigen BiasAdd and BiasAddGrad Fix for NCHW Format. (#13158)
---
Commit 7db7a890c authored by Jingyue Wu<jingyue@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[Grappler] Move InferOutputShapes to GraphProperties.
So it can be used by other optimizers. No functional changes.
PiperOrigin-RevId: 171010106
---
Commit 2114fd51e authored by Peter Hawkins<phawkins@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[TF:XLA] Improve numerical stability of SoftPlus.
PiperOrigin-RevId: 171003559
---
Commit 727d6270f authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix race condition in TensorForest tree traversal.
PiperOrigin-RevId: 170990425
---
Commit d016cb020 authored by Suharsh Sivakumar<suharshs@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix c++ gradients issue where multiple dependent outputs result in incorrect answer.
The issue is that we incorrectly calculate the pending num_expected_backprops for outputs nodes when one output transitively depends on another. this is because we use output nodes as an indicator of when we need to end our traversal. Instead we should only use output nodes that don't transitively get consumed by other output nodes as end indicators for our traversal. This change implements that fix.
Fixes#13190
PiperOrigin-RevId: 170971937
---
Commit 5405f3bd7 authored by gunan<gunan@google.com>
Committed by Frank Chen<frankchn@gmail.com>:
Fix tf-signal tests on pip packages. (#13483)
---
Commit f9f037c1c authored by Eugene Brevdo<ebrevdo@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Bugfix to LSTMBlockCell and friends: clipping is off by default.
* Rename broken API argu clip_cell boolean to cell_clip value.
* Make default no clipping.
PiperOrigin-RevId: 170960975
---
Commit bfaaefa9e authored by Frank Chen<frankchn@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update APIs for TPU Cluster Resolver to remove the custom API definition and instead use a standard definition file stored in GCS.
PiperOrigin-RevId: 170960877
---
Commit c31c118a3 authored by Ian Langmore<langmore@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Extend tf.contrib.bijector API to handle some non-injective transforms.
AbsoluteValue Bijector added to contrib/distributions/bijectors/
TransformedDistribution udpated to handle some non-injective transforms.
PiperOrigin-RevId: 170960054
---
Commit 664dd0859 authored by Frank Chen<frankchn@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Disable cluster_function_library_runtime_test on Mac OS as it is currently failing with an Unimplemented error
PiperOrigin-RevId: 170958505
---
Commit 6af7ab97a authored by Mahmoud Abuzaina<mahmoud.abuzaina@intel.com>
Committed by gunan<gunan@google.com>:
MKL-DNN open source integration. (#13135)
* MKL-DNN conv and build integration
* Adding new files that were mistakenly missing from the PR
* Minor change in the pip package build file
* Added missing #include
* Fixed a linking failure when running the bazel test
* Fixing BUILD file format
* Using -fopenmp for building mkl_dnn only when running on linux
* Fixing build rule attribute value
* Removing unnecessary deps from mkl test rule
* Removed deps on mkl-dnn when not building with --config=mkl
---
Commit 93fa1af76 authored by Akshay Agrawal<akshayka@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Make graph_callable, defun tf_decorators
PiperOrigin-RevId: 170948777
---
Commit b39525785 authored by Mustafa Ispir<ispir@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Added comment re:behavior of listener in case of multiple saver hooks.
PiperOrigin-RevId: 170946536
---
Commit de14fcbb6 authored by Igor Saprykin<isaprykin@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Support evaluation in `_TrainingExecutor.run_master()`.
This CL aims to address the following TODO:
# TODO(b/66720832): Once listener API is added into Estimator.train, the
# eval and export process should be wrapped as a listener and passed to
# _start_distributed_training. The expected behavior should be
# 1. The export is invoked after each intermediate evaluation.
# 2. The evaluation and export should be invoked correctly at the end of
# training. This should be fine if the listener works as intended (it will
# send the `after_save` signal for the final ckpt saving).
1. is achieved as follows:
a. saving_evaluators are added to the CheckpointSaverHook's listeners inside the Estimator.
b. MonitoredSession calls after_run() of CheckpointSaverHook, which in turn calls after_save on the listeners.
2. is achieved in a similar way, but when MonitoredSession calls .end() on CheckpointSaverHook.
PiperOrigin-RevId: 170945961
---
Commit d4ea993ca authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Removes unnecessary eager-mode call to convert_to_tensor in record_gradient.
PiperOrigin-RevId: 170944265
---
Commit add6d2d03 authored by RJ Ryan<rjryan@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[tf-signal] Use tf.spectral.dct in mfccs_from_log_mel_spectrograms instead of a private implementation.
PiperOrigin-RevId: 170943986
---
Commit b959da92f authored by Jiri Simsa<jsimsa@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fixing CPU implementation of parallel_stack for tensors with non-zero rank.
PiperOrigin-RevId: 170942814
---
Commit 4cf61262a authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Improve TFGAN documentation.
PiperOrigin-RevId: 170940188
---
Commit 0068086b9 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Introduce `tf.data` namespace.
PiperOrigin-RevId: 170939033
---
Commit 0c8dbc1fd authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
matmul uses shape_tuple internally
PiperOrigin-RevId: 170938790
---
Commit ad37fa81f authored by Igor Saprykin<isaprykin@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Refactor ExportStrategies into Exporters.
This design eliminates some indirection. Instead of combining an `export_fn` with `make_export_strategy` call to arrive at an ExportStrategy that is going to call the supplied `export_fn` inside its `export` call with Exporters one just defines the `export` call in an Exporter.
PiperOrigin-RevId: 170936640
---
Commit b925f8553 authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fast-path for EagerTensorBase.dtype
PiperOrigin-RevId: 170933005
---
Commit 08e266d9b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Pass activity_regularizer to __init__ instead of using the (now
deprecated) property setter.
PiperOrigin-RevId: 170932807
---
Commit b002c8b7d authored by Jingyue Wu<jingyue@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[Grappler] Fold chains of reshapes.
Reshape(Reshape(input, shape1), shape2) is equivalent to Reshape(input,
shape2).
PiperOrigin-RevId: 170932278
---
Commit 075d1d13b authored by horance<horance@aliyun.com>
Committed by Frank Chen<frankchn@gmail.com>:
remove warning for forward decl (#13459)
---
Commit 931609fcf authored by Ryohei Kuroki<ryohei.kuroki@gmail.com>
Committed by Frank Chen<frankchn@gmail.com>:
Remove unnecessary specification for default kernel name (#13465)
---
Commit 94463f521 authored by Akshay Agrawal<akshayka@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Preserve target function signature in custom_gradient decorator
PiperOrigin-RevId: 170931715
---
Commit 681056636 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Internal change to simplify prediction ops.
- it no longer returns predictions_no_dropout, which is mostly for debugging purpose.
- as a consequence, MultipleAdditiveTrees::Predict() doesn't return prediction_no_dropout, and it accept trees_to_include indexes intead of trees_to_drop indexes.
PiperOrigin-RevId: 170926422
---
Commit d6e963b82 authored by Asim Shankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
SYCL: Fix build breakage introduced in
f0e8c545e0Fixes#13350
PiperOrigin-RevId: 170923862
---
Commit 5123f2971 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Internal cleanup.
PiperOrigin-RevId: 170922297
---
Commit d0c76cd18 authored by Igor Saprykin<isaprykin@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Handle the absence of a fresh eval checkpoint in `run_local`.
It is ~unexpected condition for an eval checkpoint to not be available after a train call to the estimator. There is a corner case when it is possible, but that's going to be resolved soon.
This case is handled for continuous (distributed) evaluation differently. Instead of erroring out, we skip evaluation runs. That behavior is captured in the `test_skip_evaluation_due_to_ckpt` test.
PiperOrigin-RevId: 170919925
---
Commit 435b31b9f authored by Gunhan Gulsoy<gunan@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
BEGIN_PUBLIC
Automated g4 rollback of changelist 170892257
PiperOrigin-RevId: 171321707
Splits out a shared object (//tensorflow/libtensorflow_framework.so) with core TensorFlow functionality but neither ops nor kernels. This object does include registries for ops, kernels, filesystems, etc. The expectation is that shared objects containing custom ops will have a runtime dependency on this framework shared object: TensorFlow will load the custom op shared object, and the custom op shared object will use the symbols from the framework shared object to register its ops/kernels/etc. rather than (as before this change) relying on those symbols being in the global symbol table.
In this mode, TensorFlow artifacts (_pywrap_tensorflow.so for Python, libtensorflow.so for the C API; currently excluding Android artifacts) will depend on the framework shared object, which will be packaged with the Python pip package and other language distributions. This means that custom ops targeting the framework shared object will work in any language (C++, Java, Go; previously custom ops in these languages required custom Bazel builds).
Adds a config option which reproduces the old behavior (--config=monolithic), which for Python means building a monolithic pywrap_tensorflow shared object and loading its symbols into the global symbol table (with RTLD_GLOBAL). As before, there will be no extra-Bazel custom op support for other languages when compiling in this mode.
Does not change behavior on Windows; the cmake build is still monolithic.
Requires using tf_cc_binary, tf_cc_test, and (rarely) tf_cc_shared_object rules to link in the framework shared object when adding new TensorFlow build rules.
PiperOrigin-RevId: 169572746
END_PUBLIC
I also integrated #13073 by hand to make TAP happy.
---
Commit 92362d0f0 authored by Skye Wanderman-Milne<skyewm@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add WhileContext class and add plumbing for creating them.
This change introduces WhileContext, which stores information about a
while loop and will be used in future changes to generate while loop
gradient graphs. Exit nodes in a while loop now have a pointer to
their associated WhileContext. This will be used to retrieve the
context for a given loop.
This change adds an optional parameter to BuildWhileLoop() to create a
WhileContext for the while loop (currently this is always true, but
gradients will generate while loops without associated contexts). This
change also adds a as-yet-unused option to BuildWhileLoop() to return
the predicate output.
PiperOrigin-RevId: 168562303
---
Commit a4f6e7c1a authored by RJ Ryan<rjryan@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add mel-scale conversion matrix support to tf.contrib.signal.
PiperOrigin-RevId: 168560255
---
Commit b00b6d23c authored by Henry Tan<henrytan@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix a segmentation fault caused by invalid log directory in InternalFlush().
PiperOrigin-RevId: 168557063
---
Commit 2bc7a155a authored by Yong Tang<yong.tang.github@outlook.com>
Committed by Rasmus Munk Larsen<rmlarsen@google.com>:
Add uint16 support for tf.decode_raw (#12719)
* Add uint16 support for tf.decode_raw
This fix tries to address the request raised in 10124 where
uint16 support for tf.decode_raw is needed. tf.decode_raw
already support half, float32, float64, int8, int16, int32, int64,
uint8. And uint16 was not supported.
This fix adds uint16 support for tf.decode_raw.
This fix fixes 10124.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Fix test failure caused by uint16 support of decode_raw and add unit tests.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
---
Commit 009285c09 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove benchmark for TensorShapeOld.
PiperOrigin-RevId: 168551108
---
Commit dc1eda8a6 authored by Peter Hawkins<phawkins@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Fix CHECK-failure crash if a non-tuple was passed to GetTupleElement.
PiperOrigin-RevId: 168550703
---
Commit 010922ed9 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Go: Update generated wrapper functions for TensorFlow ops.
PiperOrigin-RevId: 168549989
---
Commit c8a6131e9 authored by Mark Daoust<markdaoust@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
make `tf.sets` examples executable
Fixes#12969
PiperOrigin-RevId: 168549712
---
Commit bece65c6f authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Use a map instead of a vector of Children() in the BeamEntry.
The assumption is that since the entries are sparse (they are all populated, but most are never Active()), using the map will save memory and make iterating over the Children() more efficient.
PiperOrigin-RevId: 168548814
---
Commit 0d5ab82ce authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update ops-related pbtxt files.
PiperOrigin-RevId: 168548642
---
Commit 3331c574b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Implementing gradients for tf.image.resize_bicubic.
PiperOrigin-RevId: 168547412
---
Commit 4982ef0fa authored by Martin Wicke<wicke@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add the ability to warn only once if deprecated functionality is used, and make that the default.
PiperOrigin-RevId: 168545655
---
Commit 99423416a authored by Peter Hawkins<phawkins@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Make shape inference error messages for the While HLO more readable. Build the error lazily.
PiperOrigin-RevId: 168531083
---
Commit d10374e45 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Discard some unneccessary logging commands.
PiperOrigin-RevId: 168500721
---
Commit 83cbabb85 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix wrong format of logging message.
PiperOrigin-RevId: 168497373
---
Commit eec4f1b3a authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Go: Update generated wrapper functions for TensorFlow ops.
PiperOrigin-RevId: 168494944
---
Commit 69301f352 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update ops-related pbtxt files.
PiperOrigin-RevId: 168494220
---
Commit 9d56f419c authored by Mingxing Tan<tanmingxing@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add crop_and_decode_jpeg_op that combines the crop and decode for better
performance.
PiperOrigin-RevId: 168493125
---
Commit 48ddf64d0 authored by Chris Leary<leary@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Make large params test only run in opt builds.
PiperOrigin-RevId: 168491913
---
Commit 11d3ac29d authored by Chris Leary<leary@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Add tests for large numbers of parameter / return values and while loops.
PiperOrigin-RevId: 168487225
---
Commit 3cd6bdef5 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Added test cases on R4 slice.
PiperOrigin-RevId: 168482049
---
Commit 46a81b5c3 authored by Jacques Pienaar<jpienaar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add cast S64 to F32 test.
PiperOrigin-RevId: 168473650
---
Commit 59bdf598d authored by Derek Murray<mrry@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add an automatically-generated "tensorflow.python.platform.build_info" script.
The motivation for this script is to provide better tools for
diagnosing load-time errors (such as the ones that plague the Windows
build due to DLL issues). Note that the script is intended to be
self-contained, so that it is possible to import it without loading
the entire TensorFlow runtime.
This generated script currently contains a single symbol,
`is_cuda_build`, which records whether the build has GPU support or not.
PiperOrigin-RevId: 168471034
---
Commit c3b86347f authored by Olivia Nordquist<nolivia@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
reenabling tests that are passing
PiperOrigin-RevId: 168466361
---
Commit c728665ec authored by Henry Tan<henrytan@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add const qualifiers whenever appropriate.
PiperOrigin-RevId: 168465926
---
Commit bf96fcd13 authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Use the scalar cache in MeanGrad.
PiperOrigin-RevId: 168462267
---
Commit 1cada9ea2 authored by Olivia Nordquist<nolivia@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
reenabling test that passed after 100 runs w/o timing out
PiperOrigin-RevId: 168458634
---
Commit 00c865566 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Generate error (instead of segfault) when trying to copy string tensor
to GPU in EagerTensor constructor.
PiperOrigin-RevId: 168457320
---
Commit 655f26fc7 authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Resurrects autograd-free eager gradients.
PiperOrigin-RevId: 168448557
---
Commit 8f37f3002 authored by Peter Hawkins<phawkins@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[TF:XLA] Cleanups to handling of arguments during XLA compilation:
* combine resource kinds in XlaCompiler::Argument::Kind, use a separate XlaResource::Kind field to distinguish different kinds of resource.
* merge XlaContext::HandleOrConstant and XlaExpression, which were almost identical.
* remove XlaContext::Argument; instead, build XlaExpressions directly from XlaCompiler and add them to the XlaContext.
PiperOrigin-RevId: 168439341
---
Commit 7f5346a80 authored by Gunhan Gulsoy<gunan@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Reduce cmake log mess.
* Echo off for the .bat scripts.
* TF cmake: disable warnings in some of the patched projects (gif,jpeg,lmdb).
PiperOrigin-RevId: 168432070
---
Commit 2ad85aa4d authored by Mark Heffernan<meheff@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Use xla/tests:xla_internal_test_main for all tests under tf/compiler/xla
and remove any main() definitions in tests. This enables use of flags
in all tests.
PiperOrigin-RevId: 168424796
---
Commit cd377811d authored by Henry Tan<henrytan@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Comment and error message consistency cleanup.
PiperOrigin-RevId: 168422582
---
Commit 7c19b82af authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update tf.sparse_reset_shape so that when shrinking the shape of an empty
sparse tensor, the result has a shape of all zeros.
PiperOrigin-RevId: 168419639
---
Commit fcacb40d4 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
FirstReadyManager for scheduling nodes in VirtualScheduler.
The current FIFOManager may yield inefficient scheduling; _Recv pushed to the
FIFO blocks other nodes that can run before _Recv due to the node order in FIFO.
FirstReadyManager picks a node with the earliest time_ready in the queue,
avoiding this problem.
Also, fixed VirtualPlacer to properly set device when Node's device name does not
include job name and to set GPU:0 as default device.
PiperOrigin-RevId: 168418455
---
Commit 7e47624f5 authored by Asim Shankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
eager: Initial support for iteration over tf.contrib.data.Dataset objects.
TODO:
- Support function-valued operation attributes in eager
(Required for MapDataset, FilterDataset etc. which encode the
per-element computation in a TensorFlow function)
PiperOrigin-RevId: 168418250
---
Commit b0a397fce authored by Asim Shankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
eager: Remove unnecessary TFE_Context argument to TFE_OpSetDevice.
PiperOrigin-RevId: 168417999
---
Commit 86211d554 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Graph transform to flatten atrous (dilated) convolutions (i.e., a sequence of SpaceToBatchND-Conv-BatchToSpaceND ops) to a regular Conv op with upsampled filters.
PiperOrigin-RevId: 168414124
---
Commit 3438981ca authored by David G. Andersen<dga@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Apply exported symbol filtering to the c++ API analogously to
what is filtered for the C API.
Fixes bug reported in comments on #1924
PiperOrigin-RevId: 168413719
---
Commit 7e023d865 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA:CPU] Remove code from parallel CPU backend outlining that was causing unnecessary copies to be inserted, and which is no longer necessary since we added co-located buffer support for kCall.
*) All bitcast copy is no longer necessary as CopyInsertion will insert copies
at the root of the computation for a parameter which is live-out.
*) Copy if root does not define buffer no longer necessary because colocated
assignment looks at points-to set of root instruction.
PiperOrigin-RevId: 168412076
---
Commit 5da4df92c authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Simplify some code in grappler_item_builder.cc, no change in logic.
PiperOrigin-RevId: 168409110
---
Commit 82ec6241a authored by drpngx<drpngx@users.noreply.github.com>
Committed by GitHub<noreply@github.com>:
Add six and numpy imports
---
Commit 9c4ce2452 authored by Mark Heffernan<meheff@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add flag parsing to more tests in xla/service specifically those which build
HLO graphs. This enables, for example, dumping of the graphs with
--xla_generate_hlo_graph. Also remove some superfluous tensorflow test_main
dependencies.
PiperOrigin-RevId: 168406746
---
Commit d4efa695c authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Relax the feed_nodes collection check, which triggers a false positive in some modes where the feed node collection is auto-generated. Keep it as a warning to help correct user-provided feed node lists.
PiperOrigin-RevId: 168396408
---
Commit cbc46a856 authored by Changming Sun<chasun@microsoft.com>
Committed by gunan<gunan@google.com>:
Add a missing template explicit instantiation of SetZeroFunctor (#12791)
---
Commit 7bb08f5bf authored by Kevin Slagle<kjslag@gmail.com>
Committed by drpngx<drpngx@users.noreply.github.com>:
fix ExponentialMovingAverage documentation so that ExponentialMovingAverage.apply is evaluated within control_dependencies (#12987)
---
Commit e6b011763 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Extend c++ gradient_checker to complex types.
PiperOrigin-RevId: 168392949
---
Commit 4086219a4 authored by Lyndon White<oxinabox@ucc.asn.au>
Committed by drpngx<drpngx@users.noreply.github.com>:
Correct minor typo in substr docs example (#12991)
---
Commit f63aa7f49 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Migrate core TFGAN functions to opensource.
PiperOrigin-RevId: 168391923
---
Commit bc6b60f1b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix tuple_losses bug caused by Python bug.
PiperOrigin-RevId: 168386341
---
Commit 7a8c63da3 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Migrate `leaky_relu` to `nn_ops.py`. Will be used for TFGAN.
PiperOrigin-RevId: 168386268
---
Commit f7ba16fdf authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Do not export from eval on train data steps.
PiperOrigin-RevId: 168374021
---
Commit 9b9e54b34 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adding NCCL sum op, register all_sum gradient.
Streamlining nccl test.
PiperOrigin-RevId: 168347428
---
Commit bc300318e authored by Gunhan Gulsoy<gunan@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update gemmlowp hash as the commit history seems to have changed in the
repository.
PiperOrigin-RevId: 168343607
---
Commit 1e96d54d9 authored by gunan<gunan@google.com>
Committed by GitHub<noreply@github.com>:
Also accept non-k8 CPU types in build pip package. (#12975)
* Also accept non-k8 CPU types in build pip package.
Fixes#12735
* Make the script work with `set -e`.
---
Commit c0a4c7ffc authored by Chris Leary<leary@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Fix bug in ShapeUtil::ShapeIs that would lead to type inference errors.
PiperOrigin-RevId: 168323589
---
Commit 4af9be964 authored by Amy<amy@infosleuth.net>
Committed by drpngx<drpngx@users.noreply.github.com>:
support passing in a source url to the mnist read_data_sets function, to make it easier to use 'fashion mnist' etc. (#12983)
---
Commit 9f848734f authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Tweak layer a bit to be eager friendly.
PiperOrigin-RevId: 168312865
---
Commit 60f15462b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Change conv_input_scale and side_input_scale from attributes to inputs for improved flexibility, in fused_conv2d_bias_activation op.
PiperOrigin-RevId: 168311988
---
Commit 4b4e10f9c authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adds dict support of eval metrics.
PiperOrigin-RevId: 168310444
---
Commit ab7f22de6 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Move FusedConvBiasActivationShape out of common_shape_fns.cc to a lambda inside the op.
PiperOrigin-RevId: 168300911
---
Commit 3a98035fa authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Augment metadata output with source-line info, as before.
PiperOrigin-RevId: 168292527
---
Commit 349188152 authored by Yao Zhang<yaozhang@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Enable fused batch norm, which is 15-20% faster for training and inference.
PiperOrigin-RevId: 168288154
---
Commit 08587d45b authored by Yuefeng Zhou<yuefengz@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Added back persistent memory tracking in queue op. The new tracking logic has avoided the crash in previous implementation: the queue_ passed to CreateTypedQueue may be unreffed if the resource is already created by another resource op that shares the same resource name and type.
PiperOrigin-RevId: 168284509
---
Commit 733063d55 authored by Amit Patankar<amitpatankar@google.com>
Committed by Amit Patankar<amitpatankar@google.com>:
Fixing awkward wording.
---
Commit c7ad6bfef authored by Amit Patankar<amitpatankar@google.com>
Committed by Amit Patankar<amitpatankar@google.com>:
Removing accidental hash.
---
Commit 53dbc761a authored by Amit Patankar<amitpatankar@google.com>
Committed by Amit Patankar<amitpatankar@google.com>:
Adding Windows self check script to docs.
---
Commit ed1135994 authored by Andrew Harp<andrewharp@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add -latomic flag to benchmark_model target to fix Android x86 build.
PiperOrigin-RevId: 168281337
---
Commit c0348bb55 authored by Anna R<annarev@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update tf_export.py to take constant name as an argument instead of a constant.
PiperOrigin-RevId: 168280613
---
Commit c3d19e40a authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Cleanup training_ops to reduce code redudancy.
PiperOrigin-RevId: 168280069
---
Commit 123fb01ee authored by Yao Zhang<yaozhang@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Set fused=False for batch norm, because the test assumes no bessel's
correction. Fused=True would add bessel's correction to variance.
PiperOrigin-RevId: 168274392
---
Commit f0e8c545e authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Switch resource variables from copy-on-read to copy-on-write.
RELNOTES: Change the signature of (C++) GetInputTensorFromVariable in
training_op_helpers to support new copy-on-write semenatics of resource
variables.
PiperOrigin-RevId: 168273249
---
Commit 495cc8e47 authored by Yuan (Terry) Tang<terrytangyuan@users.noreply.github.com>
Committed by drpngx<drpngx@users.noreply.github.com>:
Minor wording change in timeseries module's README (#12938)
* Minor wording change in timeseries module's README
* Address comments
---
Commit f13b876ed authored by Amit Patankar<amitpatankar@google.com>
Committed by Amit Patankar<amitpatankar@google.com>:
Making the default build from source version 1.4.0dev. The whl files that are built will be 1.3.0devDDMMYYYY.
---
Commit 2356c0ff4 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Delete ScopedTFStatus to avoid leaking it for long running trainers(1+day).
PiperOrigin-RevId: 168259652
---
Commit e15f4cae2 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Don't remove all aliases from linalg namespace.
Get rid of redundant aliases.
PiperOrigin-RevId: 168257658
---
Commit c58082642 authored by postBG<profile2697@gmail.com>
Committed by drpngx<drpngx@users.noreply.github.com>:
Fix minor typo in Programmers guide (#12965)
* Fix minor typo in Programmers guide
* change to "this"
---
Commit 509372c2e authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add a lot of operations' flops calculations
PiperOrigin-RevId: 168256746
---
Commit 80ed8afc0 authored by Francois Chollet<fchollet@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add Flatten to core layers.
PiperOrigin-RevId: 168254118
---
Commit a6223c01a authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix locking of variables in SparseProximalGradientDescent,
AdagradDA, SparseAdagradDA.
PiperOrigin-RevId: 168252530
---
Commit abde00830 authored by Olivia Nordquist<nolivia@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
adding InputTensor class for symmetry with OutputTensor
PiperOrigin-RevId: 168250085
---
Commit 0451032ca authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Fix variable naming style guide violation.
PiperOrigin-RevId: 168245542
---
Commit a202a5a94 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update ops-related pbtxt files.
PiperOrigin-RevId: 168245371
---
Commit f93e354cb authored by Derek Murray<mrry@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[tf.contrib.data] Switch backend Dataset representation to DT_VARIANT.
This change introduces a new `DatasetWrapper` type that wraps a
`DatasetBase*` and can be stored in a DT_VARIANT tensor. All Dataset
ops now consume and produce DT_VARIANT instead of DT_RESOURCE, and the
underlying implementation is simplified because the `DatasetWrapper`
can be passed directly by value without using the `ResourceMgr`.
PiperOrigin-RevId: 168240571
---
Commit a4042cd2a authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Introduces the placeholder for _TrainingExecutor, which serves the implementation of tf.estimator.train_and_evaluate.
PiperOrigin-RevId: 168240151
---
Commit 10ba148f7 authored by Peter Hawkins<phawkins@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Switch control_flow_ops library to use Resource variants of Stack operators, instead of deprecated Ref variants.
PiperOrigin-RevId: 168234822
---
Commit ca43fe82b authored by Ali Yahya<alive@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
TFE: Improves the interfaces of tape.watch_variable() and implicit_grad().
tape.watch_variable() replaces tape.watch() and now is called on ResourceVariable objects instead of their underlying handles.
implicit_grad() now returns a list of (gradient, variable) pairs to be consistent with tf.Optimizer's interface.
PiperOrigin-RevId: 168232055
---
Commit b72862dfc authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
internal change
PiperOrigin-RevId: 168225993
---
Commit da3280f4d authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Re-enable tsan for sdca_estimator_test.
PiperOrigin-RevId: 168186374
---
Commit c936c1155 authored by Yifei Feng<yifeif@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix pip tests for contrib/gan.
- Add *_impl.py so tests can still access removed symbols.
- Add /python directory layer to make *_impy.py and __init__.py not in the same dir.
PiperOrigin-RevId: 168161722
---
Commit ce9a2b00f authored by Toby Boyd<tobyboyd@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Performance guide update
PiperOrigin-RevId: 168159289
---
Commit 3bce4f9a0 authored by Shanqing Cai<cais@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
TFE: expose tfe.num_gpus()
PiperOrigin-RevId: 168154345
---
Commit 67a7cbc28 authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Changed the default eval throttle secs from 2 min to 10 mins.
PiperOrigin-RevId: 168120323
---
Commit 92bed178f authored by Eugene Brevdo<ebrevdo@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Reduce cmake log mess.
* Echo off for the .bat scripts.
* TF cmake: disable warnings in some of the patched projects (gif,jpeg,lmdb).
PiperOrigin-RevId: 168119914
---
Commit 702d59582 authored by joshkyh<joshkyh@users.noreply.github.com>
Committed by Yifei Feng<fengyifei2026@gmail.com>:
Corrected hyperlink for audio training tutorial (#12923)
---
Commit 877c9deca authored by Frank Chen<frankchn@gmail.com>
Committed by Yifei Feng<fengyifei2026@gmail.com>:
Reverse change eb75ded6 so that internal tests will pass. (#12933)
As support for int64 global steps is not ready in TPUs, I am reversing this change so that our internal performance and regression tests will pass.
---
Commit 665966438 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Re-enable grpc_session_test.
PiperOrigin-RevId: 168078694
---
Commit 405def792 authored by Chris Leary<leary@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Switch CallInliner to use CallGraph::VisitNodes.
PiperOrigin-RevId: 168078645
---
Commit aba3466f1 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Exposes Head and factory methods in tf.contrib.estimator.
PiperOrigin-RevId: 168071246
---
Commit b76565b39 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Some profiler fixes and cleanup.
PiperOrigin-RevId: 168069346
---
Commit 32ffc5a81 authored by Jonas<sauercrowd@users.noreply.github.com>
Committed by Yifei Feng<fengyifei2026@gmail.com>:
Just a dot in order to be consistent (#12919)
added a dot to the `7` to make clear it's a float (like every other number)
---
Commit 0753b0c79 authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Scope the scalar cache in the context.
PiperOrigin-RevId: 168065417
---
Commit 48deb206b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Migrate TFGAN features to third_party.
PiperOrigin-RevId: 168060880
---
Commit d2ae1311f authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fixing an issue in the BUILD file of the LSH ops.
PiperOrigin-RevId: 168056645
---
Commit 2f440eda4 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Expose NumpyReader for reading timeseries data.
PiperOrigin-RevId: 168055838
---
Commit be1916ce7 authored by Daniel Grazian<dgr@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Added functionality to allow `SqlDataset` to interpret a database column as various numeric types, including several integer types and `dtypes.float64`.
PiperOrigin-RevId: 168055827
---
Commit fa2000a0b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Supporting nightly windows pip packages.
PiperOrigin-RevId: 168054959
---
Commit a263ea626 authored by Asim Shankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
eager: Treat eager tensors as constants during graph construction.
Unless capturing is explicitly enabled.
PiperOrigin-RevId: 168052675
---
Commit 6e402d0d2 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Make TODO a bit more specific.
PiperOrigin-RevId: 168051381
---
Commit c779384bc authored by Daniel Grazian<dgr@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Added code example to the doc string for `SqlDataset`.
PiperOrigin-RevId: 168049037
---
Commit ff6dd474a authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Use self._in_graph_mode consistently in ResourceVariable
instead of sometimes getting it from the context.
Also: fix formatting of a comment and use a more precise test to detect
if initial_value is set.
PiperOrigin-RevId: 168047258
---
Commit f331f528b authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Removes "fast paths" which are not fast in eager mode.
PiperOrigin-RevId: 168046278
---
Commit 86f1713e5 authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Introduces TrainSpec and EvalSpec.
PiperOrigin-RevId: 168040435
---
Commit c8b9e92f0 authored by Asim Shankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
eager: Move "register_function" to context.py
This will allow function registration from other
modules without having to import "function.py".
(And besides, the function really does belong on the context).
PiperOrigin-RevId: 168040411
---
Commit 74137f994 authored by Shanqing Cai<cais@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix signed int overflow issue in tensor_id.cc
When a node name has a long numeric suffix, e.g.,
"foo/y_0/gradient_debug_09684b60f2184c67b744721915034528" (as has happened with tfdbg GradientsDebugger),
the parsing algorithm in ParseTensorName() may experience signed int overflow. Replacing the types with "unsigned int" resolves the issue.
PiperOrigin-RevId: 168039195
---
Commit 450c3b562 authored by Rohan Jain<rohanj@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Using rendezvous manager to pass args / rets between devices during function remote execution. This enables CPU->GPU remote device executions now.
PiperOrigin-RevId: 168038285
---
Commit 82cc6529f authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fixes the wording about StopIteration.
PiperOrigin-RevId: 168034451
---
Commit fb5588002 authored by Gunhan Gulsoy<gunan@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add a statement on install/index.md on what os are supported.
PiperOrigin-RevId: 168032996
---
Commit f83f6b9ef authored by Chris Leary<leary@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Handle higher-order HLOs (e.g. While) in CallInliner and test.
PiperOrigin-RevId: 168029345
---
Commit 8988ae365 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
BEGIN_PUBLIC
Automated g4 rollback of changelist 167916124
PiperOrigin-RevId: 168916710
The motivation for this script is to provide better tools for
diagnosing load-time errors (such as the ones that plague the Windows
build due to DLL issues). Note that the script is intended to be
self-contained, so that it is possible to import it without loading
the entire TensorFlow runtime.
This generated script currently contains a single symbol,
`is_cuda_build`, which records whether the build has GPU support or not.
PiperOrigin-RevId: 168471034
This avoids the issue of wrapping ops registered in transitive dependencies
(which can at times include the entirety of TensorFlow's default ops).
PiperOrigin-RevId: 165350775
END_PUBLIC
---
Commit 9f81374c3 authored by raymondxyang<zihao.yang@microsoft.com>
Committed by Rasmus Munk Larsen<rmlarsen@google.com>:
Add option for build more python tests in Cmake (#11853)
* Ignore Windows built project
* Fix deprecated methods in tf.contrib.python
* Fix regex match for Windows build in contrib.keras
* Fix Regex match for Windows build in session_bundle
* * Fix deprecated methods
* Fix regex match for Windows
* Fix compatibility issue with Python 3.x
* Add missing ops into Windows build for test
* Enabled more testcases for Windows build
* Clean code and fix typo
* Add conditional cmake mode for enabling more unit testcase
* Add Cmake mode for major Contrib packages
* Add supplementary info in RAEDME for new cmake option
* * Update tf_tests after testing with TF 1.3
* Clean code and resolve conflicts
* Fix unsafe regex matches and format code
* Update exclude list after testing with latest master branch
* Fix missing module
---
Commit 98f0e1efe authored by Yong Tang<yong.tang.github@outlook.com>
Committed by Rasmus Munk Larsen<rmlarsen@google.com>:
Dynamic ksize and strides with MaxPool (#11875)
* Dynamic ksize with max_pool
This fix tries to fix the issue raised in 4746 where ksize
is static (attr) with max_pool.
This fix changes ksize to input tensor so that it is dynamic now.
This fix fixes 4746.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add dynamic ksize to MaxPoolGrad and MaxPoolGradGrad
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add test cases for max_pool_v2
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Fix GPU Jenkins issue.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Enable MaxPoolV2 in GPU
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Hide MaxPoolV2 and other fixes.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
---
Commit 02d6bc185 authored by Bairen Yi<byronyi@users.noreply.github.com>
Committed by Rasmus Munk Larsen<rmlarsen@google.com>:
remove useless variable (#12212)
---
Commit ed6b0d905 authored by namrata-ibm<bhavenamrata@gmail.com>
Committed by Rasmus Munk Larsen<rmlarsen@google.com>:
Adding support for s390x in calculation of cpu_frequency (#12201)
---
Commit 627dfc9dd authored by Taehoon Lee<taehoonlee@snu.ac.kr>
Committed by Taehoon Lee<taehoonlee@snu.ac.kr>:
Fix typos
---
Commit c0f9b0a91 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
In fast-math mode emit a tanh that has a faster min/max.
PiperOrigin-RevId: 164943597
---
Commit 87605f3d6 authored by Kay Zhu<kayzhu@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[TF:XLA] Use HloEvaluator for ComputeConstant, remove the need of a dedicated
compute constant backend.
PiperOrigin-RevId: 164940970
---
Commit 881de45c2 authored by Taehoon Lee<me@taehoonlee.com>
Committed by Rasmus Munk Larsen<rmlarsen@google.com>:
Add bool type supports for GPU kernels (#11927)
* Add bool type supports for GPU kernels
* Add bool type test codes for GPU kernels
---
Commit eeacdcdb1 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add missing "CPU" suffix in registrations.
PiperOrigin-RevId: 164939527
---
Commit de01be952 authored by namrata-ibm<bhavenamrata@gmail.com>
Committed by Rasmus Munk Larsen<rmlarsen@google.com>:
Adding support for Big Endian in graph_constructor_test and wav_io (#12179)
---
Commit 26719d29f authored by QingYing Chen<pkudysj@126.com>
Committed by Rasmus Munk Larsen<rmlarsen@google.com>:
Implement CRF decode (Viterbi decode) for tensor (#12056)
* Implement CRF decoding for tensors
* add test code for tensor version's CRF decoding
* made modifications according to pylint
* add some comments for crf decode
* remove useless code
* add comments at the top comment of crf module and add more comments in crf_test
* capitalize first char of first word in comments
* replace crf_decode test code with a deterministic example
---
Commit f9a81ca2f authored by Pete Warden<pete@petewarden.com>
Committed by gunan<gunan@google.com>:
Create CI build script for Raspberry Pi (#12190)
* Create CI build script for Raspberry Pi
* Moved location of Pi build script
---
Commit e2a163a90 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Merge code from PR #11940 with internal changes from cl/164796436, and update Python tests to also run on GPU.
PiperOrigin-RevId: 164929133
---
Commit 08bbfa187 authored by Taehoon Lee<me@taehoonlee.com>
Committed by Rasmus Munk Larsen<rmlarsen@google.com>:
Fix typos (#12195)
---
Commit ab96f41fb authored by Luke Iwanski<luke@codeplay.com>
Committed by Rasmus Munk Larsen<rmlarsen@google.com>:
[OpenCL] Extends matmul_benchmark.py to cover SYCL (#11697)
* [OpenCL] Extends matmul_benchmark.py to cover SYCL
* Fixed typo
* /gpu:0 -> /device:GPU:0
* Fixes control_flow_ops_py_test
* /gpu: -> /device:GPU:
* Fixes //tensorflow/python/profiler/internal:run_metadata_test
* gpu: -> GPU:
* Fixes tfprof_node
* [OpenCL] Fixes device path to name with many colons (#123)
The device path is constructed from a device name by replacing all
colons with underscores. Some device names contain more than one colon,
for example 'device:SYCL:0' which gives a path 'device_SYCL_0'. The
previous code would not convert this back to the original device name,
but rather to 'device:SYCL_0'.
An alternative fix would be to convert all underscores to colons in the
device name (i.e. remove the restriction inside `replace("_", ":", 1)`),
however I'm not sure if there are any device names which contain
underscores.
* If no gpu device aviable fake one
* gpu: -> device:GPU
* Fixes profiler test
* /gpu:x -> /device:GPU:x
* Fixes debug_io_utils_test.cc test
* Fixes device_name_utils_test.cc
---
Commit 35e7a3665 authored by Yong Tang<yong.tang.github@outlook.com>
Committed by Rasmus Munk Larsen<rmlarsen@google.com>:
Remove unneeded casting of int64 for reverse_sequence (#12192)
This fix remove unneeded cast of int64 for reverse_sequence:
```
lengths = math_ops.to_int64(lengths)
```
as int32 has already been enabled for reverse_sequence.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
---
Commit 9fba8c185 authored by Anna R<annarev@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add benchmark dashboard link to benchmarks doc. Also, I added a link and
description for Benchmarks page to Community index page.
PiperOrigin-RevId: 164924906
---
Commit bb6f32fa7 authored by Mark Heffernan<meheff@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Make HloAliasAnalysis updatable after changes to the HLO graph.
As part of this change make HloAliasAnalysis a thinner layer which
basically only holds a map from HloValue to HloBuffer and vice versa.
PiperOrigin-RevId: 164923041
---
Commit 9103096c1 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by Thomas K?ppe<tkoeppe@google.com>:
Merged commit includes the following changes:
164923041 by meheff:
Make HloAliasAnalysis updatable after changes to the HLO graph.
As part of this change make HloAliasAnalysis a thinner layer which
basically only holds a map from HloValue to HloBuffer and vice versa.
--
PiperOrigin-RevId: 164923041
---
Commit 822603aed authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Merging sibling fusion instruction using multi_output_fusion
PiperOrigin-RevId: 164920220
---
Commit c035aa2a8 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Go: Update generated wrapper functions for TensorFlow ops.
PiperOrigin-RevId: 164917891
---
Commit e1e81d9ba authored by Luke Iwanski<luke@codeplay.com>
Committed by Rasmus Munk Larsen<rmlarsen@google.com>:
[OpenCL] Fixes double memcpy bug (#151) (#12173)
* [OpenCL] Fixes double memcpy bug (#151)
As the debg CopyOp is called on a Tensor without type, we need to use
the DataType enum to get type information, and use this to pass the type
on to Eigen. This is a workaround Eigen's need to have a type when
calling memcpy. If the Eigen memcpy can be provided without a type
requirement, then the memcpy in sycl_util is unnecessary.
* Acts on feedback from: #12173/files/32cb12a9001b672425867b5a3110fd98e737a20b#r132496277
---
Commit d9ca2d86d authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Internal change
PiperOrigin-RevId: 164916465
---
Commit b8d13d218 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove more parts of DCASGD missed in the first pass. (47949b)
PiperOrigin-RevId: 164914552
---
Commit 73b3d52c7 authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
cmake fix
PiperOrigin-RevId: 164911656
---
Commit 2173b5b0a authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Allow TFE_TensorHandleCopyToDevice to have the same device as src and
destination. It will reuse the same underlying buffer in those cases.
PiperOrigin-RevId: 164909906
---
Commit 13eb3b90e authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Experimental C and Python APIs to invoke TensorFlow kernels on concrete values.
PiperOrigin-RevId: 164902588
---
Commit 7dfabcc01 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Initialize ExecutionOptions in ComputeConstant to default values.
PiperOrigin-RevId: 164894867
---
Commit c8897e9bc authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Static required time computation
PiperOrigin-RevId: 164894645
---
Commit 076158f9b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Enable implicit->explicit conversion by default.
PiperOrigin-RevId: 164890915
---
Commit 58c4a4cb1 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Bugfix: number of input channels is not necessarily in the last dimension, after introduction of data_format param.
PiperOrigin-RevId: 164889729
---
Commit 8f9b1af8a authored by Igor Saprykin<isaprykin@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Recover MonitoredSession when the Coordinator is requested to stop with one of the _PREEMPTION_ERRORS.
When SyncReplicasOptimizer is used, a preemption in the Coordinator may result in two cases:
Case 1) the session gets silently marked as complete
Case 2) the session gets stuck
This CL aims to solve and verify solutions for both of these problems. Fix 1 changes the should_stop logic. Fix 2 changes the CoordinatedSession.run() logic.
SyncReplicasOptimizer runs a separate set of threads using a Coordinator instance. Those threads do FIFOQueue.enqueue; the main thread does a blocking FIFOQueue.dequeue.
`sync_token_q` FIFOQueue is on parameter-servers. When one of the PS instances gets preempted, an AbortedError causes the Coordinator to stop via request_stop(ex). That by itself changes the state of MonitoredSession.should_stop() to True (Fix 1).
Results of the blocking Dequeue operation are sent to the chief worker via Recv. What happens next depends on the amount of tokens in `sync_token_q`. If there are enough for the next call to Dequeue to return, then the low-level "tf session run() call" returns. The next iteration of the `while not MonitoredSession.should_stop()` loop decides that the training is complete (Case 1).
If there are not enough tokens in `sync_token_q`, then the blocking Dequeue is going to keep waiting for them. This results in the graph execution getting stuck and the whole session getting garbage collected after 10 minutes (Case 2).
We decided to fix that by re-creating a session after it gets garbage collected (Fix 2). An alternative was to try to cancel the pending Dequeue operation, but it's not clear that it is the right thing to do and it is also not easy.
PiperOrigin-RevId: 164888390
---
Commit 46e4de6e5 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Undo loop fusion changes for now as they seem to be altering a few results.
END_PUBLIC
RELNOTES: n/a
BEGIN_PUBLIC
BEGIN_PUBLIC
Automated g4 rollback of changelist 164825735
PiperOrigin-RevId: 165340331
END_PUBLIC
I dropped the following commit because it doesn't compile.
I will follow up with Andrew to fix it or revert it.
Commit 003deb88b authored by osdamv<osdamv@gmail.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Refactor and implementation of the camera API 1, it fixes#8736 (#10771)
List of commits in this CL:
---
Commit 446450369 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Use identity of param variable in cudnn_rnn.RNNParamsSaveable instead of parameter
variable directly. The RNNParamsSaveable is usually used in a graph which also
has a saver for the cudnn param variable itself, if the same op is used for
both, fails with a two savers for same op error.
PiperOrigin-RevId: 163431826
---
Commit d629a8316 authored by RJ Ryan<rjryan@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Increase bound on tf.contrib.signal.inverse_stft gradient error to avoid flakiness on macOS.
PiperOrigin-RevId: 163426631
---
Commit 253bcbb71 authored by Kay Zhu<kayzhu@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Use HloEvaluator for convolution in reference_util.
Also Speed up HloEvaluator's HandleConvolution in non-opt build, by moving calls
to HloInstruction::shape() out of the inner loop.
PiperOrigin-RevId: 163416183
---
Commit 569a00e68 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update API to traffic in unique_ptrs rather than owning raw pointers
PiperOrigin-RevId: 163414320
---
Commit 31a77bc77 authored by Asim Shankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Java: Update release to 1.3.0-rc1
PiperOrigin-RevId: 163413736
---
Commit 1ebbf4325 authored by Jonathan Hseu<vomjom@vomjom.net>
Committed by GitHub<noreply@github.com>:
Add missing grpc dependency (#11828)
---
Commit 905abb1f9 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Test asserts should have `expected` first.
PiperOrigin-RevId: 163409348
---
Commit d5cc143e2 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Increase timeout to deflake the test.
PiperOrigin-RevId: 163407824
---
Commit ce1c7f02a authored by Eli Bendersky<eliben@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Properly include logging header in xla_internal_test_main
PiperOrigin-RevId: 163405986
---
Commit 22241cd42 authored by joetoth<joetoth@gmail.com>
Committed by Vijay Vasudevan<vrv@google.com>:
External leveldb link changed (#11833)
table_format.txt was renamed to table_format.md
---
Commit 6b7314de4 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Consolidating the code to fill the partition's function library
into one place. Previously, Partition() and MasterSession::RegisterPartition()
both fills in the partitioned graph's function library.
PiperOrigin-RevId: 163400992
---
Commit 28373cfe7 authored by Frank Chen<frankchn@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adds preliminary support for Cloud TPUs with Cluster Resolvers. This aims to allow users to have a better experienec when specifying one or multiple Cloud TPUs for their training jobs by allowing users to use names rather than IP addresses.
PiperOrigin-RevId: 163393443
---
Commit e5353c941 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Don't prune nodes that have reference inputs.
PiperOrigin-RevId: 163390862
---
Commit 226510834 authored by Asim Shankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
C API: Groundwork for experimenting with TF_Tensor in device memory.
TF_Tensor objects are always backed by host memory. This commit lays
the groundwork for allowing TF_Tensor objects to refer to tensor data
on device (e.g., GPU) memory.
PiperOrigin-RevId: 163388079
---
Commit 613bf1c7c authored by Yuefeng Zhou<yuefengz@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
fix asan test failure in SingleMachineTest::ReleaseMemoryAfterDestruction.
PiperOrigin-RevId: 163386941
---
Commit 4653d37a3 authored by Eli Bendersky<eliben@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Change type to appease GPU builds.
PiperOrigin-RevId: 163384927
---
Commit 9f131bd15 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Internal change
PiperOrigin-RevId: 163378484
---
Commit 8bc0236c8 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
PiperOrigin-RevId: 163366493
---
Commit 3b97f1f9b authored by Yangzihao Wang<yangzihao@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Change to only run one round of matmul benchmark.
PiperOrigin-RevId: 163364341
---
Commit a4a3a3335 authored by Yun Peng<pcloudy@google.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Fix ./configure on Windows (#11775)
* Fix ./configure on Windows
* Disable bitwise_ops_test on Windows
---
Commit ae3119d16 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Small changes to op framework.
PiperOrigin-RevId: 163361071
---
Commit f40189d26 authored by qjivy<ji.qiu@spreadtrum.com>
Committed by Vijay Vasudevan<vrv@google.com>:
PR again: Enable building label_image with jpeg/gif/png decoder for Android. (#11475)
* Enable building label_image with jpeg/gif/png decoder for Android.
Add dependency "android_tesnorflow_image_op" to label_image, which
is not overlapped with android_tensorflow_kernels.
* Running buildifier to reformat the BUILD files for
sanity check.
---
Commit 599165861 authored by KB Sriram<kbsriram@gmail.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Add the Constant operator class (#11559)
Create a custom operator class to create constants in the Graph,
and introduce the Operator marker annotation to identify
operator classes.
Please see #7149 for the master tracking issue.
---
Commit 86ca3506f authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Further BUILD cleanup
PiperOrigin-RevId: 163360750
---
Commit 376bb063b authored by Pete Warden<petewarden@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Look inside functions to see which node types are used.
PiperOrigin-RevId: 163360375
---
Commit 2139e7d8b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[tf.contrib.data] map expects a nested structure.
Fixes#11786
PiperOrigin-RevId: 163359134
---
Commit d09304fca authored by Jonathan Hseu<vomjom@vomjom.net>
Committed by Vijay Vasudevan<vrv@google.com>:
Upgrade gRPC (#11768)
* BUILD rule modifications
* More build fixes
* Code changes
* More code fixes
* Working tests
* CMake build
* Fix pprof
* Fix header includes
* CMake fix test
* Bazel clean
* Fix verbs
* More verbs fixes
* bazel clean for XLA
* Windows build fix test
* Add openssl/rand.h
* New cmake build command
* --config Release
---
Commit 3cd828474 authored by David Norman<DavidNorman@users.noreply.github.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Fix error with default python path selection (#11814)
* Fix error with default python path selection
* Move setting of environment var outside if / else
---
Commit ddd8e21b7 authored by Eli Bendersky<eliben@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Consolidate all similar main()s in tests into a single target.
PiperOrigin-RevId: 163354724
---
Commit a36bca25b authored by Tayo Oguntebi<tayo@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove ShapeWithoutPadding() utility function, as it is no longer needed.
PiperOrigin-RevId: 163353430
---
Commit b26f9cd44 authored by David Norman<DavidNorman@users.noreply.github.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Ensure that the multi-instruction fuse can take shared inputs (#11748)
* Ensure that the multi-instruction fuse can take shared inputs
Note that the fuse action only works when the shared input / constant
appears after all of its consumers in the list of instructions.
* Add a comment describing the test
---
Commit 34cbf161d authored by Jiri Simsa<jsimsa@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update Dataset API documentation.
PiperOrigin-RevId: 163349457
---
Commit 2381ce5c3 authored by Abdullah Alrasheed<a.rasheed@tc-sa.com>
Committed by Vijay Vasudevan<vrv@google.com>:
DOC: Fix typo. (#11813)
you could could be I/O bottlenecked.
TO:
you could be I/O bottlenecked.
---
Commit e4a5c5356 authored by Toby Boyd<tobyboyd@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
["Variable", "VariableV2", "VarHandleOp"] is the default for ps_ops=None
PiperOrigin-RevId: 163344629
---
Commit 722f6f361 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix TensorForest's saveable object names so loading a savedmodel works.
PiperOrigin-RevId: 163332598
---
Commit cda80a785 authored by Eric Liu<ioeric@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[tpu profiler] Dump HLO graphs in profile responses to the log directory.
PiperOrigin-RevId: 163318992
---
Commit cea9ef6f5 authored by horance<horance-liu@users.noreply.github.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Refactoring device name utils (#11797)
* remove duplicated code for full_name and legacy_name for DeviceNameUtils
* replace tabs
* Real->Device
---
Commit 1f7c0f917 authored by Kongsea<kongsea@gmail.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Refine docstrings (#11800)
---
Commit dd1f0cddd authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Supports lookup devices by fullname either in the canonical form or the
legacy form. This makes DeviceSet behaves the same as DeviceMgr's
FindDevice method.
PiperOrigin-RevId: 163300346
---
Commit 631a364cd authored by Kay Zhu<kayzhu@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Add Reduce, DynamicSlice and DynamicSliceUpdate to HloEvaluator.
- Reduce is disabled explicitly for constant folding, as not all types of
embedded computation can be currently supported by the evaluator.
- Added support to evaluate HloModule to HloEvaluator.
- Minor signature change to Evaluate().
PiperOrigin-RevId: 163299238
---
Commit a52470172 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Sets the incarnation number even when the attribute is set.
PiperOrigin-RevId: 163299121
---
Commit a49fe0366 authored by Suharsh Sivakumar<suharshs@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove platform bridge for grpc_response_reader.
PiperOrigin-RevId: 163295986
---
Commit 4404aa7cb authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Add TODO comment explaining why the IsScalar check exists.
PiperOrigin-RevId: 163292777
---
Commit 43036ac16 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove unnecessary break statements.
PiperOrigin-RevId: 163291947
---
Commit fd5de4690 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Add regression test for a corner case using Reduce that currently fails with the GPU backend.
PiperOrigin-RevId: 163287986
---
Commit 32e198f2d authored by Chris Leary<leary@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[TF:XLA] Add tf.cross support.
See #11788
PiperOrigin-RevId: 163287731
---
Commit 88abddbc3 authored by Alan Yee<alyee@ucsd.edu>
Committed by Vijay Vasudevan<vrv@google.com>:
Update README.md (#11793)
Remove bad practices of sudo pip and install use safer pip install commands
---
Commit 9b30dc3a8 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove final mentions of `get_shape` in docstring.
PiperOrigin-RevId: 163282839
---
Commit 423c1eea0 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
BREAKING CHANGE: Fix semantic error in how maybe_batch* handles sparse tensors.
PiperOrigin-RevId: 163276613
---
Commit 6028c071b authored by Justin Lebar<jlebar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Highlight incoming/outgoing edges on hover in HLO graphviz dumps, and other improvements.
Other improvements:
- Don't show tooltips for nodes and clusters. Previously we'd show a
tooltip containing a pointer value expressed as decimal. Not so
useful.
- Show tooltips on edges with the to/from node names.
- Fix bug wherein if we had
- a node at the "edge" of the graph (so its operands aren't included
unless they're referenced by another node),
- with all of its operands included in the graph save one or more
constants, and
- those constants weren't referenced by any nodes not at the edge of
the graph,
we would incorrectly draw the node as "grayed out", indicating that
one of its operands (namely, its constant operand) wasn't present in
the graph.
This is wrong because constants are inlined into their users, so they
should always count as "displayed" for the purposes of determining
whether a node is grayed out.
PiperOrigin-RevId: 163276108
---
Commit ce7a355bd authored by Joshua V. Dillon<jvdillon@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update contrib/distributions/estimator_test build dependency.
PiperOrigin-RevId: 163272464
---
Commit 1b8458a1c authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Shorten docstring line.
PiperOrigin-RevId: 163269709
---
Commit 69e323cc6 authored by Asim Shankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix comment ypo
PiperOrigin-RevId: 163266376
---
Commit 08790e73d authored by Chris Leary<leary@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Fix a bug in cloning outfeeds, carried the wrong shape.
PiperOrigin-RevId: 163265592
---
Commit 1bad826d6 authored by Yangzihao Wang<yangzihao@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Rollback of GPU kernel implementation of transpose for tensors with one small dimension.
END_PUBLIC
BEGIN_PUBLIC
BEGIN_PUBLIC
Automated g4 rollback of changelist 162525519
PiperOrigin-RevId: 163490703
END_PUBLIC
---
Commit daa67ad17 authored by Jonathan Hseu<vomjom@vomjom.net>
Committed by Frank Chen<frankchn@gmail.com>:
Remove unittest import (#11596)
---
Commit 491beb74c authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
BEGIN_PUBLIC
Automated g4 rollback of changelist 162423171
PiperOrigin-RevId: 162541442
END_PUBLIC
---
Commit d0f53f77f authored by Penghao Cen<scorpiocph@gmail.com>
Committed by Shanqing Cai<cais@google.com>:
Minor fix typo (#11323)
---
Commit 02fcf564e authored by Chris Song<sjhshy@gmail.com>
Committed by Chris Song<sjhshy@gmail.com>:
Fix misspells.
---
Commit 764c9b6b4 authored by Louis Tiao<ltiao@users.noreply.github.com>
Committed by GitHub<noreply@github.com>:
Fixed typo in docstring
---
Commit f8cd1283e authored by Shanqing Cai<cais@google.com>
Committed by Shanqing Cai<cais@google.com>:
Chaser
---
Commit 01383b946 authored by Shanqing Cai<cais@google.com>
Committed by Shanqing Cai<cais@google.com>:
Adapt TensorFlowTestCase.setUp() to new reset_default_graph() semantics
Avoid calling reset_default_graph() directly to prevent exceptions in
cases where test methods error out from within nested graph contexts,
which can leave _default_graph_stack non-empty in certain Python
versions.
---
Commit 0ffc37890 authored by Amit Patankar<amitpatankar@google.com>
Committed by Amit Patankar<amitpatankar@google.com>:
Removing second declaration of functions.
---
Commit f9c9cacb0 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Refactor ElementalIrEmitter's slice index finding code into
IrArray::Index::SourceIndexOfSlice().
PiperOrigin-RevId: 161140653
---
Commit ba297aec9 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update ops-related pbtxt files.
PiperOrigin-RevId: 161138258
---
Commit 68d666737 authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fixes a reentrant lock issue with tensors using ndarray memory which uses tensor memory.
PiperOrigin-RevId: 161137788
---
Commit a2ee8bca3 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add support for int8 x int8 -> int32 matrix multiplication via cublasGemmEx to stream_executor.
PiperOrigin-RevId: 161137741
---
Commit 755fa7b50 authored by Mark Daoust<markdaoust@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Block generate_test, and docs generating from running in python3.
- Doc generation is currently unsupported in python3
- These both end in errors in python 3.5.1+
PiperOrigin-RevId: 161137467
---
Commit 97cbcac45 authored by Peter Hawkins<phawkins@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[TF:XLA] Fix failure in functionalize_control_flow rewrite for Enter nodes that are unused. Make sure we ignore such nodes without producing an error.
PiperOrigin-RevId: 161136545
---
Commit dabcb60bc authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Add reasonable error messages to Builder::Build for bad parameter numbers.
PiperOrigin-RevId: 161136262
---
Commit 0cbd249e8 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add complex tensors support to `matrix_determinant`.
PiperOrigin-RevId: 161132422
---
Commit 335f1f14d authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Extend static shape inference for SparseTensors with dense_shapes constructed using slicing.
PiperOrigin-RevId: 161132391
---
Commit 53604916e authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fixed the missing labels test in TPUEstimator.
PiperOrigin-RevId: 161131282
---
Commit 9f57dc8dd authored by Bruno Rosa<bruno.rosa@eldorado.org.br>
Committed by Bruno Rosa<bruno.rosa@eldorado.org.br>:
Use mcpu instead of march for ppc64le
march is not support by gcc on ppc64le
---
Commit 7d5c74a9c authored by Skye Wanderman-Milne<skyewm@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Move duplicate detection logic from Graph to FunctionLibraryDefinition
Turns out this is more useful, since there are many function libraries
that don't belong to a graph. This will be used in a future
change. Note that this maintains the current behavior of Graph.
In addition, updates FunctionDefsEqual() to handle unset attr entries
(I ran into this when using this in said future change).
PiperOrigin-RevId: 161126628
---
Commit 2caec3af1 authored by Shanqing Cai<cais@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Disable more timeseries py tests failing in OSS PIP GPU builds
PiperOrigin-RevId: 161124799
---
Commit 0b5cce367 authored by Eugene Brevdo<ebrevdo@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Get TopK op working on GPU again. Extend using cub's radix sort.
1. Undo rollback of Andreas Kirsch's initial implementation.
2. Use cub segmented radix sort if Andreas' heap-based impl
for large k and small num_cols (thresholds of k=100, n=1000
determined empirically).
3. Use cub segmented radix sort if k == num_cols (this case is always faster).
4. Added benchmarks.
Benchmarks show that the GPU implementation is up to 3x slower for small k but
can be 10x faster for large num_cols and k.
Benchmarks:
Benchmark: m_128_n_10_k_5_use_gpu_False wall_time: 0.000166 s Throughput: 0.0077 GB/s
Benchmark: m_128_n_10_k_5_use_gpu_True wall_time: 0.000796 s Throughput: 0.00161 GB/s
Benchmark: m_128_n_10_k_9_use_gpu_False wall_time: 0.00017 s Throughput: 0.00751 GB/s
Benchmark: m_128_n_10_k_9_use_gpu_True wall_time: 0.000796 s Throughput: 0.00161 GB/s
Benchmark: m_128_n_10_k_10_use_gpu_False wall_time: 0.00017 s Throughput: 0.00753 GB/s
Benchmark: m_128_n_10_k_10_use_gpu_True wall_time: 0.000775 s Throughput: 0.00165 GB/s
Benchmark: m_128_n_100_k_1_use_gpu_False wall_time: 0.000155 s Throughput: 0.0826 GB/s
Benchmark: m_128_n_100_k_1_use_gpu_True wall_time: 0.000796 s Throughput: 0.0161 GB/s
Benchmark: m_128_n_100_k_50_use_gpu_False wall_time: 0.000247 s Throughput: 0.0519 GB/s
Benchmark: m_128_n_100_k_50_use_gpu_True wall_time: 0.0008 s Throughput: 0.016 GB/s
Benchmark: m_128_n_100_k_99_use_gpu_False wall_time: 0.000261 s Throughput: 0.049 GB/s
Benchmark: m_128_n_100_k_99_use_gpu_True wall_time: 0.000794 s Throughput: 0.0161 GB/s
Benchmark: m_128_n_100_k_100_use_gpu_False wall_time: 0.000239 s Throughput: 0.0536 GB/s
Benchmark: m_128_n_100_k_100_use_gpu_True wall_time: 0.000777 s Throughput: 0.0165 GB/s
Benchmark: m_128_n_1000_k_1_use_gpu_False wall_time: 0.000324 s Throughput: 0.395 GB/s
Benchmark: m_128_n_1000_k_1_use_gpu_True wall_time: 0.000916 s Throughput: 0.14 GB/s
Benchmark: m_128_n_1000_k_10_use_gpu_False wall_time: 0.00042 s Throughput: 0.305 GB/s
Benchmark: m_128_n_1000_k_10_use_gpu_True wall_time: 0.000902 s Throughput: 0.142 GB/s
Benchmark: m_128_n_1000_k_500_use_gpu_False wall_time: 0.0011 s Throughput: 0.116 GB/s
Benchmark: m_128_n_1000_k_500_use_gpu_True wall_time: 0.00097 s Throughput: 0.132 GB/s
Benchmark: m_128_n_1000_k_990_use_gpu_False wall_time: 0.00133 s Throughput: 0.0962 GB/s
Benchmark: m_128_n_1000_k_990_use_gpu_True wall_time: 0.000993 s Throughput: 0.129 GB/s
Benchmark: m_128_n_1000_k_1000_use_gpu_False wall_time: 0.00102 s Throughput: 0.126 GB/s
Benchmark: m_128_n_1000_k_1000_use_gpu_True wall_time: 0.000964 s Throughput: 0.133 GB/s
Benchmark: m_128_n_10000_k_10_use_gpu_False wall_time: 0.002 s Throughput: 0.64 GB/s
Benchmark: m_128_n_10000_k_10_use_gpu_True wall_time: 0.00288 s Throughput: 0.445 GB/s
Benchmark: m_128_n_10000_k_100_use_gpu_False wall_time: 0.00233 s Throughput: 0.549 GB/s
Benchmark: m_128_n_10000_k_100_use_gpu_True wall_time: 0.00325 s Throughput: 0.394 GB/s
Benchmark: m_128_n_10000_k_5000_use_gpu_False wall_time: 0.0127 s Throughput: 0.101 GB/s
Benchmark: m_128_n_10000_k_5000_use_gpu_True wall_time: 0.00381 s Throughput: 0.336 GB/s
Benchmark: m_128_n_10000_k_9900_use_gpu_False wall_time: 0.015 s Throughput: 0.0853 GB/s
Benchmark: m_128_n_10000_k_9900_use_gpu_True wall_time: 0.00438 s Throughput: 0.292 GB/s
Benchmark: m_128_n_10000_k_10000_use_gpu_False wall_time: 0.0104 s Throughput: 0.123 GB/s
Benchmark: m_128_n_10000_k_10000_use_gpu_True wall_time: 0.00427 s Throughput: 0.3 GB/s
Benchmark: m_128_n_100000_k_100_use_gpu_False wall_time: 0.0148 s Throughput: 0.865 GB/s
Benchmark: m_128_n_100000_k_100_use_gpu_True wall_time: 0.0262 s Throughput: 0.488 GB/s
Benchmark: m_128_n_100000_k_1000_use_gpu_False wall_time: 0.0201 s Throughput: 0.636 GB/s
Benchmark: m_128_n_100000_k_1000_use_gpu_True wall_time: 0.0263 s Throughput: 0.486 GB/s
Benchmark: m_128_n_100000_k_50000_use_gpu_False wall_time: 0.214 s Throughput: 0.0599 GB/s
Benchmark: m_128_n_100000_k_50000_use_gpu_True wall_time: 0.0322 s Throughput: 0.398 GB/s
Benchmark: m_128_n_100000_k_99000_use_gpu_False wall_time: 0.262 s Throughput: 0.0489 GB/s
Benchmark: m_128_n_100000_k_99000_use_gpu_True wall_time: 0.0377 s Throughput: 0.34 GB/s
Benchmark: m_128_n_100000_k_100000_use_gpu_False wall_time: 0.118 s Throughput: 0.108 GB/s
Benchmark: m_128_n_100000_k_100000_use_gpu_True wall_time: 0.0365 s Throughput: 0.351 GB/s
END_PUBLIC
BEGIN_PUBLIC
BEGIN_PUBLIC
Automated g4 rollback of changelist 157169178
PiperOrigin-RevId: 161476569
END_PUBLIC
Note: this CL will break builds. cl/159887762 to follow to fix all the breakages.
---
Commit 2336cdf7f authored by Maxwell Paul Brickner<mbrickn@users.noreply.github.com>
Committed by gunan<gunan@google.com>:
Updated link to use HTTPS (#10998)
Howdy!
I just updated a link to use https instead of http.
Thanks!
---
Commit ad0892df1 authored by Luke Iwanski<luke@codeplay.com>
Committed by Luke Iwanski<luke@codeplay.com>:
[OpenCL] Fixes run_metadata_test for SYCL
This test is designed to test CUDA specific behavior
---
Commit 6b37a0725 authored by Todd Wang<toddwang@gmail.com>
Committed by GitHub<noreply@github.com>:
Update comments
---
Commit 1699d904a authored by John Lawson<john@codeplay.com>
Committed by Luke Iwanski<luke@codeplay.com>:
[OpenCL] Fixes CUDA specific test run on SYCL (#56)
The testBadParentValuesOnGPU should only be run on CUDA devices, as the
test checks for particular CUDA behaviour. We don't actually provide a
SYCL kernel for GatherTree and so it's not a problem that the tests
don't target SYCL.
---
Commit 3c1946230 authored by myPrecious<Moriadry@users.noreply.github.com>
Committed by Shanqing Cai<cais@google.com>:
Java API to get the size of specified input list of operations. (#10865)
* Java API to get the size of specified input list of operations
* remove unnecessary explain to avoid bring a new term to users.
---
Commit e911c7480 authored by Luke Iwanski<luke@codeplay.com>
Committed by Luke Iwanski<luke@codeplay.com>:
[OpenCL] REGISTER -> REGISTER6
---
Commit fbf6c4cec authored by superryanguo<superryanguo@gmail.com>
Committed by superryanguo<superryanguo@gmail.com>:
Simplify the Quickstart section with the weblink is better
---
Commit 72e2918cc authored by Taehoon Lee<taehoonlee@snu.ac.kr>
Committed by Taehoon Lee<taehoonlee@snu.ac.kr>:
Fix typos
---
Commit 90c4406b7 authored by Rishabh Patel<patelrishabh@users.noreply.github.com>
Committed by GitHub<noreply@github.com>:
Correct the learning rate as per the code snippet
---
Commit 03da61134 authored by Todd Wang<toddwang@gmail.com>
Committed by GitHub<noreply@github.com>:
Update ir_array.cc
---
Commit 2df6cd3ac authored by Todd Wang<toddwang@gmail.com>
Committed by GitHub<noreply@github.com>:
Another try
---
Commit af0cbace1 authored by Luke Iwanski<luke@codeplay.com>
Committed by Benoit Steiner<benoitsteiner@users.noreply.github.com>:
[OpenCL] Transpose to go through Eigen (#10321)
---
Commit fc7361081 authored by Luke Iwanski<luke@codeplay.com>
Committed by Benoit Steiner<benoitsteiner@users.noreply.github.com>:
[OpenCL] Registers RGBToHSV and HSVToRGB (#91) (#10848)
* [OpenCL] Added RGBToHSV and HSVToRGB
* Aligning '\'
---
Commit 832894ef8 authored by Luke Iwanski<luke@codeplay.com>
Committed by Benoit Steiner<benoitsteiner@users.noreply.github.com>:
[OpenCL] Registers AdjustContrastv2 (#10949)
* [OpenCL] Registers AdjustContrastv2 (#93)
* [OpenCL] Extended adjust_contrast_op_benchmark_test for OpenCL (#96)
* [OpenCL] Extended adjust_contrast_op_benchmark_test for OpenCL
* simplified to #ifndef
* Changed to "#if GOOGLE_CUDA"
* Update adjust_contrast_op_benchmark_test.cc
* Added comments
---
Commit cb4c2f8d1 authored by Yifei Feng<yifeif@google.com>
Committed by Yifei Feng<yifeif@google.com>:
Make TransferBufferToInFeed not virual so it compiles.
---
Commit e89f04d80 authored by Yifei Feng<yifeif@google.com>
Committed by Yifei Feng<yifeif@google.com>:
Fix calling Literal member functions.
---
Commit 15a8df724 authored by Yifei Feng<yifeif@google.com>
Committed by Yifei Feng<yifeif@google.com>:
Fix mac build
clone from meheff's change:
[XLA] Change return type of DeviceAssignment::Deserialize to fix build
breakage on mac.
The mac build had the following error:
error: incomplete type 'xla::DeviceAssignment' used in type trait
expression
This was due to a static method returning a StatusOr<DeviceAssignment>
inside of the definition of DeviceAssignment.
---
Commit a54d43fa4 authored by Yifei Feng<yifeif@google.com>
Committed by Yifei Feng<yifeif@google.com>:
Replace LiteralUtil to Literal in compiler/plugin/executor
---
Commit 88a6bb80c authored by Guenther Schmuelling<guschmue@microsoft.com>
Committed by Guenther Schmuelling<guschmue@microsoft.com>:
expand inline for debug builds to limit number of symbols
---
Commit 62fb49d31 authored by Yifei Feng<yifeif@google.com>
Committed by Yifei Feng<yifeif@google.com>:
Fix visibility error for contrib/remote_fused_graph/pylib/BUILD.
---
Commit 4c75252f2 authored by Mark Neumann<markn@allenai.org>
Committed by Mark Neumann<markn@allenai.org>:
fix initial test values to avoid numerical instability
---
Commit b58d98353 authored by sj6077<epik03sj@gmail.com>
Committed by Benoit Steiner<benoitsteiner@users.noreply.github.com>:
Fixes of AutoParallel bug (#10368)
* Fix the bug that auto_parallel could replicate variable snapshot name
* Use NodeName in grappler:utils instead of substr, convert variables->variable_def of grappler item
* remove variable_def from grappler item, exclude snapshot nodes from dont_replicate_nodes in auto_parallel
---
Commit a286b7db8 authored by Yifei Feng<yifeif@google.com>
Committed by Yifei Feng<yifeif@google.com>:
Make debug_test slice integer.
---
Commit 97fcfdfa6 authored by Toby Boyd<tobyboyd@google.com>
Committed by GitHub<noreply@github.com>:
Fixed path to seq2seq.py and minor formatting
---
Commit 63c1befb8 authored by Anish Shah<shah.anish07@gmail.com>
Committed by Anish Shah<shah.anish07@gmail.com>:
Improve docs for tf.nn.depthwise_conv2d_native
---
Commit 8d42202b2 authored by Yong Tang<yong.tang.github@outlook.com>
Committed by Yong Tang<yong.tang.github@outlook.com>:
Fix mismatched delete in mkl_tfconv_op.cc
This fix fixes mismatched new[]-delete in mkl_tfconv_op.cc
(the file went through clang-format so there are some additional
changes)
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
---
Commit 26301bd55 authored by Danny Goodman<goodman.danny@gmail.com>
Committed by Danny Goodman<goodman.danny@gmail.com>:
fix error format
---
Commit b3f33ad46 authored by Yao Zhang<yaozhang@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Make changes to prepare for the fused option of batch norm to be set to None (None means using fused batch norm if possible).
PiperOrigin-RevId: 159649743
---
Commit a4a469832 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Add tests for select ops and while loops that produce tuples that contain predicates.
PiperOrigin-RevId: 159645900
---
Commit 980d3f2be authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Use C API to implement Operation.name property
This name property is used in many existing tests including those that
already run with C API enabled (math_ops_test, framework_ops_test,
session_test, session_partial_run_test, math_ops_test_gpu, etc).
PiperOrigin-RevId: 159645767
---
Commit 26239c706 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Previously we didn't have an implementation of BatchNormInference and BatchNormTraining, which gives a linker error if anyone ever tries to call that. A dummy implementation is friendlier than a linker error.
PiperOrigin-RevId: 159645612
---
Commit f671c5caa authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
BEGIN_PUBLIC
Automated g4 rollback of changelist 159570549
PiperOrigin-RevId: 160182040
END_PUBLIC
---
Commit f0e185d1f authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Better handle nodes with a variable number of outputs
PiperOrigin-RevId: 158435028
---
Commit bc3e20807 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove unused BUILD dependencies
PiperOrigin-RevId: 158431059
---
Commit a0c80e4d5 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Delete unnecessary (mistakenly duplicated) logging message.
PiperOrigin-RevId: 158428506
---
Commit b6ad1d747 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adds DNN-only tests for DNNLinearCombinedClassifier.
PiperOrigin-RevId: 158423119
---
Commit ddbb58034 authored by Shanqing Cai<cais@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove unnecessary pylint disable
PiperOrigin-RevId: 158416140
---
Commit fcaa724e2 authored by Luke Iwanski<luke@codeplay.com>
Committed by gunan<gunan@google.com>:
[OpenCL] Cleans pack and unpack ops (#10336)
* [OpenCL] Cleans pack op
* [OpenCL] Cleans unpack op
---
Commit 2f53cacb2 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix a test failure of quantization_utils_test on ASAN
PiperOrigin-RevId: 158414538
---
Commit 50b2f951c authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update ops-related pbtxt files.
PiperOrigin-RevId: 158413455
---
Commit 1e90b78e9 authored by Brennan Saeta<saeta@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add CacheDataset ops.
Some input pipelines may pull down data from remote webservers or perform
expensive processing. In order to avoid extraneous work, we now support
caching the dataset (e.g. on disk).
PiperOrigin-RevId: 158411901
---
Commit e16cd2ede authored by Taehoon Lee<taehoonlee@snu.ac.kr>
Committed by gunan<gunan@google.com>:
Fix typos (#10533)
---
Commit 50d80ddf9 authored by Jonathan Hseu<jhseu@google.com>
Committed by Jonathan Hseu<jhseu@google.com>:
Fix fft_ops_test.py for CPU
---
Commit d35cbbb44 authored by Mustafa Ispir<ispir@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add weight-column support to the heads.
PiperOrigin-RevId: 158409180
---
Commit 7fb52cd54 authored by Justin Lebar<jlebar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Don't crash when displaying XLA metrics if they happen to be negative.
PiperOrigin-RevId: 158407664
---
Commit 12a7a752a authored by Jianfei Wang<me@thinxer.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
Add a tip for tf.train.LoggingTensorHook (#10237)
`INFO` logs are not printed by default unless in IPython. Add a friendly tip for newcomers.
---
Commit 216dcbf1e authored by Luke Iwanski<luke@codeplay.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
[OpenCL] Cleans reduction ops (#10340)
* [OpenCL] Cleans reduction_ops_max.cc
* [OpenCL] Cleans reduction_ops_mean.cc
* [OpenCL] Cleans reduction_ops_min.cc
* [OpenCL] Cleans reduction_ops_prod.cc
* [OpenCL] Cleans reduction_ops_sum.cc
---
Commit 2b351062a authored by Androbin<robin.richtsfeld@gmail.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
Improve docs for selective registration headers (#10351)
* Improve docs for selective registration headers
progressing #10299
* Update print_selective_registration_header.py
* Mention both flags
-DSELECTIVE_REGISTRATION and -DSUPPORT_SELECTIVE_REGISTRATION
---
Commit ee919510f authored by Yun Peng<pcloudy@google.com>
Committed by gunan<gunan@google.com>:
Re-enable some python tests in Windows Bazel build (#10526)
---
Commit b0e881457 authored by Androbin<robin.richtsfeld@gmail.com>
Committed by gunan<gunan@google.com>:
[Bash] Declare and assign separately (#10509)
As proposed by static analysis tool:
https://github.com/koalaman/shellcheck/wiki/SC2155
---
Commit 284901b08 authored by Androbin<robin.richtsfeld@gmail.com>
Committed by gunan<gunan@google.com>:
[Bash] Remove unquoting quotes (#10506)
As proposed by static analysis tool:
https://github.com/koalaman/shellcheck/wiki/SC2027
---
Commit 2a1f11556 authored by ksellesk<zhengdachuan200305@gmail.com>
Committed by ksellesk<zhengdachuan200305@gmail.com>:
Fix AttributeError in resnet.py
There is no function tf.softmax() in Tensorflow 1.x.
When running the old code, Python interpreter complains:
File "resnet.py", line 152, in res_net_model
prediction, loss = res_net(x, y)
File "resnet.py", line 148, in res_net
return tf.softmax(logits), loss
AttributeError: 'module' object has no attribute 'softmax'
---
Commit 1d68f729b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove unneeded BUILD dependency
PiperOrigin-RevId: 158391996
---
Commit 08ed32dbb authored by Yun Peng<pcloudy@google.com>
Committed by gunan<gunan@google.com>:
Windows: Make TensorFlow build without --cpu=x64_windows_msvc (#10466)
* Windows: Make TensorFlow build without --cpu=x64_windows_msvc
Since from Bazel 0.5.0, MSVC toolchain became the default toolchain on
Windows. So --cpu=x64_windows_msvc is not required as long as we adjust
the BUILD files in TensorFlow.
--cpu=x64_windows_msvc is also supported for now, but is depracated.
The configuration for cpu value x64_windows_msvc is a duplicate of
x64_windows, which should be removed in the future.
* Fix breakage on macOS
---
Commit 02dbe153a authored by Androbin<robin.richtsfeld@gmail.com>
Committed by gunan<gunan@google.com>:
[Bash] Simplify Conditional (#10503)
---
Commit c07bc581f authored by Androbin<robin.richtsfeld@gmail.com>
Committed by gunan<gunan@google.com>:
[Bash] Prefer read -a to split path (#10508)
As proposed by static analysis tool:
https://github.com/koalaman/shellcheck/wiki/SC2207
---
Commit 0a389674d authored by Androbin<robin.richtsfeld@gmail.com>
Committed by gunan<gunan@google.com>:
[Bash] Prefer [ p ] && [ q ] over [ p -a q ] (#10507)
As proposed by static analysis tool:
https://github.com/koalaman/shellcheck/wiki/SC2166
---
Commit 87a008ec3 authored by Jonathan Hseu<vomjom@vomjom.net>
Committed by gunan<gunan@google.com>:
Delete non-deterministic testEmpty() test (#10512)
---
Commit 3a2971bd8 authored by Frank Chen<frankchn@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adds the base for ClusterResolvers, a new way of communicating with and retrieving cluster information for running distributed TensorFlow.
Implementations of this class would eventually allow users to simply point TensorFlow at a cluster management endpoint, and TensorFlow will automatically retrieve the host names/IPs and port numbers of TensorFlow workers from the cluster management service.
PiperOrigin-RevId: 158358761
---
Commit 28b4e7f04 authored by Jonathan Hseu<vomjom@vomjom.net>
Committed by gunan<gunan@google.com>:
Disable stage_op_test and map_stage_op_test (#10516)
---
Commit 390e57a75 authored by Yan (Asta) Li<yanastali@users.noreply.github.com>
Committed by Benoit Steiner<benoitsteiner@users.noreply.github.com>:
Check EIGEN_MAX_ALIGN_BYTES to prevent mod-by-0 (#10380)
* Check EIGEN_MAX_ALIGN_BYTES to prevent mod-by-0
If EIGEN_MAX_ALIGN_BYTES is set to 0, alignment checks that mod by EIGEN_MAX_ALIGN_BYTES fail at runtime.
* Returns true, as in tensorflow/core/framework/tensor.h
* Update unit tests
* Enable tests only if EIGEN_MAX_ALIGN_BYTES > 0
---
Commit cd5ac40b3 authored by Peter Hawkins<phawkins@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Update LLVM to upstream revision r304927.
Add LLVM build rules for the LLVM AMDGPU backend, commented out by default. Fixes issue #10437.
PiperOrigin-RevId: 158351480
---
Commit 91cb809bd authored by David Norman<DavidNorman@users.noreply.github.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
[XLA] Add ability to run the XLA unit tests against a different device (#9759)
* Add ability to run the XLA unit tests against a different device
* Allow for multiple extra backend devices
* Correct merge error
* Include options for additional tags
---
Commit aff4d124b authored by Yuxin Wu<ppwwyyxxc@gmail.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
Compare base_dtype instead of dtype in piecewise_constant (#10280)
* Compare base_dtype instead of dtype in piecewise_constant
Compare base_dtype instead of dtype in piecewise_constant. Fix#10086
* add unit test
* Small lint fix and comment
---
Commit 845539f98 authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add evaluation test for linear classifier (n==2 or n >2).
PiperOrigin-RevId: 158340296
---
Commit 7c46214ab authored by Jonathan Hseu<vomjom@vomjom.net>
Committed by GitHub<noreply@github.com>:
Fix numpy 1.13 incompatibilities (#10501)
* Fix numpy 1.13 incompatibilities
* Skip tests with numpy 1.13.0
---
Commit 4572c41df authored by gunan<gunan@google.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
A few changes to kernel_tests. (#10502)
* Disable reader_ops_test on windows.
* Run buildifier on kernel_tests/BUILD
* Mark map_stage_op_test as large.
* Set the size of stage_op_test to large
---
Commit 892293d98 authored by Brennan Saeta<saeta@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Set a default for datasets end_of_sequence.
While all datasets carefully set the end_of_sequence to true at the
appropriate time, some datasets might forget to set it to false in the normal
case. In order to avoid potential undefined behavior, we set the
end_of_sequence variable to be false by default.
PiperOrigin-RevId: 158337799
---
Commit 187404eac authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Setup the env to since ops such as MatchFileOp rely on it.
PiperOrigin-RevId: 158336344
---
Commit 2741561c8 authored by Justine Tunney<jart@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix up vz_projector script structure
We now make sure scripts and HTML imports are declared in the correct
places. In the future, pedantically listing script tags should not be
necessary.
PiperOrigin-RevId: 158334306
---
Commit beeaade46 authored by Kay Zhu<kayzhu@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Resubmit a reverted change. Original description:
[XLA] Enable HloEvaluator for constant folding, also merged a few operations
from hlo_constant_folding to hlo_evaluator.
Additionally:
- In ShapeUtil::ForEachIndex:
* fix a bug where visitor is called when the shape has zero elements (e.g., F32{1,0})
* added test case for ForEachIndex.
- In HloEvaluator:
* Instead of copying and caching a Constant instruction, return the literal directly if the instruction is constant.
* Fix an issue where TUPLE and OPAQUE primitives are not keyed in the templated typed_visitor.
* Use (fixed) LiteralUtil::Populate to populate resulting literal, fixes the preexisting bug in the evaluator where R0 and shape with zero size dimensions are not handled.
* Refactor ElementWiseUnaryOp and HandleCompare to be templatized on the operand's type.
* Refactor IsFinite to be top level since it is only applicable to floats and the return type is always boolean.
* Change from std::remainder to std::fmod for kRemainder to be compliant with existing XLA behavior.
* Change from std::max and std::min to std::fmax and std::fmin to handle NaNs.
* Minor comments fix.
PiperOrigin-RevId: 158330052
---
Commit b94540e6f authored by Toby Boyd<tobyboyd@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
tf.layers.conv2d use_bias=True to use nn.bias_add
PiperOrigin-RevId: 158326493
---
Commit 379aa9911 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Go: Update generated wrapper functions for TensorFlow ops.
PiperOrigin-RevId: 158325855
---
Commit 4e529f0f1 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update ops-related pbtxt files.
PiperOrigin-RevId: 158325293
---
Commit 0a9d2dac0 authored by Yuefeng Zhou<yuefengz@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add a util function in virtual placer to return canonicalized device string, which can be used to fix the node's device field before passing them to the maxcut algorithm.
PiperOrigin-RevId: 158322753
---
Commit 2d8da1d9b authored by Daniel Ylitalo<daniel@blodan.se>
Committed by gunan<gunan@google.com>:
Recognize CPU core count in FreeBSD (#10490)
---
Commit c19e6cac0 authored by Peter Hawkins<phawkins@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[TF:XLA] Initial implementation of TensorArray ops.
The XLA implementation of TensorArrays is more restrictive than regular TensorArrays:
* XLA TensorArrays must have dynamic_size=False.
* all elements in an XLA TensorArray must have the same shape.
* writes always add their values to any existing values; neither reads nor writes ever issue errors. Out-of-bounds writes currently wrap.
Refactor Variable handling in the TF/XLA bridge. Use a XlaVariable* to refer to variables inside compilation rather than a numerical ID. Allow for variables that don't correspond to variables known to the user. Also use XlaVariable to handle TensorArrays.
PiperOrigin-RevId: 158322041
---
Commit b5e8d3086 authored by Peter Hawkins<phawkins@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[TF:XLA] Refactor randomized tests to allow testing of larger inputs without running out of memory.
PiperOrigin-RevId: 158321431
---
Commit 5d90bbaac authored by Kay Zhu<kayzhu@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Disable constant_folding in test base, so that intended test code paths
would not be elided by constant_folding pass.
PiperOrigin-RevId: 158317641
---
Commit 036ce8ba6 authored by Luke Iwanski<luke@codeplay.com>
Committed by gunan<gunan@google.com>:
[OpenCL] Cleans dense_update_ops (#10335)
* [OpenCL] Cleans dense_update_ops
* Acts on feedback from: #10335#discussion_r120536460
---
Commit 85f968125 authored by Luke Iwanski<luke@codeplay.com>
Committed by gunan<gunan@google.com>:
[OpenCL] Cleans cast operation (#10330)
* [OpenCL] Removes not needed typedef for SYCLDevice
* [OpenCL] Fixes formatting
* [OpenCL] use SYCLDevice for int32 cast case
---
Commit bff5e72da authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix typo.
PiperOrigin-RevId: 158310742
---
Commit 38249d6be authored by Shanqing Cai<cais@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Swap the order of NanTensorHook and custom hooks
to ensure that when the training encounteres NaN's in the loss function, user-supplied hooks such as tf_debug.LocalCLIDebugHook can still be used to debug the root cause of the numeric issues.
PiperOrigin-RevId: 158310249
---
Commit 599727c65 authored by Eli Bendersky<eliben@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Propagate debug option flags to hlo_test_base.
Specific HLO tests have to replace the generic test_main target with a manual
main() that invokes RUN_ALL_TESTS.
To get access to a module with debug options set up, a new convenience method
is created on HloTestBase.
Initially algebraic_simplifier_test is modified as a canary; in a followup
we'll convert all HLO tests to this approach.
PiperOrigin-RevId: 158309488
---
Commit 0770393e9 authored by Eric Liu<ioeric@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[Tensorboard] Add a trace viewer component to TensorBoard.
We make the trace viewer a separate app; otherwise, there would be dependency
conflicts (e.g. Polymer) between the trace viewer app and the tensorboard app.
The trace viewer app would be served by a plugin, and Tensorboard dashboard will integrate trace viewer app using iframe in the
future.
This CL also added "mominify" support for link import HTML tags in the
tensorboard home-grown java vulnizer; otherwise, the vulcanized trace viewer code
would crash the java vulcanizer.
For open-source build, we add a denpendency on the Catapult github repository
(https://github.com/catapult-project/catapult/tree/master/tracing). We use a bazel genrule to vulcanize a trace viewer binary which is then used in the
tf-trace-viewer component.
PiperOrigin-RevId: 158309408
---
Commit 85e832201 authored by RJ Ryan<rjryan@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Support unknown emit shapes in tf.nn.raw_rnn.
PiperOrigin-RevId: 158308002
---
Commit edb5fed7f authored by Mustafa Ispir<ispir@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add label-vocab support to binary logistic head.
Add assertion that binary classifier label is in range [0., 1.]
Fixed Classifier Integration tests.
PiperOrigin-RevId: 158307521
---
Commit f8e1cf8fa authored by Justine Tunney<jart@google.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
Open up visibility of tf_imports (#10500)
This also fixes the definition of Clutz.
---
Commit 9fd7cf054 authored by Luke Iwanski<luke@codeplay.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
[OpenCL] Cleans relu ops (#10343)
* [OpenCL] register relu ops to gpu types (no half)
* [OpenCL] Removes #undef EIGEN_USE_SYCL
---
Commit 09c1455e3 authored by Luke Iwanski<luke@codeplay.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
[OpenCL] Cleans reverse_op.cc (#10346)
---
Commit b7892a30f authored by orome<royl@aldaron.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
Clarify tf.matmul documentation (#10381)
* Update math_ops.py
* Fix non-ascii character
---
Commit 9786b7062 authored by Luke Iwanski<luke@codeplay.com>
Committed by Benoit Steiner<benoitsteiner@users.noreply.github.com>:
[OpenCL] Cleans StridedSlice Op (#10314)
* [OpenCL] Cleans StridedSlice Op
* [OpenCL] Removes half from registred types
---
Commit f105df047 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
In the CUDA path of depthwise_conv2d, optimize backward filter convolution for images 2 or 4 times smaller than 16x16. Also initialize in_cols from blockDim, to fix the regression caused in CL 157906773.
PiperOrigin-RevId: 158296136
---
Commit 492afc2e3 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Go: Update generated wrapper functions for TensorFlow ops.
PiperOrigin-RevId: 158295169
---
Commit abe0877ef authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add bazel version check to .configure
PiperOrigin-RevId: 158294569
---
Commit b702e7e79 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update ops-related pbtxt files.
PiperOrigin-RevId: 158294289
---
Commit 94085bee7 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Replace std::function object with regular function.
The function is called recursively, and the std::function object had only existed to allow recursion from within a lambda expression. A regular function should be cheaper than a polymorphic function wrapper.
PiperOrigin-RevId: 158292415
---
Commit ba656b261 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Use template specialization instead of overloaded methods. This is a more appropriate tool here. NFC
PiperOrigin-RevId: 158292035
---
Commit 55f987692 authored by Yutaka Leon<yleon@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Make tf.contrib.lookup python functions use the kernels v2 that uses the resource tensor as handler.
PiperOrigin-RevId: 158291836
---
Commit ebae3deba authored by Wei Ho<weiho@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Switch back to max_num_rows_to_load instead of reading slice by slice due to performance regression from network overhead.
Add check when using initializing values to avoid seg fault
PiperOrigin-RevId: 158291218
---
Commit 7b4c01794 authored by RJ Ryan<rjryan@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Support numpy-style padding and slicing of tf.spectral.rfft/irfft to match the desired FFT length.
Fixes incorrect RFFT/IRFFT results when fft_length does not match the input dimension.
PiperOrigin-RevId: 158289991
---
Commit fdb8e2935 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update iOS examples to use CocoaPods, and moved to tensorflow/examples/ios
PiperOrigin-RevId: 158289285
---
Commit d86167b5f authored by Amit Patankar<amitpatankar@google.com>
Committed by Amit Patankar<amitpatankar@google.com>:
Merging rc2 back into master.
---
Commit dffea202a authored by Eli Bendersky<eliben@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Clean up some code after previous CL
PiperOrigin-RevId: 158282834
---
Commit 7b5302af0 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adds ability to set a "family" attribute in Tensorflow summaries, which
controls the "tab name" of the summary that is displayed.
This solution keeps using name_scope to keep names unique, but then prefixes the tag with the family name if provided.
PiperOrigin-RevId: 158278922
---
Commit 611c82b5b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adds integration test for DNNLinearCombined((Classifier)|(Regressor)).
PiperOrigin-RevId: 158278512
---
Commit cc6c91a9a authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove a further unused proto header inclusion
PiperOrigin-RevId: 158278026
---
Commit 9f17c26ca authored by Mark Heffernan<meheff@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Add HloLocation to dataflow analysis.
Add an HloLocation abstraction to dataflow analysis which indicates where (in the output of what instruction and at which index) an HloValue may appear. Previously only uses were stored with an HLO value where a use is an edge in the HLO graph (instruction, operand number and ShapeIndex).
Also, change the handling of tuple-shaped kSelect instructions when ssa_form is true. Previously a phi value would be created. With this change the the value set instead contains the union of it's inputs identical to the ssa_form=false case.
PiperOrigin-RevId: 158276598
---
Commit b9d5e1441 authored by Eli Bendersky<eliben@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Start collecting flags for debug options in a single place.
ClientLibraryTestBase will now parse command-line flags for debug options
automatically, permitting subclasses to override certain options by using
mutable_debug_options.
main() still has to call AppendDebugOptionsFlags() explicitly before running
the TF flag parser. In the mean-time, this CL leaves flag handling to the
current "legacy" approach. However, this is part of a larger plan to move *all*
debugging flags for XLA into the DebugOptions message and expose them as flags
from a single place. The other flags (which are not controlling debugging
options) will have to be propagated more explicitly.
PiperOrigin-RevId: 158276294
---
Commit 3b6fe94bb authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Properly handle shape nodes that have a preexisting control dependency
PiperOrigin-RevId: 158274845
---
Commit 1d67379d5 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Minor cleanup
PiperOrigin-RevId: 158268933
---
Commit 41997756c authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Sort header inclusions; define EIGEN_USE_THREADS where headers depend on it.
PiperOrigin-RevId: 158267803
---
Commit 85355f015 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add missing header inclusion
PiperOrigin-RevId: 158265934
---
Commit 3cf88d390 authored by Gunhan Gulsoy<gunan@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
When GPU is configured, do not require --config=cuda.
Also fix indentation in configure.
PiperOrigin-RevId: 158232959
---
Commit f48673b50 authored by Luke Iwanski<luke@codeplay.com>
Committed by gunan<gunan@google.com>:
[OpenCL] Removes ReductionFunctor for SYCLDevice (#10326)
We are using Eigen implementation
---
Commit 1b6453bec authored by Joan Puigcerver<joapuipe@gmail.com>
Committed by gunan<gunan@google.com>:
Fixes issue #10258 (#10366)
On CUDA versions previous to 8.0, only __shared__ variables could be declared as static in the device code.
---
Commit cd56a638d authored by Beomsu Kim<123bskim@naver.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
Fixed wrong range in docstring (#10272)
---
Commit d13ae380c authored by Micha? Jastrz?bski<michal.jastrzebski@intel.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
Fix CMD in Dockerfile (#10444)
Currently Notebook fails execution because default user for this container is root, and unless explicitly allowed, jupyter notebook will not start.
---
Commit 8118ab4ec authored by Simon Perkins<simon.perkins@gmail.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
Support partial gets in MapStagingArea (#10276)
* Modify map staging area tests
- size from `small` to `medium`
- introduce 2 shards
* Add partial get support in MapStagingArea
A partial list of tensors in a (key, value) map entry can now be
requested. Once all tensors associated with the entry are removed,
it is removed from the map.
* Correct output/indices mismatch errors
* Rename IncompleteTuple to OptionalTuple
* Add partial get test with indices
* Add some more index checks
* Improve stage test case graph creation
Test sessions (and default graphs) are reused by default.
Create explicit, finalized graphs in each test to prevent
possible interactions between stateful Staging Areas and
others ops created in separate tests.
* Make staging area tests small and remove shards
They were originally made 'medium' to ameliorate timeouts in the test
case, but they usually run in ~1s so they should be small.
* Improve imports
Avoid importing base tensorflow package
* Support both python 2 and python 3 range.
* Set map_stage_op_test to size=large
* Convert the tests to size=medium
---
Commit 0df102b0a authored by Androbin<robin.richtsfeld@gmail.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
Update `configure` script sample (#10455)
The `configure` script was changed regularly since the generation of the sample.
This PR updates the sample to reflect those changes.
---
Commit f6dc1ac61 authored by Earthson Lu<Earthson.Lu@gmail.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
MKL_INSTALL_PATH should not be ignore when given (#10180)
* MKL_INSTALL_PATH should not be clear when given
* fix overwrite by default
---
Commit 8ad6a036e authored by Asim Shankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Java: Update Maven release to 1.2.0-rc2
PiperOrigin-RevId: 158212897
---
Commit 15eddf035 authored by Fritz Obermeyer<fritz.obermeyer@gmail.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
Export C API symbols in _pywrap_tensorflow_internal.so (#10469)
* Export C API symbols
* Export C API symbols under config:default
---
Commit 754e12668 authored by Luke Iwanski<luke@codeplay.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
[OpenCL] Removes half concat op registration (#10331)
---
Commit cfdc22dee authored by Peng Yu<yupbank@users.noreply.github.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
fix the error (#10293)
---
Commit 58747e357 authored by Joel Hestness<jthestness@gmail.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
PhiloxRandom: Fix race in GPU fill function (#10298)
* PhiloxRandom: Fix race in GPU fill function
The PhiloxRandom fill kernel for the GPU had race conditions that caused the
outputs to be non-deterministic. In particular, the code previously executed
with N GPU threads (# thread contexts per GPU), but it would only advance the
fill addresses by N-1 stride in each step. This incorrect stride caused the
0th and N-1st threads to write to the same memory locations, racing for which
was last to write their common locations. Make the stride equal to the number
of threads to eliminate the race.
BONUS: By fixing this race, PhiloxRandom constant-sized GPU initializers now
match CPU initializers.
* Update random_ops_test.py to find race conditions
Increasing the size of arrays in the random_ops_test.py test to manifest
the race conditions to be resolved.
---
Commit 2cbcda08f authored by Androbin<robin.richtsfeld@gmail.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
Fixed formatting in Linux install guide (#10353)
Formatting issues were introduced in PR #8825, commit f30918b369
---
Commit ab5f38560 authored by Lakshay Garg<lakshayg@outlook.in>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
Fixed typos in documentation & READMEs (#10365)
---
Commit 94dc1dbfa authored by Christos Nikolaou<cNikolaou@users.noreply.github.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
Enable figures in the tfprof README.md (#10372)
---
Commit 3018d4678 authored by Taehoon Lee<taehoonlee@snu.ac.kr>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
Fix typos (#10386)
---
Commit c5f3c6171 authored by Daniel Rasmussen<drasmuss@users.noreply.github.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
Fix unbatch for Datasets with multiple elements (#10401)
* Fix unbatch for datasets with multiple elements
* fixup! pylint (indent two spaces instead of four)
---
Commit 8b065bc10 authored by Yong Tang<yong.tang.github@outlook.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
Fix unaligned args in api_docs/python/tf/contrib/learn/Evaluable (#10423)
This commit fixes unaligned args in api_docs/python/tf/contrib/learn/Evaluable
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
---
Commit 8f89b654f authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Profile memory usage in VirtualScheduler and report peak memory usage.
To do so, NodeState now handles different output ports of a node (in case
a node has multiple outputs).
Also, VirtualScheduler code is cleaned up with more comments.
PiperOrigin-RevId: 158209068
---
Commit 0ea0bf5aa authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add a frontend for viewing the first ops that exhibit bad values (NaN, +/- Inf).
This helps the user identify problematic ops. Also moved the debugger data logic within tf-graph-info into a new tf-graph-debugger-data-card component.
PiperOrigin-RevId: 158208679
---
Commit ed47ecf2d authored by Luke Iwanski<luke@codeplay.com>
Committed by Benoit Steiner<benoitsteiner@users.noreply.github.com>:
[OpenCL] Cleans variable op (#10333)
* [OpenCL] Cleans variable op
* Fixes formatting and float / double -> GPU_NUMBER_TYPES_NO_HALF
---
Commit 9b2c1af63 authored by Luke Iwanski<luke@codeplay.com>
Committed by Benoit Steiner<benoitsteiner@users.noreply.github.com>:
[OpenCL] Improves device reporting (#10462)
Prints: id, type, name, vendor and profile of the device
---
Commit 7f5384dcc authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Making load() work for resource variables.
PiperOrigin-RevId: 158205361
---
Commit 05412bd36 authored by Mark Heffernan<meheff@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Simplify Shape traversal visitors.
Simplify shape traversal visitors in ShapeUtil and ShapeTree. Add a non-Status form because most uses of the traversal methods do not use it, and remove is_leaf parameter from ShapeTree.ForEach* as it is not frequently used.
PiperOrigin-RevId: 158201574
---
Commit 69c9365b4 authored by Mustafa Ispir<ispir@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Extracted linear estimator testing utils to be reused by dnn-linear-combined.
Added tests for linear part of dnn-linear-combined estimator.
PiperOrigin-RevId: 158200827
---
Commit 65ce8c723 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add arrowheads to dataflow edges.
Make reference edges orange.
Remove animations from tooltips in the graph documentation.
Previously, arrowheads were only added to reference edges (because we assumed users knew about the convention that arrowless edges flow upwards). That decision nicely reduces clutter. However, recently, some internal and external folks have expressed confusion, and so I want to try adding arrowheads to all data flow edges. And make the reference edges starkly different.
See #10428
PiperOrigin-RevId: 158195388
---
Commit bf4c3dd6b authored by gunan<gunan@google.com>
Committed by GitHub<noreply@github.com>:
Revert "Fix patching issue on Windows" (#10472)
This reverts commit 47e6785646.
---
Commit b49515539 authored by David Soergel<soergel@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add only string constants to ASSET_FILEPATHS collection.
PiperOrigin-RevId: 158192152
---
Commit 51acad09c authored by Sergio Guadarrama<sguada@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add tests with different delta to huber_loss.
PiperOrigin-RevId: 158191361
---
Commit a4e7b7add authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fixes a bug in setting default optimizers for DNNLinearCombinedClassifier.
PiperOrigin-RevId: 158190192
---
Commit ddd67e333 authored by Luke Iwanski<luke@codeplay.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
[OpenCL] Cleans reshape.cc (#10347)
* [OpenCL] Cleans reshape.cc
* Removes half and complex numbers.
Half is extension and complex numbers needs implementation in Eigen first
---
Commit 3ca653304 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update ops-related pbtxt files.
PiperOrigin-RevId: 158186454
---
Commit 8cda8660e authored by Luke Iwanski<luke@codeplay.com>
Committed by gunan<gunan@google.com>:
[OpenCL] Cleans sendrecv_ops.cc (#10345)
---
Commit 6915bb919 authored by Luke Iwanski<luke@codeplay.com>
Committed by gunan<gunan@google.com>:
[OpenCL] Cleans Slice op (#10341)
---
Commit 54998b45d authored by Michele Colombo<m-colombo@users.noreply.github.com>
Committed by Jonathan Hseu<vomjom@vomjom.net>:
BasicRNNCell comment fix (#10467)
---
Commit df5906fb7 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Mark saver/restore ops that depend on filesystem as stateful to disable them
from being folded into a constant by graph optimizer.
PiperOrigin-RevId: 158182282
---
Commit 96cb4d182 authored by Sergio Guadarrama<sguada@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add support of scale_l1 == 0. or scale_l2 == 0 to l1_l2_regularizer.
Added tests.
PiperOrigin-RevId: 158179790
---
Commit b65eb3f9b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Speed up atrous_convolution_test by combining evaluations.
To make this test run faster (and prevent it from timing out under
certain circumstances), this change combines all evaluations for each
test method into a single call to Session.run, to eliminate overhead.
This reduces the test time from about 40 seconds to 10 seconds.
RELNOTES: n/a
PiperOrigin-RevId: 158175227
---
Commit b440abce7 authored by Gao, Xiang<qasdfgtyuiop@gmail.com>
Committed by Rasmus Munk Larsen<rmlarsen@google.com>:
add Cuda{2D,3D}LaunchConfig that maximizes occupancy (#10032)
* add Cuda{2D,3D}LaunchConfig that max occupancy
* remove default val, check input<=0
* add max size check
* fix typo
* tests, docs, and related changes
* build the test
* buildify
* cudaOccupancy... call check success, and style fix
---
Commit 81cf61fdb authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Initialize tensor in graph_properties_test, to avoid msan complaint.
PiperOrigin-RevId: 158169374
---
Commit cabc5c35c authored by Eli Bendersky<eliben@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Add xla_disable_hlo_passes to DebugOptions
Also add a SetDebugOptions method to ClientLibraryTestBas; this lets us set
debug options in tests by calling it.
As an example, this CL removes the current way of passing
xla_disable_hlo_passes programmatically in tests - it used to employ a special
constructor parameter which is no longer required.
PiperOrigin-RevId: 158169006
---
Commit 187d23337 authored by Luke Iwanski<luke@codeplay.com>
Committed by gunan<gunan@google.com>:
[OpenCL] Cleans Pad op (#10339)
---
Commit e8bc38ef6 authored by gunan<gunan@google.com>
Committed by GitHub<noreply@github.com>:
Fix test failures on windows. (#10470)
---
Commit 2b3535c64 authored by David Soergel<soergel@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Minor docstring fix for build_parsing_serving_input_receiver_fn
PiperOrigin-RevId: 158163615
---
Commit e55f2e036 authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Propagates constants through switch nodes.
PiperOrigin-RevId: 158163537
---
Commit b01d4b905 authored by Jacques Pienaar<jpienaar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Remove outdated todo.
PiperOrigin-RevId: 158161411
---
Commit 7125733d7 authored by William Chargin<wchargin@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Create a set of sample data for the audio plugin
This implements a simple tone generator, with sine waves, square waves,
and triangle waves, plus two simple combinations of sine waves. The step
value is used to control the frequency.
PiperOrigin-RevId: 158160889
---
Commit dc81a2420 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Updates to the WALSMatrixFactorization estimator:
- Add a completed_sweeps variable to keep track of sweeps that have been completed during training.
- Add a StopAtSweepHook, which can request a stop after completing a specified number of sweeps.
PiperOrigin-RevId: 158156347
---
Commit 74220616c authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Set device cores and frequency in op_level_cost_estimator_test,
to avoid asan error about assigning inf to int64 (this comes
in from a divide-by-0).
PiperOrigin-RevId: 158155488
---
Commit 47e678564 authored by Yun Peng<pcloudy@google.com>
Committed by gunan<gunan@google.com>:
Fix patching issue on Windows (#10452)
---
Commit 6d54f09d9 authored by Yun Peng<pcloudy@google.com>
Committed by gunan<gunan@google.com>:
Fix linking errors of lmdb on Windows (#10457)
---
Commit 61c8a745b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Minor cleanup: Add braces around if statement arms; remove redundant "return" and "static".
PiperOrigin-RevId: 158143418
---
Commit e9a889c5e authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Pass int parameter by value, not by const reference
PiperOrigin-RevId: 158142102
---
Commit 9184726ed authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Avoid unnecessary copying of map data during visitation
PiperOrigin-RevId: 158141962
---
Commit 2e7e1d57b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Small fix for how std::move is used in constructors
PiperOrigin-RevId: 158141564
---
Commit 2a61c1652 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
In cpu compiler's CompileAheadOfTime, pass ordering when compiling entry computation.
PiperOrigin-RevId: 158140349
---
Commit f3f53e8b3 authored by Derek Murray<mrry@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[tf.contrib.data] Add support for dicts and remove lists from nested structures.
This changes the behavior of constructors like
`tf.contrib.data.Dataset.from_tensors()` when passed a list. Previously, the
`nest` utility would recurse into each element of such a list and create a
separate Dataset component. Now the list will be converted to a tensor, allowing code like:
```python
dataset = tf.contrib.data.Dataset.from_tensor_slices(([1, 2, 3], [4, 5, 6]))
```
...to define a dataset with two components (each of shape `()`).
This change also adds support for dictionaries as nested structures, which
simplifies integration with dictionary-returning ops like `tf.parse_example()`.
Fixes#10151.
RELNOTES: Breaking change to `tf.contrib.data.Dataset` APIs that expect a
nested structure. Lists are now converted to tf.Tensor implicitly. You may need
to change uses of lists to tuples in existing code. In addition, dicts are now
supported as a nested structure.
PiperOrigin-RevId: 158139467
---
Commit b6a8848c1 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Enabling python configuration to use a remotely generated configuration that is located inside of the org_tensorflow repo (previously it *had* to be a remote repo declared in workspace file).
PiperOrigin-RevId: 158138601
---
Commit 0fe0bfcc3 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove unused protobuf header inclusions
PiperOrigin-RevId: 158120864
---
Commit f0c4c6c3f authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
In the CUDA path of depthwise_conv2d, add a fast NCHW backward filter convolution for images smaller than 16x16.
PiperOrigin-RevId: 158111294
---
Commit 8dcf37b47 authored by Jon Malmaud<malmaud@gmail.com>
Committed by gunan<gunan@google.com>:
Fix typo (#10379)
---
Commit 3039d7da2 authored by Androbin<robin.richtsfeld@gmail.com>
Committed by gunan<gunan@google.com>:
Remove "bazel clean" (#10318)
Reverting #8880 (see #10236)
unnecessary since bazelbuild/bazel#2759 was merged
---
Commit ae1c16ae8 authored by Yifei Feng<fengyifei2026@gmail.com>
Committed by gunan<gunan@google.com>:
Update docker to cudnn6. (#10307)
* Update docker to cudnn6.
* Update Dockerfile.gpu
* Add --expunge to bazel clean to make cuda_configure run again and update TF_CUDNN_VERSION.
* Remove expunge and set CUDA and CUDNN version default in configure.
* Update configure
* Only set --action_env once
* Update prints for default version.
---
Commit 232e9d86d authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
tf_workspace() claims that the tf_repo_name argument is unused.
temp_workaround_http_archive still requires it.
This change silences the spurious message.
PiperOrigin-RevId: 158089834
---
Commit cc1a02d37 authored by Francois Chollet<fchollet@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add fp16 support to convolutional layers that support it.
PiperOrigin-RevId: 158086284
---
Commit 7d3fbba48 authored by Mustafa Ispir<ispir@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Extracted dnn estimator testing utils to be reused by dnn-linear-combined.
Added tests for dnn part of dnn-linear-combined estimator.
PiperOrigin-RevId: 158084898
---
Commit 9d12c629c authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Refactor the document and some polishment
PiperOrigin-RevId: 158083952
---
Commit 134138299 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Corrected comment: import_scoped_metagraph does not return a Saver.
PiperOrigin-RevId: 158082288
---
Commit a58553e4d authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add function in shape inference to try to infer output tensor content based on
the input shapes of the op. In some cases (E.g: shape), knowing the shapes of
the input is all that is necessary to infer the content of the output tensor.
This improves shape inference.
PiperOrigin-RevId: 158079306
---
Commit 0cc851c08 authored by Yuefeng Zhou<yuefengz@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Call maxcut algorithm in the model_based_cost_estimator.
PiperOrigin-RevId: 158078511
---
Commit 7d76a90be authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add question marks next to items in the graph legend.
PiperOrigin-RevId: 158076005
---
Commit 68fdb7628 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add DNNLinearCombinedClassifier.
PiperOrigin-RevId: 158075939
---
Commit 3d52e4cb9 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix create_meta_graph to respect an empty collection_list.
PiperOrigin-RevId: 158073112
---
Commit 54ccc3e5a authored by Mark Heffernan<meheff@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Add module-scoped HLO dataflow analysis.
This is the first step to replacing TuplePointsToAnalysis with a global, module-scoped analysis. This dataflow analysis identifies all values and their defs and uses in the XLA graph. The analysis is currently unused. Follow up CLs will add buffer alias analysis using this dataflow analysis, and incrementally switch the transformation passes (for example, CopyInsertion) to use these new module-scoped analyses.
PiperOrigin-RevId: 158067910
---
Commit 93c57c6e4 authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Handle control flow logic properly:
* Don't fold enter/exit nodes since that can interact badly with frames
* Create proper control dependencies on switch nodes
PiperOrigin-RevId: 158066691
---
Commit 9e6899720 authored by Jingyue Wu<jingyue@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[SE] Add cudnnTransformTensor to StreamExecutor.
PiperOrigin-RevId: 158062553
---
Commit 827874c30 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
In the CUDA path of depthwise_conv2d, add a fast NCHW backward input convolution for images smaller than 16x16.
PiperOrigin-RevId: 158061669
---
Commit bee26215c authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Speed up multinomial_op on CPU by using a vectorized Eigen expression and avoiding unnecessary casts.
Benchmark with AVX+FMA enabled:
Run on <redacted> (12 X 3492 MHz CPUs); 2017-06-05T12:54:07.881672447-07:00
CPU: Intel Haswell with HyperThreading (6 cores) dL1:32KB dL2:256KB dL3:15MB
Benchmark Base (ns) New (ns) Improvement
------------------------------------------------------------------
BM_Multinomial_cpu_1_10000_4 250817 172953 +31.0%
BM_Multinomial_cpu_1_10000_128 273834 187552 +31.5%
BM_Multinomial_cpu_1_10000_10000 1174175 1130778 +3.7%
BM_Multinomial_cpu_1_100000_4 2040741 1276761 +37.4%
BM_Multinomial_cpu_32_10000_4 10221765 4498666 +56.0%
BM_Multinomial_cpu_32_10000_128 10638159 4994754 +53.0%
BM_Multinomial_cpu_32_100000_4 100790019 44193314 +56.2%
BM_Multinomial_cpu_128_100000_1 431269640 182506078 +57.7%
PiperOrigin-RevId: 158061480
---
Commit 515b3ac67 authored by Justine Tunney<jart@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add Clutz to TensorBoard build
This is so we can get JavaScript protobufs. This CL also improves the
web_aspect and makes some peculiar Closure Compiler errors go away
relating to externs.
PiperOrigin-RevId: 158061198
---
Commit 0df6760fe authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Added a test to make sure that graph properties for variables are properly
reported
PiperOrigin-RevId: 158053084
---
Commit 2ccfe8e76 authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Added a new method to extract the graph properties from a cost graph without
having to run the model. This will simplify the process of creating regression
tests
PiperOrigin-RevId: 158050327
---
Commit 27f1b80c2 authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fixes memory leak in py_func when functions return unwrapped strings.
PiperOrigin-RevId: 158046530
---
Commit cf238e1f2 authored by Eugene Brevdo<ebrevdo@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix memory leak in python caused by @tf_should_use.
The issue is that python's GC has trouble collecting objects with __del__ methods.
The solution is two pronged:
* Keep track of usage state outside of the class, via a dict mapping
id(object) => state
* Remove __del__ (this was the source: python's GC couldn't collect wrapped
objects), and instead use weakref.finalize to emit warnings just as the object
is being garbage collected.
* Added tests for garbage collection [they were failing before i fixed the issue]
PiperOrigin-RevId: 158042388
---
Commit e6f581863 authored by Bo Wang<david.b.wang@gmail.com>
Committed by Rasmus Munk Larsen<rmlarsen@google.com>:
New reader for LMDB databases (#9950)
* Add LMDBReader op and test case
* Add testcase to load LMDB from a folder
* Add tensorflow/core/lib/lmdb/testdata/data.mdb
* Add EOF test
* Add license export
* Blacklist the test data in pip_smoke_test.py
* Address issues with respect to review
* Add LICENSE to BUILD rules
* Remove the prefx of LICENSE
* Wrap key with compat.as_bytes()
* Fixed a compilation flag
* Improve BUILD rules
* Support LMDB build in cmake
* Fix BUILD file format with buildifier
* Add fake unistd.h for lmdb to build on Windows
* Avoid building lmdb tools which depends on unistd.h
* Fix the string encoding issue in Python3
* Update lmdb library name in CMakeList.txt
---
Commit cc411f938 authored by Yao Zhang<yaozhang@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
When converting the layout of Conv2DBackpropInput, we need to permute one of
its inputs, which is a constant node. We permute a copy of this node, instead of the
original node, because the original node may be used as input to other nodes.
This kind of sharing of const node could arise if the graph is pre-optimized by common
subexpression elimination, which is part of the L1 optimizations in
TensorFlow.
PiperOrigin-RevId: 158037552
---
Commit 88bdb6fca authored by Dandelion Man?<dandelion@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove all remaining references to non-public TF modules from TensorBoard.
I deleted the PluginAssetUtil tests because that code is deprecated.
I'll later add manual testing for backcompat in the text plugin.
PiperOrigin-RevId: 158037466
---
Commit 6c531eb2f authored by Francois Chollet<fchollet@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add file hash to Keras Boston Housing dataset to force cache update.
PiperOrigin-RevId: 158036587
---
Commit afdc38cd3 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove deprecated resource handle functions in InferenceContext.
PiperOrigin-RevId: 158034419
---
Commit 9f932e6ce authored by Derek Murray<mrry@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Avoid parsing a rendezvous key for Send/Recv ops outside a loop.
For such ops, the rendezvous key will be constant, because
`ctx->frame_iter()` will always evaluate to `{0, 0}`. Benchmarking
reveals that this can save between 1 and 2 microseconds per Send or
Recv op execution. The optimization applies to all cross-process,
inter-device, and intra-device (host-to/from-device memory) Send/Recv
ops.
PiperOrigin-RevId: 158032522
---
Commit cc2dd4ac8 authored by Shanqing Cai<cais@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
tfdbg: dump debug data from different devices in separate directories
Fixes: #7051
wherein TFDBG failed to load the data dump from a Session.run() involving multiple GPUs.
The root cause of the bug was that TFDBG previously assumed that node names are unique across all partition graphs. This is however not the case when multiple GPUs exist. The Send/Recv nodes in the partition graphs of the GPUs can have duplicate names. There will potentially be other cases like this in the future due to other reasons (e.g., distributed sessions and/or graph optimization).
This CL relaxes this assumption, by dumping the GraphDef and tensor data from different devices into different sub-directories under the dump root directory.
PiperOrigin-RevId: 158029814
---
Commit a5909d643 authored by Toby Boyd<tobyboyd@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fixed triggering create device multiple times
PiperOrigin-RevId: 158025196
---
Commit 504a307b7 authored by Martin Wicke<wicke@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Make sure that Adam colocates ops with a consistent variable across workers.
PiperOrigin-RevId: 158022292
---
Commit 69ba4d3d4 authored by Asim Shankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix#10371
cpuinfo.get_cpu_info() doesn't seem to include the l2_cache_size key on some
architectures.
PiperOrigin-RevId: 158021008
---
Commit a51a9846c authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Performance-related tweaks: Don't copy loop variables; remove ineffective std::move casts.
PiperOrigin-RevId: 158017670
---
Commit 009789f74 authored by Peter Hawkins<phawkins@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Allow 0-sized slices in DynamicSlice and DynamicUpdateSlice; add tests.
PiperOrigin-RevId: 158015870
---
Commit 48a4853eb authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Miscellaneous cleanups
PiperOrigin-RevId: 158012131
---
Commit 379ddde24 authored by Chris Song<sjhshy@gmail.com>
Committed by Chris Song<sjhshy@gmail.com>:
Fix misspells.
---
Commit a0a76da97 authored by Lakshay Garg<lakshay.garg.1996@gmail.com>
Committed by Lakshay Garg<lakshay.garg.1996@gmail.com>:
Fixed typo in code
---
Commit 7ffc35732 authored by Eugene Brevdo<ebrevdo@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add support for bools in matrix_diag, matrix_diag_part, matrix_set_diag, matrix_band_part.
PiperOrigin-RevId: 157939272
---
Commit edf3d5dbe authored by Darren Garvey<darren.garvey@gmail.com>
Committed by Darren Garvey<darren.garvey@gmail.com>:
configure: Fix default path when enabling MPI.
Correct showing what the default path is when mpi is installed.
---
Commit aad2e3daf authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
In the CUDA path of depthwise_conv2d, add a fast NCHW forward convolution for images smaller than 16x16.
PiperOrigin-RevId: 157915637
---
Commit 5cf08d9cb authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Drop blockDim.y for the equivalent in_cols, and slightly improve naming (use 'pixels' instead of 'size' for height*width numbers).
PiperOrigin-RevId: 157906773
---
Commit 563f05ff6 authored by Eugene Brevdo<ebrevdo@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[tf contrib seq2seq] Expand tile_batch to handle nested structures.
This allows it to properly tile the initial wrapper state when using
BeamSearchDecoder with AttentionWrapper. Unit tests updated to show this use.
PiperOrigin-RevId: 157903115
---
Commit 1234e2dda authored by Justine Tunney<jart@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix Plottable definition
On Mac OS the build directory in the Node package conflicts with BUILD.
PiperOrigin-RevId: 157899970
---
Commit bb7a8d8e7 authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Don't use the _output_shape attribute in the op_level_cost_estimator since
there is no guaranty that it will be present or accurate.
PiperOrigin-RevId: 157898989
---
Commit 6f4204c3d authored by Justine Tunney<jart@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix TensorBoard SHA256 in cmake
PiperOrigin-RevId: 157897958
---
Commit c9d2f432b authored by Justine Tunney<jart@google.com>
Committed by Justine Tunney<jart@google.com>:
Fix TensorBoard SHA256 in cmake
---
Commit 1c70fb686 authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add training test for multi classes (n>2) linear classifier.
PiperOrigin-RevId: 157896002
---
Commit 675d36be0 authored by Yao Zhang<yaozhang@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add fused batch norm to tf.layers.
PiperOrigin-RevId: 157893874
---
Commit f37d0ea47 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Internal change -- first draft docs
PiperOrigin-RevId: 157891937
---
Commit 9b8f6113b authored by Zongheng Yang<zongheng@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
tensor_bundle: fix that the read path forgets to cache file handles.
In a case where a reader is geographically far from the file, this change
achieves a speedup of end-to-end checkpoint restore by 5.8x.
PiperOrigin-RevId: 157889659
---
Commit 0c92dada6 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Use inplace Cholesky factorization and solves to speed up and reduce memory usage in matrix_solve_ls.
Check succes before copying outputs in cholesky_op.
PiperOrigin-RevId: 157887564
---
Commit a4caeb2ea authored by William Chargin<wchargin@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Extract the graphs dashboard to a plugin
This completes the great plugin migration!
The graphs plugin is somewhat different from the plugins considered so
far. First, it exposes two kinds of data: graph data and run metadata.
We elect to put both sources of data under the domain of the graphs
plugin for now, because it's not clear that the run metadata would be
useful for anything else. Second, the graph data really has no use for
"tags": a run either has an associated graph or it does not. Thus, we
expose an endpoint /data/plugin/graphs/runs that is different in format
from the /tags routes exposed by other plugins (it returns just a list
instead of a run-to-tag mapping).
This change removes a bunch of tests from application_test.py. The tests
cover the compresion behavior of the graph endpoint, but the graph
endpoint doesn't have any special logic in the way of compression. Thus,
the tests are, apparently, testing that werkzeug (or whatever is
relevant here) provides good compression defaults. This isn't
necessarily a bad idea, but it shouldn't be coupled to the graph tests.
To get test data that includes run metadata, you can run this script:
https://raw.githubusercontent.com/tensorflow/tensorflow/326942394e69074d50d5889218a24c9371eff259/tensorflow/examples/tutorials/mnist/mnist_with_summaries.py
PiperOrigin-RevId: 157884714
---
Commit 05a6a13f7 authored by Gunhan Gulsoy<gunan@google.com>
Committed by gunan<gunan@google.com>:
Make sure all writer caches are closed before deleting directories in dnn_test.
---
Commit d0e761f8d authored by Gunhan Gulsoy<gunan@google.com>
Committed by gunan<gunan@google.com>:
Disable another test that uses matrix_set_diag on windows.
---
Commit 8939b8562 authored by Derek Murray<mrry@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[tf.contrib.data] Re-implement IteratorGetNext as an AsyncOpKernel.
This prevents the op from consuming an inter-op thread pool thread
when blocked, and fixes a potential deadlock when many IteratorGetNext
ops are blocked. Fixes#10369.
PiperOrigin-RevId: 157878885
---
Commit 9e25c68ad authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add loss_only_head to hold additional loss terms for multi_head setup
PiperOrigin-RevId: 157875934
---
Commit 7cdcd0cca authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Filter more op types that don't benefit from constant folding.
PiperOrigin-RevId: 157875168
---
Commit 366990d92 authored by Kay Zhu<kayzhu@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Fix a subtle issue in copy_insertion due the interaction between copy
overriding logic and RecordIndicesToColocatingBuffers:
- When building instructions ShapeTree to be copy overriden, it is possible
that we create a single kCopy for two identical instructions. An example can
be:
%tuple.19 = tuple(%constant.4, %constant.1793, %constant.1793)
where it is used in a while.init operand, and constant.1793 is read-only within
the loop and also used by another while loop. The copy overriding pass will then
create the following (logical, not finalized) tuple:
%tuple.19 = tuple(%constant.4, %copy.5, %copy.5)
- In the subsequent pass RecordAmbiguousOrNonDistinctIndices, to add copies to
ensure point_to set is distinct, the duplicate %copy.5 are ignored because they
are not yet finalized, and these indices (1 and 2 in the example) are still
marked as to-be copied.
Therefore distinctiveness is lost.
This fix applies to the override building stage, to explicitly avoid creating
shared copies for non-distinct buffers.
PiperOrigin-RevId: 157872231
---
Commit f4b8d21b8 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Change function parameters to references to avoid copying, or otherwise move from function parameters when moving reduces the amount of copying.
PiperOrigin-RevId: 157867333
---
Commit 3eee61caa authored by Drew Hintz<pushespretn@gmail.com>
Committed by GitHub<noreply@github.com>:
fix quotes in example code from ? to "
---
Commit 4905c0eae authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove TODO - the new tolerance is okay to keep.
PiperOrigin-RevId: 157861020
---
Commit 55f6b6ff1 authored by David Soergel<soergel@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add explicit SparseTensor support to SignatureDef.
PiperOrigin-RevId: 157860466
---
Commit 79099d677 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Removes default thresholds from BinaryLogisticHead and adds predict and evaluate tests for DNNClassifier.
PiperOrigin-RevId: 157856471
---
Commit 54595f0f3 authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adds the training test for LinearClassifier with n_classes=2.
PiperOrigin-RevId: 157855473
---
Commit cd6c02985 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add 'streaming_curve_points' metric which returns curve [ROC, PR] approximation at specified number of points.
PiperOrigin-RevId: 157851535
---
Commit 0f2db7391 authored by Peter Hawkins<phawkins@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[TF:XLA] Split union-find implementation in mark_for_compilation_pass.cc into a separate library, make it more generic.
PiperOrigin-RevId: 157850985
---
Commit d5421cf58 authored by Justin Lebar<jlebar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add additional concat test.
PiperOrigin-RevId: 157844113
---
Commit f661128db authored by Geoffrey Irving<geoffreyi@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove unused overloads of SummarizeGraphDef and EqualGraphDef
PiperOrigin-RevId: 157843404
---
Commit a56d59a84 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Set flow to a value during TensorArray creation,
Re-enable tensor_array_ops_test in msan.
PiperOrigin-RevId: 157841785
---
Commit edcc5cc13 authored by Justine Tunney<jart@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add manual test runner for vz_sorting
PiperOrigin-RevId: 157841098
---
Commit 3f6404f20 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Assign a max height of 800px to images in the image dashboard.
The user could always expand to actual dimensions if need be.
PiperOrigin-RevId: 157838046
---
Commit c6ea6972a authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove debugging LOG(INFO) from previous change.
PiperOrigin-RevId: 157837305
---
Commit 07d39f28e authored by freedom" Koan-Sin Tan<koansin.tan@gmail.com>
Committed by Benoit Steiner<benoitsteiner@users.noreply.github.com>:
make gcc-5 on Ubuntu 16.04 happy (#10385)
gcc-5 complains of ambiguity and refuses to go when doing something
like 'bazel build -c opt tensorflow/...'
---
Commit ac66be783 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Minor cleanup: Remove unused BUILD dependencies and unnecessary code.
PiperOrigin-RevId: 157837211
---
Commit 4161ccc8e authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adjust tolerance on dirichlet_multinomial test.
PiperOrigin-RevId: 157834660
---
Commit 43c0f52f1 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix off-by-one error in BoolVector(begin, end) constructor.
PiperOrigin-RevId: 157833086
---
Commit 419d437ba authored by Lakshay Garg<lakshay.garg.1996@gmail.com>
Committed by Lakshay Garg<lakshay.garg.1996@gmail.com>:
Fixed typo in code comment
---
Commit 07710014d authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix device colocation for KMeans in case of multiple parameter servers.
PiperOrigin-RevId: 157795360
---
Commit b659bc39f authored by Justine Tunney<jart@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Simplify TensorBoard build
- Remove tensorboard_typescript_genrule
- Remove tensorboard_typescript_bundle
- Introduce ts_web_library Skylark rule which supports seamless
TypeScript compilation.
- Use Closure Compiler in semi-advanced mode to compile JavaScript.
This is done in a way that preserves <script> tag placement, which
causes pages to load faster and avoid FOUC, thereby making it a
better solution than the existing vulcanize.
PiperOrigin-RevId: 157794795
---
Commit 0503ce09c authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Wipe out previous shape inference result when importing a grappler item
Run graph optimizations last: since they can be expensive it's best to filter invalid items first.
PiperOrigin-RevId: 157792834
---
Commit 9ae941c4a authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Turn reductions along an empty set of dimensions into identity nodes.
PiperOrigin-RevId: 157792209
---
Commit 69075f354 authored by Yangzihao Wang<yangzihao@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add functional support for cudnnConvolutionBiasActivationForward().
PiperOrigin-RevId: 157788425
---
Commit 7d7a40309 authored by William Chargin<wchargin@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Extract the distributions dashboard to a plugin
This continues the great plugin migration. The distributions plugin was
similar to the histograms plugin, but it also purported to allow CSV
download like the scalars plugin. However, the existing implementation
of this was flawed, and would always yield a 500 on current prod [1]
(unless there were actually no data). This indicates that no one is
actually using it---probably because there isn't a relevant button on
the frontend, anyway!---so I just removed it.
This also changes most frontend occurrences of "compressedHistograms"
to "distributions" while we're at it.
[1]: Due to the reference `value.rank_in_bps` in the handler
`_serve_compressed_histograms`; this field does not exist and throws an
`AttributeError`.
PiperOrigin-RevId: 157787156
---
Commit 23cdf96b8 authored by Brennan Saeta<saeta@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Re-enable session_test.py
A number of CL's have split up session_test.py to be a bit smaller. As a
result, this CL will re-enable the session_test to see if it remains flaky.
PiperOrigin-RevId: 157786407
---
Commit d741d81c5 authored by Dandelion Man?<dandelion@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Expose tf.test.StubOutForTesting in the tf testing api
Also redirect TensorBoard usage to use that endpoint.
This is part of my ongoing effort to have TensorBoard only
depend on TensorFlow via its public api, so that it can
be split into a project with a fast external build.
PiperOrigin-RevId: 157784552
---
Commit 40411cd5c authored by Dandelion Man?<dandelion@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Refactor projector plugin to only use tf public methods.
Remove all reference to the PluginAsset system, which is deprecated.
Part of an ongoing effort to have TensorBoard only consume the public
TensorFlow api.
PiperOrigin-RevId: 157784016
---
Commit a65a70ea5 authored by Gunhan Gulsoy<gunan@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix pip tests under contrib/text
PiperOrigin-RevId: 157783952
---
Commit fb4bc806a authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix flakiness in GpuMultiSessionMemoryTest.
PiperOrigin-RevId: 157781368
---
Commit f7de292df authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update placeholder nodes' shapes in the GraphDef to reflect manually specified values for incomplete placeholder shapes. Previously, these overrides were only specified in the feed nodes, which improves estimates when using dynamic shapes but not when using static shapes. With this change, static shapes also benefit.
PiperOrigin-RevId: 157780800
---
Commit eebd44123 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add a frontend method for retrieving numeric alerts from the debugger plugin.
This route responds with a list of alerts (occurrences of bad values) in ascending timestamp order.
PiperOrigin-RevId: 157780270
---
Commit 5bc685d7f authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] If an op has a single "large" operand, we want to fuse this op into some of its consumers, even if we can't fuse into all of them.
PiperOrigin-RevId: 157779106
---
Commit 2ee09b873 authored by Mark Heffernan<meheff@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Various improvements to ShapeTree.
Add support for holding non-copyable types, operator==, and a
CopySubtreeFrom method for copying a subtree from one ShapeTree to
another.
PiperOrigin-RevId: 157777636
---
Commit 4f3ae7699 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add beam_search kernels used by BeamSearchDecoder to tensorflow.contrib.
PiperOrigin-RevId: 157775011
---
Commit 6b16c33b3 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Make audio-related logic use the audio plugin.
Previously, fetching audio and related data from TensorBoard used handlers within application.py. We now remove those handlers in favor of routes offered by the audio plugin. ML Dash is updated as well.
PiperOrigin-RevId: 157774953
---
Commit 8032e1f75 authored by Geoffrey Irving<geoffreyi@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Make function instantiation use std::vector<NodeDef> instead of GraphDef
It's about to turn into std::vector<NodeInfoPtr>; this change gets us partway there.
RELNOTES: n/a
PiperOrigin-RevId: 157771141
---
Commit 2e44be35d authored by Vinu Rajashekhar<vinuraja@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adds a protected DeleteResourceMgr(...) method in Device.
PiperOrigin-RevId: 157770378
---
Commit cc346e690 authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Strip the :x suffix when generating control inputs from input names
PiperOrigin-RevId: 157770257
---
Commit d6fe47af5 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Use tensorflow::StringPiece in literal_util.
Use template for RepeatedField assignment.
PiperOrigin-RevId: 157765477
---
Commit 7866fa01b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
This change significantly reduces time and resources used to load large TensorFlow graphs.
For a real-world large graph (13k nodes, 20k edges), this change:
* reduces all heap allocations by 19%
* reduces retained (final) heap allocations by 2.2%
* reduces CPU time by 11.2%
In most TF graphs, the set of unique values set to Node::assigned_device_name() is quite small. This change adds an interning table to the Graph object, which contains all of the unique values used for Node::set_assigned_device_name(), as well as a look-up table. This is the main source of the reduction in retained heap memory; nearly all nodes are assigned to just one or two unique devices.
This change removes the "string assigned_device_name_" field from the Node class, and replaces it with "int assigned_device_name_index_". However, because you need both the index and the name table to get the actual value, the Node::assigned_device_name() accessor needs access to the parent Graph. This requires adding a "Graph* graph_" field to the Node class.
In the future, if all users of this property are converted to use Graph::assigned_device_name(Node*), then the Node::graph_ field can be deleted, and the space reclaimed. However, doing so is out of the scope of this CL, and even with this new pointer field, the Node class is smaller than it was before, so this is still a net win.
The placement algorithm in simple_placer.cc is one of the main accessors of the Node::assigned_device_name property. This CL contains significant changes to simple_placer.cc, which directly take advantage of the fact that the property is an index into a name table, rather than treating it simply as a string. Many temporary allocations are also removed, which is the main source of the reduction in total heap allocations.
This CL also contains a few changes that remove short-lived allocations in unrelated code, such as the changes in op.cc/h, costmodel.cc, etc. It is extremely easy in C++ to accidentally allocate memory, especially when implicit conversions and copy constructors allocate memory.
All of the changes in this CL were motivated by empirical measurement, using CPU profiling and heap profiling.
PiperOrigin-RevId: 157762909
---
Commit fdffafbc1 authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add QueueDequeueUpTo to the list of dequeue ops
PiperOrigin-RevId: 157760201
---
Commit 7ad0d0698 authored by Mustafa Ispir<ispir@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add type error to start_queue_runners if given session is not a `tf.Session`. Due to semver, we suppress the error if a MonitoredSession is provided.
PiperOrigin-RevId: 157748375
---
Commit 7106f9fac authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Implemented an initial version of virtual scheduler unit test.
PiperOrigin-RevId: 157746305
---
Commit b020db0c6 authored by Andrew Harp<andrewharp@google.com>
Committed by Andrew Harp<andrewharp@google.com>:
revert public visibility
---
Commit 5b05728c2 authored by Andrew Harp<andrewharp@google.com>
Committed by Andrew Harp<andrewharp@google.com>:
visibility workaround 3
---
Commit 15a740ebb authored by Mustafa Ispir<ispir@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update and Move DNNLinearCombinedRegressor to estimator/canned.
PiperOrigin-RevId: 157744087
---
Commit d29bbeca3 authored by Dandelion Man?<dandelion@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix outdated code ref in TensorBoard README, add link to SO question.
PiperOrigin-RevId: 157743374
---
Commit 9fc164225 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix index_table_from_file to allow vocabulary_file be a Tensor
PiperOrigin-RevId: 157740677
---
Commit 0aa3e0194 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Internal change
PiperOrigin-RevId: 157740660
---
Commit 02ac85399 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Introduce new class Literal to replace protobuf Literal.
This renames the existing Literal message to LiteralProto and introduces a new
C++ class named Literal to replace it.
The LiteralProto is only used at RPC boundaries, or when protobuf-specific
functionality is required. The Literal class offers a 'ToProto' function to
generate a new LiteralProto message when necessary.
Currently, all the static functions in class LiteralUtil, just forward to their
counterparts in class Literal. This will change in a future CL.
Class Literal implements all the buffers as std::vectors. The only exception
is preds(), which given the std::vector<bool> representation, makes it unusable
for the semantics we require (it's not possible to get the address of the
underlying vector, for instance).
The CL adds a BoolVector class to work around that issue.
In future CLs, the std::vector representation may be changed to something more
efficient, if needed.
PiperOrigin-RevId: 157739125
---
Commit 207203253 authored by gunan<gunan@google.com>
Committed by GitHub<noreply@github.com>:
Python 3.6 support on windows. (#10356)
* Python 3.6 support on windows.
* Fix typo in README.md
* Make environment configurable for windows gpu build.
---
Commit 2b75a9a6e authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Go: Update generated wrapper functions for TensorFlow ops.
PiperOrigin-RevId: 157734029
---
Commit f60b6bdcb authored by Mustafa Ispir<ispir@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add a warning to documentation of MonitoredSession.
PiperOrigin-RevId: 157728225
---
Commit eb10a4c49 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Preallocate vector storage when the ultimate vector size is known in advance
PiperOrigin-RevId: 157724431
---
Commit ce32228c4 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add release notes for Intel MKL integration.
PiperOrigin-RevId: 157722003
---
Commit a23255bc0 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adds missing group OP to benchmark
PiperOrigin-RevId: 157716500
---
Commit d3e840a6c authored by Asim Shankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Disable writing of compressed checkpoints.
Snappy compression (and decompression) was enabled after the
1.1 release (in commit 63b2f999d3).
This means that checkpoints produced by the 1.2.0 release candidates
will cause TensorFlow 1.1 (and prior) binaries to crash as they
CHECK fail when trying to load snappy-compressed tables.
To ease transition, disable writing of compressed checkpoints in
1.2.0 for now.
Reconsider this in the next release.
PiperOrigin-RevId: 157675189
---
Commit 6db400bbc authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Refactoring Python op code generation.
PiperOrigin-RevId: 157675126
---
Commit d9620cab8 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add flag to determine whether to do L1 optimizations and inline functions. Default is to do them. In tf_optimizer don't inline or do l1 optimizations.
PiperOrigin-RevId: 157673614
---
Commit 25bb504cc authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Make a plugin that serves data for the audio dashboard.
Subsequent changes will make TensorBoard use this audio plugin instead of the previous handlers for audio-related data.
PiperOrigin-RevId: 157673132
---
Commit 24623653b authored by James Qin<jamesqin@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix graph text format serialization
PiperOrigin-RevId: 157669530
---
Commit 3aed1735c authored by Andrew Harp<andrewharp@google.com>
Committed by Andrew Harp<andrewharp@google.com>:
visibility workaround 2
---
Commit fea90f89d authored by Andrew Harp<andrewharp@google.com>
Committed by Andrew Harp<andrewharp@google.com>:
visibility workaround
---
Commit 732a6b1ae authored by Justine Tunney<jart@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Upgrade TypeScript to v2.3.4
PiperOrigin-RevId: 157667511
---
Commit 95d90ab2e authored by Luke Iwanski<luke@codeplay.com>
Committed by Benoit Steiner<benoitsteiner@users.noreply.github.com>:
[OpenCL] Fixes Split op (#10322)
* [OpenCL] Fixes Split op
Split should alway go through SYCL device
* [OpenCL] Removes half from registred types
---
Commit 963441400 authored by Luke Iwanski<luke@codeplay.com>
Committed by Benoit Steiner<benoitsteiner@users.noreply.github.com>:
[OpenCL] Extends softmax op to cover double (#10323)
---
Commit a702863e8 authored by Luke Iwanski<luke@codeplay.com>
Committed by Benoit Steiner<benoitsteiner@users.noreply.github.com>:
[OpenCL] Extends tile ops to int16 and int32 (#10328)
* [OpenCL] Extends tile ops to int16 and int32
* [OpenCL] Extends tile_ops to cover bool, uint8, int16, int64
---
Commit 75385814f authored by cxx<cxxgtxy@gmail.com>
Committed by cxx<cxxgtxy@gmail.com>:
Fix comments error in mnist_replica.py where only one ps is used with two works by default.
---
Commit 23364e2c6 authored by Andrew Harp<andrewharp@google.com>
Committed by Andrew Harp<andrewharp@google.com>:
buildifier fix
---
Commit e5088cb82 authored by Yao Zhang<yaozhang@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix discrepancy between measured and analytical cost graph. Use tf_cuda_library for utils.
PiperOrigin-RevId: 157660745
---
Commit 787381ca5 authored by Brennan Saeta<saeta@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Split up session_test.py -> session_clusterspec_prop_test.py
session_test.py has gotten very large. Additionally, recently it has become
flaky. In order to both (1) improve overall code health, and (2) to facilitate
root-causing the test flakiness, this CL begins to split apart session_test
into focused subsets.
I've suffixed the scoping of the session_test in order to preserve filesystem
sort-order grouping.
PiperOrigin-RevId: 157658981
---
Commit b09932d74 authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Added PlaceholderWithDefault to the list of known placeholder types
Use PartialTensorShape instead of TensorShapes to better handle partially known
shapes
PiperOrigin-RevId: 157657664
---
Commit 0462416f6 authored by Dandelion Man?<dandelion@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add make_ndarray, tensor_proto, and MetaGraphDef to tf api.
Since TensorProtos are part of the TensorFlow API, it makes sense
to also include the methods that generate and parse them.
Similarly, we write out MetaGraphDef protos in the summary writer,
so we should provide the proto as well.
This is part of an ongoing effort to have TensorBoard only consume
TensorFlow methods through the public api.
PiperOrigin-RevId: 157657564
---
Commit 458f94c12 authored by Wei Ho<weiho@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Open-source skip-gram ops
PiperOrigin-RevId: 157655970
---
Commit faac0331c authored by Justine Tunney<jart@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Introduce tensorboard_zip_file build rule
This rule can depend on web_library or tensorboard_html_binary. In
both cases it will create a .zip file containing all the transitive
web server paths. This can be used to deploy static assets to web
servers.
A small change was also made to Vulcanize to support path overriding.
PiperOrigin-RevId: 157655047
---
Commit 7ed44f4c9 authored by Brennan Saeta<saeta@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Split up session_test.py -> session_partial_run_test.py
session_test.py has gotten very large. Additionally, recently it has become
flaky. In order to both (1) improve overall code health, and (2) to facilitate
root-causing the test flakiness, this CL begins to split apart session_test
into focused subsets.
I've suffixed the scoping of the session_test in order to preserve filesystem
sort-order grouping.
PiperOrigin-RevId: 157651813
---
Commit 3c7ac46ae authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Teach Executable to do its own profiling (patch 4/4).
This CL removes the xla::Service stub for ExecuteOnStreamWrapper so the users call the xla::Executable version directly, and simplifies the function API to simply accept "arguments" as a parameter (with a templated type) rather than requiring the user to capture it into a lambda around the relevant Executable::ExecuteOnStream method.
PiperOrigin-RevId: 157651740
---
Commit 626f95ab9 authored by Peter Hawkins<phawkins@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[TF:XLA] Don't enforce that all nodes in an encapsulated subgraph are on the same device.
Use the assigned device rather than the user-requested device when converting a Graph to a FunctionDef.
PiperOrigin-RevId: 157648977
---
Commit 414470329 authored by Jacques Pienaar<jpienaar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Guard stream pool with mutex.
A data race can occur while populating the map.
PiperOrigin-RevId: 157647183
---
Commit ccdb30763 authored by Eugene Brevdo<ebrevdo@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Additional colocation options and bugfixes for TensorArray
* colocate_with is now set properly when a TensorArray is passed through a
while_loop
* added a new argument, "colocate_with_first_write" (default: True; this is
the current behavior). If False, the TensorArray is simply placed on the
device from the context it's constructed in, and no colocation constraints
are added.
PiperOrigin-RevId: 157643133
---
Commit 03fc7022b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update ops-related pbtxt files.
PiperOrigin-RevId: 157642677
---
Commit 41b87d6ce authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add a new attribute narrow_range to FakeQuant* operations. It quantizes into range [1; 255] instead of [0; 255].
PiperOrigin-RevId: 157641054
---
Commit c048e2938 authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adds support to non-placeholder inputs in _graph_to_function_def.
Specifically, supports input ops with more than one output tensor.
PiperOrigin-RevId: 157640908
---
Commit d310de4fa authored by Brennan Saeta<saeta@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Split up session_test.py -> session_list_devices_test.py
session_test.py has gotten very large. Additionally, recently it has become
flaky. In order to both (1) improve overall code health, and (2) to facilitate
root-causing the test flakiness, this CL begins to split apart session_test
into focused subsets.
I've suffixed the scoping of the session_test in order to preserve filesystem
sort-order grouping.
PiperOrigin-RevId: 157640788
---
Commit 8e868cf6a authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove unused arguments to call_cpp_shape_fn.
PiperOrigin-RevId: 157640125
---
Commit 9ddbf31fe authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Use unnamed namespace to effect internal linkage, replace string constructors with array-deducing helper function
PiperOrigin-RevId: 157636308
---
Commit 88ffe6276 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Increase cholesky_op_test to medium, bump shard_count 1 more.
PiperOrigin-RevId: 157635774
---
Commit bef563dc8 authored by Benjamin Kramer<kramerb@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Don't add constraints for computations we're not currently looking at.
TuplePointsToAnalysis is computed globally per module, so we add all
unconstrained buffers in that module, even if it's outside of the computation
we're currently running on. Then we proceed to propagate default layouts to all
those buffers and then throw the constraints away because they don't affect any
instruction in the current computation.
PiperOrigin-RevId: 157635564
---
Commit a980aead8 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Use test_adjusted_name when making the mangled_test_name in
run_and_gather_logs_lib.py, to avoid duplicate file names when the same test is
run on multiple GPUs.
PiperOrigin-RevId: 157630193
---
Commit 0a84cfd58 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update ops-related pbtxt files.
PiperOrigin-RevId: 157629497
---
Commit 6882effb8 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Make single-parameter constructors explicit
PiperOrigin-RevId: 157628970
---
Commit 0b8070253 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Support negative axis for Split op
PiperOrigin-RevId: 157628162
---
Commit 289e7bf5b authored by gunan<gunan@google.com>
Committed by GitHub<noreply@github.com>:
Fixes and improvements to cmake windows build. (#10354)
* Disable linalg ops tests on windows.
* Do not print the full source code path for logs on windows.
---
Commit bc236cfc3 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Passes classification head to LinearClassifier.
PiperOrigin-RevId: 157624020
---
Commit cebd7e246 authored by Luke Iwanski<luke@codeplay.com>
Committed by Shanqing Cai<cais@google.com>:
[OpenCL] Cleans debug ops (#10334)
* [OpenCL] Cleans debug ops
* Acts on feedback from #10334#discussion_r119452513
* Acts on #10334#discussion_r119459463
---
Commit fd6c3c4f1 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fixes flaky test in dnn_linear_combined_test.
PiperOrigin-RevId: 157622951
---
Commit c9cc388dc authored by Asim Shankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Avoid CHECKs in BundleReader, propagate errors instead.
Motivation:
We'd like to evolve the checkpoint format over time (e.g., enable
different types of compression). Without this change, a TensorFlow
version that encounters a format that it doesn't understand would CHECK fail
with an unhelpful error message.
With this, it propagates a clearer error message up, giving the user some
hints about what could be wrong.
I don't have a unittest for this - I thought about writing a bundle and
then strategically corrupting the bytes on disk before reading it back,
but that seems a bit much. The intention of this change is to enable
graceful reporting of forward compatibility breakages. Ideas for an
appropriate unittest are appreciated.
PiperOrigin-RevId: 157620358
---
Commit ee05b8b69 authored by Wei Ho<weiho@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix to remove TF op usage outside of the initializer fn (due to deferred execution of initializer fn, this prevent issues with graph mismatch).
PiperOrigin-RevId: 157620177
---
Commit e8d17ea8c authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Materialize shapes that are known at graph construction time into constants
that can be folded
PiperOrigin-RevId: 157619380
---
Commit dc0427d48 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Directly depend on the used libraries
Do not rely on transitive dependencies.
PiperOrigin-RevId: 157618184
---
Commit 964d1a509 authored by Yuan Yu<yuanbyu@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix a bug that an erroneous control edge can be introduced when loops are nested in control dependency context.
PiperOrigin-RevId: 157616919
---
Commit 2de94bbb8 authored by Eli Bendersky<eliben@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Add an option to set the "generate HLO graph" regex without a flag.
Pipes the option through xla.proto ExecutionOptions, to HloModuleConfig, which
can then be accessed throughout the compiler.
PiperOrigin-RevId: 157615458
---
Commit d3c0482e6 authored by My name is<raviqqe@gmail.com>
Committed by gunan<gunan@google.com>:
Fix a typo in export_output.py (#9975)
---
Commit 0c75d9f52 authored by ddurham2<ddurham@davyandbeth.com>
Committed by gunan<gunan@google.com>:
Adding lost documentation to tf.abs from the old tf.complex_abs when it learned how to work on complex data. (#9954)
---
Commit 84661fa73 authored by Benoit Steiner<bsteiner@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Propagate control dependencies during constant folding
PiperOrigin-RevId: 157610040
---
Commit a3520340e authored by gunan<gunan@google.com>
Committed by GitHub<noreply@github.com>:
Improve windows bazel python test suite. (#10305)
* Improve windows bazel python test suite.
- Create new tags, no_windows and no_windows_gpu
- Instead of a separate maintained list, use bazel tags to exclude tests.
- Tag all the python tests that are known to have issues in windows.
* Also blacklist neon_depthwise_conv_ops_test in windows.
* Only build tests in CPU windows tests.
* Only build tests in GPU windows tests.
* Also disable session_test on windows.
* Only run py tests on windows, and only build tests that are not
disabled.
---
Commit a6f284ca4 authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adds integration tests for LinearRegressor.
PiperOrigin-RevId: 157604107
---
Commit d21bf7d75 authored by Francois Chollet<fchollet@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Backport changes from Github master.
PiperOrigin-RevId: 157603238
---
Commit 43bfc138c authored by Shanqing Cai<cais@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix OSS compilation error in tfprof_main.cc
PiperOrigin-RevId: 157602449
---
Commit 904a3d075 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fixing issue with cuda compilation related to missing include (exception is only thrown when running with sandboxing on)
PiperOrigin-RevId: 157602401
---
Commit f59203c98 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Shard cholesky_op_test.
PiperOrigin-RevId: 157601172
---
Commit 3fdbb5579 authored by Amit Patankar<amitpatankar@google.com>
Committed by Amit Patankar<amitpatankar@google.com>:
Merging rc1 back into master.
---
Commit be5d98a8b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adds integration tests for DNNClassifier.
PiperOrigin-RevId: 157592010
---
Commit a05de6cd2 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Change reporting feature importances in RandomForestEstimator to run at the end of training, instead of part of the inference graph.
PiperOrigin-RevId: 157591575
---
Commit e96f1142f authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove unnecessary casts
PiperOrigin-RevId: 157591439
---
Commit 5f8571a6b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix missing namespace comments
PiperOrigin-RevId: 157591364
---
Commit eeb0b4067 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Go: Update generated wrapper functions for TensorFlow ops.
PiperOrigin-RevId: 157573997
---
Commit 7f9674217 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update ops-related pbtxt files.
PiperOrigin-RevId: 157573723
---
Commit 473a590c9 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Allow complex valued input for Cholesky decomposition.
PiperOrigin-RevId: 157572536
---
Commit 2d1860859 authored by Blake Hechtman<blakehechtman@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix test name in array_elementwise_ops_test.
PiperOrigin-RevId: 157552402
---
Commit a7fff05e0 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
tfprof multi-step profiling.
This allows users to fill in RunMetadata across different steps.
1. It is useful for RL model which runs a subset of graph each step.
2. It also gets averages of multi-step stats.
PiperOrigin-RevId: 157552388
---
Commit fe589d9e7 authored by Luke Iwanski<luke@codeplay.com>
Committed by Benoit Steiner<benoitsteiner@users.noreply.github.com>:
[OpenCL] Implementation improvements (#9117)
* OpenCL Improvements
* Registers Scatter and ScatterNd Ops for SYCL
* Registers Stack op for SYCL
* Fixes No sycl buffer found error for debug ops
* Registers MatMul and Transpose Ops to SYCL device for double
* Extends analyzer_cli_test.py test to cover SYCL
* Fixes Transpose Op for double when on SYCL
* Bumps Eigen version to fix double precision issue on SYCL
* Extends SessionDebugTestBase to cover SYCL
* Register SYCL implementations for random ops
* Avoid functions that might not be defined on SYCL device (#51)
* Avoid functions that might not be defined on SYCL device
* Simplify by using Eigen math functions
* OpenCL improvements
- Bumps Eigen Version
- Refactors Ops registration
- Introduces workaround for Const Op related to the difference between
CUDA which uses pointers and OpenCL that uses buffers/accessors
- Extends memory types to cover DEVICE_SYCL as well
- Introduces GetSYCLDevice() method that returns list of supported devices
with GPU device having the highest priority ( doesn't include blacklisted devices )
- ::internal::Transpose -> tensorflow::internal::Transpose in order to
avoid compilation reported error
- re-introduces fix for bugged string replacement causing a lot of compilation
warnings -c -> --include
- Adds sycl_runtime to bazels ARRAY_DEPS
- Replicates TF_CALL_GPU_PROXY_TYPES for SYCL
* [OpenCL] Fixes an issue caused by switch to aligned allocator for sycl buffer (#53)
* [Build] Use gcc/g++ as a host compiler to avoid #8394 (#54)
* [OpenCL] Fixes Scatter Op
* Fix testSimple and testConst in stack_op_test (#3)
* Fix testSimple and testConst in stack_op_test
* Create a specialisation of DoParallelConcatUpdate for SyclDevice and
register it
* Guard all code in TENSORFLOW_USE_SYCL
* Do not use sycl device for int32
* Registration of the Sycl version is now looking like the one for the GPU
* Remove added empty line
* Register batch normalization kernels for OpenCL (#61)
* [OpenCL] RandomGamma has no GPU friendly implementation (#57)
* [OpenCL] Compatibility fixes for TensorFlow 1.1.0-rc1
* [OpenCL] Implements BatchMatmul Op for SYCL
* Lowercase the device name when GPU or SYCL returned
* [OpenCL] kernel_estimator_test.py assertEqual-> assertAlmostEqual due to floating point representation on the device
* [Eigen] Version bump
* GPU device name string manipulation is not needed anymore
* [OpenCL] Adds SYCL to device backwards compatibility
* [OpenCL] Extends core_rnn_test.py to run for SYCL device
* [OpenCL] Minor optimizations for build script
* [OpenCL] Enables skip folder list in build script
* [OpenCL] Fixes ApplyAdamOp for Sycl device
* [OpenCL] SYCL device improvements
* [OpenCL] Fixes debug_ops's SEGFAULT for SYCL device
* [Build] Adds hexagon to skipped folders list
* [OpenCL] Removes EnterLameDuckMode from SYCL device and allocator
* [OpenCL] Registers Unique Op for SYCL device
* [OpenCL][Temporary] Disables tests for SYCL target due to features not being implemented yet
Tests affected:
- tensorflow/contrib/memory_stats/python/kernel_tests/memory_stats_ops_test.py
- tensorflow/contrib/rnn/python/kernel_tests/core_rnn_test.py
- tensorflow/python/kernel_tests/conv_ops_test.py
- tensorflow/python/kernel_tests/depthwise_conv_op_test.py
- tensorflow/python/kernel_tests/pooling_ops_3d_test.py
- tensorflow/python/kernel_tests/pooling_ops_test.py
- tensorflow/python/kernel_tests/scatter_nd_ops_test.py
- tensorflow/python/training/adam_test.py
- tensorflow/python/training/localhost_cluster_performance_test.py
- tensorflow/python/training/training_ops_test.py
* [OpenCL][Temporary] Disables failing tests for SYCL in order to establish regression baseline
Tests affected:
- tensorflow/python/debug/cli/analyzer_cli_test.py
- tensorflow/python/debug/lib/session_debug_testlib.py
- tensorflow/python/debug/lib/stepper_test.py
- tensorflow/python/kernel_tests/unstack_op_test.py
- tensorflow/python/ops/image_ops_test.py
* [OpenCL] Take options.config.device_count() into consideration
* [OpenCL] Fixes compilation warning
* [OpenCL] device:SYCL:0 -> sycl:0
* [OpenCL] Removes unwanted flags in building script
Removes flags given to computecpp that enable SIMD instructions
Removes duplicate flags
* bool -> const bool
* [OpenCL] sycl in test_util.gpu_device_name() -> is_sycl_enabled()
* [OpenCL][Temporary] Disables failing tests for SYCL in order to establish regression baseline
Test affected:
- tensorflow/contrib/stateless/python/kernel_tests/stateless_random_ops_test.py
* Imports test_util from tensorflow.python.framework
* [OpenCL] Fixes formatting in Python code
* [OpenCL] Extends session_test.py to cover SYCL device
* [OpenCL] Cleans singleton class
* [OpenCL] Keeping CUDA happy
* [OpenCL][Temporary] Disables failing tests for SYCL in order to establish regression baseline
Test affected:
- tensorflow/contrib/rnn/python/kernel_tests/core_rnn_cell_test.py
- tensorflow/contrib/seq2seq/python/kernel_tests/beam_search_ops_test.py
* Added support for building with SYCL on ARM.
* Acts on the review feedback from:
- #9117#discussion_r113608975
- #9117#discussion_r113609173
* [OpenCL] Fixes scatter_nd_op_test
* Fixes auto-merge mistake
* [OpenCL] struct SyclDevice -> class SyclDevice
* Revert "[OpenCL] struct SyclDevice -> class SyclDevice"
This reverts commit addd43348c374a5379f67bb1e5ad084715722fc2.
* [OpenCL] Reverting refactoring commit.
As requested in the review #9117#issuecomment-298454466
This change set will be re-introduced in smaller chunks.
* Revert "[OpenCL] device:SYCL:0 -> sycl:0"
This reverts commit cf16e60340b62d16c3764d71b716fe03d35f87a9.
* Revert "[OpenCL] Adds SYCL to device backwards compatibility"
This reverts commit b8401b5164199b7a169be1c1d8dea5001195c390.
* Acts on the feedback from #9117#discussion_r115036905
* control_flow_ops_py_test.py expects device name to be lower cased
* Acts on the feedback from #9117#discussion_r115037222
* Removes debug print
* Removes not needed partial specialisation
* [OpenCL] Registers ScatterNdFunctor for SYCL device
* [OpenCL] Make it compile
* [OpenCL] Follow gpu_device changes
* [OpenCL] Adds cxx_builtin_include_directory for python lib
Fixes bazels missing undeclared inclusions that appeared after
merge with TensorFlow upstream
* [OpenCL] Fixes Constant Op
* [OpenCL] gXX-4.8 -> gXX
* [OpenCL] Removes -D_GLIBCXX_USE_CXX11_ABI=0 as it breaks default compiler setup for Ubuntu 16.04
* Revert "[OpenCL] kernel_estimator_test.py assertEqual-> assertAlmostEqual due to floating point representation on the device"
This reverts commit 06c50c0a485f40c30a436f02c3fa7794e370c49d.
* [OpenCL] CPU allocator is a singleton we should not delete it
---
Commit 7aac2395c authored by Blake Hechtman<blakehechtman@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Merge a copies of copies.
PiperOrigin-RevId: 157549434
---
Commit 37d9d5f0e authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add some routines for managing summaries to slim.
PiperOrigin-RevId: 157541902
---
Commit d58cd2962 authored by Justine Tunney<jart@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix weblas license mirror URL
PiperOrigin-RevId: 157537115
---
Commit 5c13ee13b authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Make images-related logic use the images plugin.
Previously, fetching images and related data from TensorBoard used handlers within application.py. We now remove those handlers in favor of routes offered by the images plugin. ML Dash is updated as well.
PiperOrigin-RevId: 157536471
---
Commit 60394a3d1 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Reduce size of the no-winograd tests, but still large enough that
ShouldIncludeWinogradNonfusedAlgo returns true.
PiperOrigin-RevId: 157535386
---
Commit 9501c4104 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Replace protobuf CopyFrom with assignment
PiperOrigin-RevId: 157534272
---
Commit 96698f7fd authored by Eugene Brevdo<ebrevdo@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[tf contrib seq2seq] Improve BeamSearchDecoder's ability to handle unknown shapes.
Updated unit tests to contain inputs of unknown shape (at graph build time).
Found an issue in the gather helper that stops it from properly propagating
the batch size of the output shape. This caused problems with tf.while_loop.
Fixed.
PiperOrigin-RevId: 157533937
---
Commit 5c73d0102 authored by Neal Wu<wun@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Batch norm docs fix applied to _fused_batch_norm as well
PiperOrigin-RevId: 157530527
---
Commit abd4aa49a authored by Jonathan Hseu<jhseu@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix docs for tf.abs() and tf.pow().
PiperOrigin-RevId: 157528475
---
Commit dd5ad6917 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Declarations of operators to support batch norm in xla
PiperOrigin-RevId: 157527596
---
Commit bbeaa1307 authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix the expand_dim for label and weight for classifier heads.
PiperOrigin-RevId: 157524909
---
Commit 346021ab4 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Cleanup: Use C++ casts, remove redundant casts, use CHECK_OK
PiperOrigin-RevId: 157522142
---
Commit e405b0f6b authored by Francois Chollet<fchollet@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Refactoring of layer name autogeneration, to remove a graph serialization warning.
PiperOrigin-RevId: 157520123
---
Commit 5784e1e35 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add HasOutputProperties to check for pruned ops; Return
device name instead of casting it to a short name (GPU:0/CPU:0); VLOG(2) when printing op device placement since it is a lot of output.
PiperOrigin-RevId: 157519077
---
Commit 2994444bf authored by Peter Hawkins<phawkins@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Issue a more user-friendly error message if a variable's initializer is from inside a control-flow scope, such as tf.cond() or tf.while_loop().
Fixes#8604.
PiperOrigin-RevId: 157516279
---
Commit da2daf068 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove unused using declarations
PiperOrigin-RevId: 157513772
---
Commit 8b2e8b566 authored by Derek Murray<derek.murray@gmail.com>
Committed by gunan<gunan@google.com>:
Exclude Python test files from CMake PIP package. (#10302)
* Exclude *_test.py files from the CMake-built PIP package.
* Add stray _test.py file to the PIP package.
* Nit. Convert tabs to spaces in tf_python.cmake
---
Commit 2249a4ea8 authored by Dan Ringwalt<ringwalt@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix control reaching the end of ProjectiveGenerator.
PiperOrigin-RevId: 157510013
---
Commit 040e2e20f authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove unneeded check for has properties in grappler.
PiperOrigin-RevId: 157507665
---
Commit 684006955 authored by Yun Peng<pcloudy@google.com>
Committed by gunan<gunan@google.com>:
Windows: Remove session_test from bazel_test_lib.sh (#10274)
It was disabled in 49b17146d2
---
Commit 890a0a407 authored by Gunhan Gulsoy<gunan@google.com>
Committed by Gunhan Gulsoy<gunan@google.com>:
Upgrade TF ci build and docker files to use bazel 0.5.0
---
Commit 46db634e5 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Only run the no-winograd tests once each.
Only run the no-winograd tests on GPU; this also fixes
timeouts in asan and msan.
PiperOrigin-RevId: 157505317
---
Commit a6cd4e735 authored by Dandelion Man?<dandelion@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove all TB build references that circumvent TF's public API.
This doesn't actually remove all the code references, lots of code references continue to work despite the BUILD references being removed. I think this is because depending on the public api transitively makes all of TensorFlow's guts available too.
PiperOrigin-RevId: 157502987
---
Commit dcc3cdce8 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove redundant get() calls and string conversions
PiperOrigin-RevId: 157497932
---
Commit af2b9d875 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix the trace inputs functionality of the graph explorer.
After migrating to d3 v4, the graph can no longer directly index into d3.Selections to obtain elements. Instead, we must use the nodes method of d3.Selection to generate an array of selected elements.
PiperOrigin-RevId: 157493509
---
Commit 5cf484584 authored by Jacques Pienaar<jpienaar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Small test that performs A*B+A and A*B+B.
PiperOrigin-RevId: 157492992
---
Commit b2355913b authored by Androbin<robin.richtsfeld@gmail.com>
Committed by drpngx<drpngx@users.noreply.github.com>:
remove some invalid entries (#10294)
I noticed that some entries don't exist (anymore).
This seems to be some kind of a consistency issue.
More specifically:
`tensorflow/contrib/ios_examples/camera/data`
`tensorflow/contrib/session_bundle/testdata/saved_model_half_plus_two`
`tensorflow/contrib/session_bundle/testdata/saved_model_half_plus_two/variables`
This is the continuation of PR #10264
---
Commit 367ec84f8 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add SampleEmbeddingHelper to do sampling at inference time
PiperOrigin-RevId: 157487623
---
Commit a3ba225d5 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add BatchMatMul execution cost prediction
PiperOrigin-RevId: 157487507
---
Commit 34a29fc3b authored by Eric Liu<ioeric@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[TF:XLA] preserve metadata when replacing HLO instructions.
The motivation is to add metadata for HLO instructions that are created to replace existing HLO instructions during optimizations. The assumption is that the old instruction and the new instruction would perform the same function, and that they would be correlated to the same TF op. This might not always be correct since HLO optimizations can cross TF op boundaries. But still this seems to be better than nothing.
Note that this still doesn't fully resolve missing OpMetadata after HLO optimizations; new instructions might be added without using ReplaceInstruction.
PiperOrigin-RevId: 157484394
---
Commit 092a7b6e6 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Disable keras lstm test in tsan.
PiperOrigin-RevId: 157484268
---
Commit 7280dafca authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Use "empty" member function to test for emptiness
PiperOrigin-RevId: 157483181
---
Commit 6c3b15915 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Expands integration tests in dnn_test.
PiperOrigin-RevId: 157476608
---
Commit 727193b1f authored by Androbin<robin.richtsfeld@gmail.com>
Committed by drpngx<drpngx@users.noreply.github.com>:
add missing import for `signal` package (#10264)
* add missing import for `signal` package
* add missing dependency for `signal` package
* Update tf_python.cmake
---
Commit 21461213d authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove unused BUILD dependencies
PiperOrigin-RevId: 157473460
---
Commit 4788ca2be authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix handling of Infinity/NaN in line chart domain
Test Plan:
- Use the script listed below to generate data that has enough
infinities for these values to not be treated as outliers.
- Load the data into TensorBoard (`--logdir /tmp/infbug`) and look at
the scalars plot; also look at the console.
- Before this change, the chart is completely blank, and there is a
console warning: "QuantitativeScales cannot take NaN or Infinity as
a domain value. Ignoring."
- After this change, there is no console output, and the chart appears
as intended: a reasonable domain is shown, and the infinities just
shoot off the chart.
Generating script:
```py
import tensorflow as tf
LOGDIR = '/tmp/infbug'
STEPS = 134
def main():
x = tf.Variable(3.1415)
y = x.assign_add(x)
tf.summary.scalar('y', y)
summ = tf.summary.merge_all()
sess = tf.Session()
writer = tf.summary.FileWriter(LOGDIR)
writer.add_graph(sess.graph)
sess.run(tf.global_variables_initializer())
for step in xrange(STEPS):
writer.add_summary(sess.run(summ), step)
writer.close()
if __name__ == '__main__':
main()
```
PiperOrigin-RevId: 157472340
---
Commit 49476a62c authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Remove unused namespace aliases
PiperOrigin-RevId: 157468609
---
Commit d83074847 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Use "nullptr" for null pointer values
PiperOrigin-RevId: 157468186
---
Commit b73fea6e2 authored by Tim Harley<tharley@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Refactor `tf.Operation.traceback` implementation in to methods of tf.Graph.
Adds an `_extract_frame_info` method to allow derived classes to extend the
information available in each op traceback, if desired. The default result of
`tf.Operation.traceback` is unchanged.
Also fixes a poorly scoped `pylint disable=line-too-long`, so adds the necessary
enable/disable blocks to silence pylint for the offending docstrings.
PiperOrigin-RevId: 157466174
---
Commit f7ca8db7d authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Improve shape inference error messages for DynamicSlice/DynamicUpdateSlice.
PiperOrigin-RevId: 157461335
---
Commit 8c2a079ec authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adding a slot / accumulator warmstart initializer that overrides the provided partitioner at call time with one passed at construction time. This is intended to be used for slot Variables (such as accumulators) associated with Optimizers, since these Variables are created in a fashion that relies on replicating the exact shape of the associated primary variables (see slot_creator).
PiperOrigin-RevId: 157453498
---
Commit 73d10599f authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Default CUDNN_HOME to CUDA_TOOLKIT_TARGET_DIR. The cuDNN distro is most naturally installed in the same directory as the CUDA SDK, so try to find it there if the user doesn't specify any other directory.
PiperOrigin-RevId: 157436253
---
Commit eb7cf9331 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Go: Update generated wrapper functions for TensorFlow ops.
PiperOrigin-RevId: 157429266
---
Commit 346dcc0a4 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update ops-related pbtxt files.
PiperOrigin-RevId: 157429078
---
Commit 3d5ede131 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update documentation for sparse_matmul op to reflect gradient calculation.
PiperOrigin-RevId: 157428135
---
Commit 822d64f0c authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix embedding_lookup() bug where normalization did not work with ids of rank != 1.
PiperOrigin-RevId: 157422220
---
Commit 8cad6b824 authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Improve the error message for live set memory check.
PiperOrigin-RevId: 157415647
---
Commit 34dcd5b49 authored by Eugene Brevdo<ebrevdo@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[tf contrib seq2seq] Bugfixes to BeamSearchDecoder
Implementation by Cinjon Resnick. He can't push this since he's traveling.
I just copied the fix and added some small syntax tweaks to make the unit
tests pass. More comprehensive unit tests will come in the near future.
Fixes at least part of #9904.
BeamSearchDecoder:
1. Fix the bug where we don't pass the next cell state through.
2. Gather the cell state (and attention if that's a part of the model
as an AttentionWrapper on the cell) according to the next_beam_ids.
PiperOrigin-RevId: 157415564
---
Commit f7ae1461c authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix oversampling in the GPU version of multinomial due to an error in generating
gumbel noise. -log(-log(U)) gives infinity if U draws a hard 0. Adds a tiny
offset to U (2e-30) to avoid log(U) = -inf.
The CPU sampling algorithm depends on the order of the logits which is
undesirable and can also oversample the first logit if it is smaller than the
smallest random float larger than 0 (~1e-7). Switching to double precision
internally mitigates these problems, although it doesn't fix them. Slowdown
is ~35% in the worst case.
Also adds various tests that we would like the sampling to pass.
CPU Benchmark before:
32 10000 1 0.060 0.069 0.87
32 10000 4 0.229 0.074 3.10
32 10000 32 2.180 0.059 37.09
32 100000 1 0.430 0.480 0.90
32 100000 4 2.322 0.449 5.17
32 100000 32 31.508 0.471 66.96
128 10000 1 0.168 0.235 0.71
128 10000 4 0.965 0.246 3.93
128 10000 32 7.989 0.225 35.51
128 100000 1 1.681 1.539 1.09
128 100000 4 9.012 1.57 35.73
128 100000 32 126.222 1.626 77.60
CPU Benchmark after:
32 10000 1 0.054 0.112 0.48
32 10000 4 0.206 0.093 2.21
32 10000 32 1.826 0.091 20.12
32 100000 1 0.292 0.636 0.46
32 100000 4 2.086 0.606 3.44
32 100000 32 28.496 0.633 45.03
128 10000 1 0.125 0.266 0.47
128 10000 4 0.759 0.258 2.94
128 10000 32 7.362 0.254 29.03
128 100000 1 1.550 2.18 10.71
128 100000 4 8.712 2.22 23.92
128 100000 32 122.585 2.213 55.39
PiperOrigin-RevId: 157414849
---
Commit 62cf561f1 authored by Jianwei Xie<xiejw@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add numpy_input_fn integration for LinearRegressor and fix the expand_dim for label and weight.
PiperOrigin-RevId: 157405237
---
Commit 40c7e0dd7 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Go: Update generated wrapper functions for TensorFlow ops.
PiperOrigin-RevId: 157402364
---
Commit 2726c00ce authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update ops-related pbtxt files.
PiperOrigin-RevId: 157402063
---
Commit e9d2fba8f authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix comment describing ignore_longer_outputs_than_inputs.
PiperOrigin-RevId: 157400110
---
Commit 5f097217f authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
An initial step of eliminating all implicit broadcast at the HLO level.
Guard the shape inference for binary ops behind a flag.
PiperOrigin-RevId: 157373647
---
Commit e78e5ec8a authored by Yangzihao Wang<yangzihao@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Set winograd nofused flag to be true by default.
Disable winograd nonfused conv for certain input params to avoid a known bug in cuDNNv5 and cuDNNv6.
PiperOrigin-RevId: 157352847
---
Commit 3f9b69a50 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
In the CUDA path of depthwise_conv2d, add a fast variant for forward convolution when the input images are smaller than 16x16.
PiperOrigin-RevId: 157347823
---
Commit 848123e61 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix incorrect condition to instantiate depthwise_ops introduced in commit 15d9f00fa. The change should have excluded depthwise_conv2d for doubles on windows debug builds, but it excluded it for all windows and all debug builds.
PiperOrigin-RevId: 157345929
---
Commit 060d67b34 authored by Taehoon Lee<taehoonlee@snu.ac.kr>
Committed by Taehoon Lee<taehoonlee@snu.ac.kr>:
Fix typos
---
Commit 409419bcc authored by Mark Daoust<markdaoust@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
add closing code quotes
PiperOrigin-RevId: 157339360
---
Commit d20d0a623 authored by Jonathan Hseu<jhseu@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix the contrib estimator_test by updating the global step in all the appropriate spots.
PiperOrigin-RevId: 157328239
---
Commit d1144d3a9 authored by Juang, Yi-Lin<b02901026@ntu.edu.tw>
Committed by Juang, Yi-Lin<b02901026@ntu.edu.tw>:
Fix typos
---
Commit fa8bb43b1 authored by lanhin<lanhin1@gmail.com>
Committed by lanhin<lanhin1@gmail.com>:
Fixed a comment typo in GraphView:InitializeNode(), executor.cc.
---
Commit 9f13ae93f authored by Asim Shankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Java: Update Maven release to 1.2.0-rc1
PiperOrigin-RevId: 157294719
---
Commit c8256769c authored by Gunhan Gulsoy<gunan@google.com>
Committed by Gunhan Gulsoy<gunan@google.com>:
Address comments and sanity check failures.
---
Commit 344225a60 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update ops-related pbtxt files.
PiperOrigin-RevId: 157292254
---
Commit eb2f6d041 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
VLOG(2) instead of VLOG(1) for detailed op printouts.
PiperOrigin-RevId: 157291238
---
Commit b4466279a authored by Shanqing Cai<cais@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
tfdbg: add runtime shape and dtype info to DebugNumericSummary
PiperOrigin-RevId: 157291215
---
Commit 4fb2425f8 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add GraphOptimizer to Grappler item builder to do L1 optimizations and
inlining.
Op Counts Comparison (BNMT)
Counts: Profile vs Grappler
Op: Add, 968 vs 965
Op: AddN, 2228 vs 2228
Op: ApplyGradientDescent, 84 vs 84
Op: BatchMatMul, 998 vs 998
Op: Identity, 142 vs 105
Op: MatMul, 63 vs 63
Op: Mul, 10318 vs 10306
Op: OneHot, 1 vs 1
Op: Reshape, 8421 vs 8422
Op: Select, 488 vs 488
Op: Shape, 8132 vs 8131
Op: Sigmoid, 942 vs 942
Op: Softmax, 19 vs 19
Op: StridedSlice, 58 vs 74
Op: Sub, 1398 vs 1394
Op: Tanh, 333 vs 333
Op: Tile, 21 vs 21
Op: Transpose, 39 vs 39
PiperOrigin-RevId: 157288420
---
Commit 8918fa9ef authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
BEGIN_PUBLIC
Automated g4 rollback of changelist 157272843
PiperOrigin-RevId: 158534336
Pull request #8606 added str(Label(...)) for most dependencies in
tensorflow.bzl, allowing most functions to be used from repositories which
include TensorFlow as a submodule. Unfortunately, it broke when pulled into
Google and was removed in cl/152200430. This CL restores the change, except
for two Android-only functions; these were the only problematic bits.
Change: 152297413
The deps of the "framework" target did not reflect the actual imports
used in those files. Adding the missing deps causes circular
dependencies, so this patch refactors "framework" into per-file
targets. It still exposes the "framework" and
"framework_for_generated_wrappers" to avoid breaking the many targets
that have these as dependencies.
Change: 148834459
- Linking a version of the entire proto library with every .so is wasteful.
- Causes duplicate destruction of the static initialized objects causing
non-deterministic crashes.
Change: 147220106
functions for C++. A souped-up version of the hidden_ops mechanism in
Python, the intent is to use this for most or all of the client
languages, with a common list of changes to make in a common file and
per-language overrides.
Also:
* include the documentation for outputs in the generated comments
* several updates to C++ API to match Python
* fix C++ shape function for ConcatV2 now that we use it by default
* split op_gen_lib out of core:framework, since it is only used by
the op generators, and I don't want to add another proto to
mobile builds
Change: 146267344
Allow users of tf_gen_op_wrapper_cc() to override the deps of the rule, similar to tf_gen_op_wrapper_py().
Remove some unnecessary op dependencies from tensorflow/compiler/tf2xla/.
Change: 144774549
Additionally:
- change single quotes to double quotes to make path rewriting easier
- guard windows lib reference with PLATFORM_WINDOWS
- fixed failing kmeans test
Change: 141515942
SSE4.1 is widely available, and enabling this helps overall CPU performance. It does mean that unsupported machines will crash with an illegal instruction error.
Change: 141331377
- Eigen and Neon intrinsics based implementations.
- Added test suitable for regressions and standalone runs on Android.
- Made it possible to compile the C++ API on android platform, so it's easy
to write tests.
Change: 141326710
SSE4.1 is widely available, and enabling this helps overall CPU performance. It does mean that unsupported machines will crash with an illegal instruction error.
Change: 141217999
an ambiguous way to designate (1) the deps attribute of each generated
tf_kernel_library target, and (2) associated tf_kernel_library targets for ops
which should be included as dependencies of the omnibus cc_library target
(for example, :dilation_ops.)
As a result, each individual op library brought in the deps of all the others
along with dependencies on unrelated ops.
Change: 140657643
specify additional tf_kernel_library targets that should be grouped into the
omnibus cc_library target that includes all generated rules, but should not be
considered dependencies of each individual generated tf_kernel_library target.
Use the new attribute to split out some existing deps entries and avoid
unnecessary transitive dependencies.
Split out the :l2loss_op library so that it doesn't share the same deps list
with the rest of the "nn" libraries, in particular avoiding a dependency on
:pooling_ops which in turn depends on the expensive :eigen_helpers.
Likewise, split out :lookup_table_{init_}op from the "data_flow" libraries.
Change: 137887998
This change allows Bazel to fetch and build SWIG rather than getting it
from the system. This change also improves the i/o performance of the
SWIG build, makes it hermetically sealed, and ensures tf_py_wrap_cc()
can function correctly across Bazel repositories.
CC: #4983
Change: 136783531
headers from "core:framework" target like we do for framework_headers_lib,
so that it is available in the pip package consistently.
Tested by building the wheel with this change and validating that
the files were in site-packages/tensorflow/include/tensorflow/core/framework,
etc.
Fixes#4996.
Change: 136664737
This includes ~200 -Wsign-compare warnings in TensorFlow, 15
-Wimplicit-function-declaration warnings in zlib, and more.
I'm also working on getting rid of 400 protobuf warnings here:
google/protobuf#2261
Change: 136555503
It is necessary to symlink in files from .git/ in order to make
bazel aware of changes to the current head. As it is this is not
completely reliable when git repositories are in a dirty index
state. First class support for bazel git a reported bug but
not a high priority.
./configure sets up the symlinks by calling the gen_git_source.py
a bazel genrule calls gen_git_source.py to generate version_info.cc
Also changed cmake and make to build this properly.
Change: 132328009
It is about 2-3x faster compared to rnn_cell.LSTMCell and lstm_ops.LSTMBlockCell.
Cudnn LSTM speedup Cudnn LSTM speedup
over rnn.LSTMCell over rnn.LSTMBlockCell
large 200.00% 192.27%
medium 247.75% 228.38%
small 500.00% 438.10%
The step-time per second for each model size.
Cudnn LSTM rnn_cell.LSTMCell lstm_ops.LSTMBlockCell
large 0.0854 0.2562 0.2496
medium 0.0222 0.0772 0.0729
small 0.0042 0.0252 0.0226
TESTED:
- opensource_build
https://ci.tensorflow.org/job/tensorflow-cl-presubmit-multijob/4568/
- passed unit tests
Change: 131472315
This change ensures that GOOGLE_CUDA=1 when compiling .cc files with --config=cuda enabled (also includes other important copts like -fno-exceptions.)
Change: 129242223
