Commit Graph

70 Commits

Author SHA1 Message Date
Shanqing Cai
cae8ed1ca5 Fix build scripts for MKL () 2017-05-05 15:16:04 -07:00
Vijay Vasudevan
15b8f3d65c Merge commit for internal changes 2017-05-04 21:31:53 -07:00
Vivek Rane
27dd167c5f Enable MKL in configure and various bug fixes ()
* relu grad and maxpooling grad fixes for perf

* Graph layout pass and conversion pass changes

This commit makes following changes:

- Enables support for ReluGrad and BiasAddGrad
- Adds support for detecting depthwise/batchwise pooling
- Adds more unit tests for Graph rewrite pass
- Improvements to handling control-flow edges
- Bug fixes

* Defaulting to Eigen when LRN depth_radius!=2

* Fixed mkl_conv_grad_filter.cc for conv_ops_tests.py

* Style fix to mkl_matmul and remove unnecessary 'MKL' label on matmul kernel

* Style fixes based on clang-format to mkl_conv_* and mkl_matmul

* Bug fixes

* Adding OP_REQUIRES_OK check in Concat

* Making some style changes

* Enabled the configuration of MKL settings

* relu grad and maxpooling grad fixes for perf

* Graph layout pass and conversion pass changes

This commit makes following changes:

- Enables support for ReluGrad and BiasAddGrad
- Adds support for detecting depthwise/batchwise pooling
- Adds more unit tests for Graph rewrite pass
- Improvements to handling control-flow edges
- Bug fixes

* Defaulting to Eigen when LRN depth_radius!=2

* Fixed mkl_conv_grad_filter.cc for conv_ops_tests.py

* Style fix to mkl_matmul and remove unnecessary 'MKL' label on matmul kernel

* Style fixes based on clang-format to mkl_conv_* and mkl_matmul

* Bug fixes

* Adding OP_REQUIRES_OK check in Concat

* Making some style changes

* Enabled the configuration of MKL settings

* Fixing graph unit tests with Mkl op name change to _Mkl; Fixed missing _ in MklToTf op

* Fixed missing libdl.so.2 in BUILD file

* Fixes for unit test build failures.

* Changes in mkl_conv_grad_filter_ops.cc for Google code style

* Fixes to remove dead code

* removed the dead code and added a TODO for mkl implementation to handle this case in the future

* Fixed buildifier sanity check error

* Adding support for google's CI automation

* Updated link to new MKL version

* Fix for missing locate command in CI

* Adding updatedb to populate the database after installing mlocate

* Fixed buildifier issue

* setting tf_need_mkl=0 in libtf files

* Added third_party/mkl/* to .gitignore

* Added third_party/eigen3/mkl_include to .gitignore

* In configured, set MKL-enabling options only for Linux.
2017-05-04 14:02:25 -07:00
László Csomor
9340f27ae1 Fix Bazel CI / TensorFlow project. ()
This change:

1. updates common_env.sh to export PYTHON_LIB_PATH
along with PYTHON_BIN_PATH so the configure
scripts doesn't have to guess

2. writes these paths to bazelrc with quotes
around, to guard agains spaces in the path (e.g.
"C:/Program Files/Anaconda3/python")

Fixes https://github.com/bazelbuild/bazel/issues/2892
2017-05-04 13:19:05 -07:00
Patrick Nguyen
3bee923c93 Use $opt defined in the loop rather than raw string.
Fixes .
Change: 155089799
2017-05-04 10:07:38 -07:00
Vijay Vasudevan
22586bdf90 Branch 154885009 ()
* Enable grappler to propagate shapes through queues.
Change: 154789133

* Add whitelist support in uid of RunConfig.
Change: 154794859

* Fix a bunch of bad links and missing docs in contrib.
Change: 154820641

* Don't try to refine the shapes for a node if its inference context wasn't
successfully built by the AddNode() method.
Change: 154838211

* Fix issue related to empty bazel.rc file.
Change: 154840138

* Remove overly precise CHECK when rendering debug output for a function.

An `_Arg` node can have more than three attrs, because the runtime may
(and does) add system-defined attrs (viz. "_output_shapes") that do
not change the meaning of the op.
Change: 154850526

* Port makefile build breakage
Change: 154855106

* [TF:XLA] Try to incorporate Tensorflow node structure for large HLO GraphDefs.

This change assumes that a TF subgraph/op does not cross the boundary of a HLO
computation and always put top-level TF subgraphs/ops under HLO computations.
Change: 154855884

* Added a unit test to check what happens when 2 shapes with known rank but
unknown dimensions are merged
Change: 154856675

* [XLA] Refactor constant folding operations into a dedicated module

Refactor constant folding operations into a dedicated module, and added a new
ReplaceInstruction() API to collapse { computation->ReplaceInstruction();
changed=true}.
Change: 154857025

* Java: Docs: Update instructions for Windows.

Inspired by
http://stackoverflow.com/questions/43741775/tensorflow-in-java-running-failed
Change: 154859066

* Add more documentation for features and labels.
Change: 154859649

* Added link to high-performance models
Change: 154860213

* Navigation and index for new performance section documents.
Change: 154862215

* Fix shape mismatch between loss and weights.
Change: 154862650

* Add examples to TensorShape documentation and ran autoformatter.
Change: 154862667

* Move linking of cudnn_plugin, cublas_plugin and cufft_plugin from
stream_executor to the ops that need them.
Change: 154863520

* Properly track the persistent memory usage of lookup tables.
Change: 154866686

* Reset the inputs to ShapeRefiner::RunShapeFn so that it behaves the same every time it's called.
To properly handle queues that have populated by several enqueue ops, merge the shapes of the inputs to all the enqueue ops before calling InferenceContext::set_output_handle_shape(). This ensures that we detect incorrect queue setups (where the 2 enqueue ops might generate tensors with incompatible shapes), and that we take all the known shape information instead of that of just one of the enqueue ops.
Change: 154866747

* Making sure an error message will be produced by session_manager when a non-tensor object is passed in.
Otherwise the 'name' property is missing.
Change: 154868022

* Don't needlessly synchronize the CUDA stream in CropAndResize.
Make the op Async so we don't block an executor thread while waiting for the result of the box bounds check to be copied back to the host.
Change: 154868460

* Add contribution guidelines and standards section to CONTRIBUTING.md

Several parts are largely based on the post by @yaroslavvb at: #7443#issuecomment-279182613

Fixes 
Change: 154876045

* Final draft
Change: 154876563

* Final draft
Change: 154876646

* Fix losses documentation.

Fix documentation of get_total_loss() to be correct.
And add a helpful comment about a common pitfall.
Change: 154876822

* [XLA] Second change for HLO interpreter.

Extends HloEvaluator to allow evaluation of HLO Computation or single HLO instruction
with non-constant operands, by traversing the instruction in post order and keeps track of
each instruction along the way as evaluated literals.
Change: 154877580

* [tf distributions] Move the remaining whitelisted distributions to core.
Change: 154878206

* Add shape to error message.
Change: 154880260

* Revert "Fix build issue when `/usr/bin/python` path is not available ()"

This reverts commit 95f37ebf0b.
2017-05-03 12:25:10 -07:00
A. Unique TensorFlower
aaa5600245 Fix issue related to empty bazel.rc file.
Change: 154840138
2017-05-02 09:49:37 -07:00
Julian Villella
53a60aedd3 Replace sed_hyphen_i() with portable implementation () 2017-05-01 22:20:03 -07:00
Gao, Xiang
58cd0f404e make configure smarter in detecting cuda ()
* make configure smarter in detecting cuda

* Remove variable
2017-05-01 18:31:43 -07:00
A. Unique TensorFlower
79789dd5ab Removing python_config.sh, moved functionality asking users for input to root configure moved lib checks to python_configure.bzl
Change: 154412830
2017-04-27 06:13:19 -07:00
Shanqing Cai
326942394e Merge changes from github.
Change: 153925676
2017-04-22 07:28:38 -07:00
A. Unique TensorFlower
8e0d6f12ef Automated rollback of change 153736477
Change: 153825726
2017-04-21 07:48:35 -07:00
Shanqing Cai
3a39b41b97 Automated rollback of change 153709951
Change: 153736477
2017-04-20 12:05:32 -07:00
A. Unique TensorFlower
7933420df6 Adding python_configure.bzl to (partially) replace python_config.sh
Change: 153709951
2017-04-20 08:30:56 -07:00
A. Unique TensorFlower
8268476073 Fix ./configure script
1. Add %workspace% in .bazelrc file when using import statement
2. Write action_env into bazelrc file for required environment variables for OpenCL support
Change: 152290700
2017-04-05 12:53:31 -07:00
A. Unique TensorFlower
ccbc8991db Merge changes from github.
Change: 152200430
2017-04-04 17:24:57 -07:00
A. Unique TensorFlower
8d393ea2fa Add cuda_clang build configuration that allows to use clang as a CUDA compiler.
Change: 151705528
2017-03-30 08:54:57 -07:00
Martin Wicke
bc456e361d Merge changes from github.
Change: 151046259
2017-03-23 13:44:29 -07:00
Asim Shankar
429d14d435 configure: Add option to restrict bazel targets fetched.
Use that option to restrict the Windows C and Java library release
builds to the 4 targets that are actually built.
Change: 149990258
2017-03-13 14:47:46 -07:00
Dandelion Mané
0386a01ad3 Merge changes from github.
Change: 149800363
2017-03-10 15:18:15 -08:00
Vijay Vasudevan
93a975e114 Merge changes from github.
Change: 147897309
2017-02-17 17:23:48 -08:00
Benoit Steiner
639b4e71f5 Merge changes from github.
Change: 146918929
2017-02-08 09:50:05 -08:00
Eugene Brevdo
ce2a102760 Add xla target for tensorflow tests that request them.
Change: 145856327
2017-01-27 17:46:06 -08:00
Andrew Harp
51dbc46483 Delete downloaded BUILD files for makefile dependencies immediately after extracting and also at the beginning of ./configure. This will prevent bazel from erroneously parsing contrib/makefile/downloads during configuration if a makefile build has previously been performed.
Change: 145838744
2017-01-27 15:08:59 -08:00
Eugene Brevdo
8fc3981e02 Automated rollback of change 145703555
Change: 145809900
2017-01-27 10:45:00 -08:00
Eugene Brevdo
13a1a9a71c Make LSTMCell use Defuns to speed up static graph builds, add compiled flag.
Change: 145703555
2017-01-26 12:31:21 -08:00
Shanqing Cai
56fc8834c7 Merge changes from github.
Change: 145363673
2017-01-23 18:45:23 -08:00
Jonathan Hseu
c058a01d99 In ./configure, only ask about jemalloc when running on Linux.
Also add functions to test whether we're running on Linux or macOS, and convert
every check over to them.

Fixes 
Change: 144761341
2017-01-17 15:48:13 -08:00
Patrick Nguyen
db24941489 Merge changes from github.
Change: 144729490
2017-01-17 11:15:18 -08:00
Gunhan Gulsoy
acdbd68986 Create --config opt for compiling fully optimized binaries.
Change: 144609556
2017-01-16 01:47:31 -08:00
Martin Wicke
c4e3d4a74e Enable customization of architecture dependent compiler optimizations via configure, defaulting to -march=native.
Change: 144470919
2017-01-13 12:25:28 -08:00
Jonathan Hseu
83c6e0c63a Switch open-source to use jemalloc for CPU Tensor memory allocation, gRPC, and other places where we call malloc/free.
- Only enabled on Linux for now.
- Added as a ./configure option defaulting to enabled.
Change: 144266237
2017-01-11 16:45:22 -08:00
Peter Hawkins
1e67c90e2c Initial open-source release of XLA: Accelerated Linear Algebra.
XLA is a compiler-based linear algebra execution engine that targets CPUs, GPUs and custom accelerators.

XLA is still experimental; we are releasing it early to get the community involved.
Change: 143990941
2017-01-09 12:26:35 -08:00
Shanqing Cai
efd40e5b73 Merge changes from github.
Change: 143922699
2017-01-08 20:47:05 -08:00
Rohan Jain
aab099711d Merge changes from github.
Change: 143710639
2017-01-05 14:46:39 -08:00
A. Unique TensorFlower
46d2c28604 Merge changes from github.
Change: 143412147
2017-01-02 22:27:38 -08:00
A. Unique TensorFlower
95a954ab39 Remove default support for Google Cloud Platform that was introduced recently.
Some users do not want or need this support and it significantly increases
their dependencies and binary sizes.  After this change, users must explicitly
depend on :gcs_file_system to enable this support.
Change: 143129406
2016-12-28 13:58:59 -08:00
Justine Tunney
bb890ea5fa Make TensorFlow build libcurl from scratch
Google Cloud Platform support is now available for everyone by default.

Fixes 
Change: 143077241
2016-12-27 21:08:52 -08:00
Jonathan Hseu
bed8383c27 Merge changes from github.
Change: 142805270
2016-12-22 15:48:41 -08:00
Martin Wicke
2e4869af1a Merge changes from github.
Change: 142074581
2016-12-14 16:04:11 -08:00
Andrew Harp
1cb96893a6 Merge changes from github.
Additionally:
- change single quotes to double quotes to make path rewriting easier
- guard windows lib reference with PLATFORM_WINDOWS
- fixed failing kmeans test
Change: 141515942
2016-12-08 20:21:45 -08:00
Benoit Steiner
a771598ad8 Merge changes from github.
Change: 138675832
2016-11-09 13:48:22 -08:00
Justine Tunney
1dba78b997 Automatically build SWIG from source
This change allows Bazel to fetch and build SWIG rather than getting it
from the system. This change also improves the i/o performance of the
SWIG build, makes it hermetically sealed, and ensures tf_py_wrap_cc()
can function correctly across Bazel repositories.

CC: 
Change: 136783531
2016-10-20 18:04:26 -07:00
Patrick Nguyen
c5ab3dd177 Merge changes from github.
Change: 136750267
2016-10-20 13:19:03 -07:00
A. Unique TensorFlower
edaf3b342d Merge changes from github.
Change: 135698415
2016-10-10 11:35:00 -07:00
Jonathan Hseu
1283b84a49 Merge changes from github.
Change: 134721831
2016-09-29 16:17:09 -07:00
Jonathan Hseu
9f5b098f77 HDFS support
Notes:
- The test is tagged as manual, and you must download the Hadoop distribution to run it.
- We ask during ./configure whether to include HDFS support.
- Copied hdfs.h from Hadoop here in third_party. It's licensed Apache 2.0.
Change: 133615494
2016-09-19 12:17:00 -07:00
Andrew Selle
09045e49d1 Include sha hash in python variable __version__
It is necessary to symlink in files from .git/ in order to make
bazel aware of changes to the current head. As it is this is not
completely reliable when git repositories are in a dirty index
state. First class support for bazel git a reported bug but
not a high priority.

./configure sets up the symlinks by calling the gen_git_source.py
a bazel genrule calls gen_git_source.py to generate version_info.cc

Also changed cmake and make to build this properly.
Change: 132328009
2016-09-06 09:32:49 -07:00
A. Unique TensorFlower
b0bdff4827 Merge changes from github.
Change: 131437429
2016-08-26 14:01:27 -07:00
A. Unique TensorFlower
2c598e874e Merge changes from github.
Change: 131310818
2016-08-25 11:32:33 -07:00