Commit Graph

5427 Commits

Author SHA1 Message Date
TensorFlow Release Automation
82515cee8f Update version numbers to 2.3.0 2020-07-23 11:05:30 -07:00
Geeta Chavan
1f610fc5ae Updating version for final release 2020-07-22 17:44:09 -07:00
Geeta Chavan
44e3817ad0 Updating version for final release 2020-07-22 17:39:39 -07:00
A. Unique TensorFlower
2ef4243a20 Update tensorboard dependency to 2.3.x
TensorBoard release: https://pypi.org/project/tensorboard/2.3.0/

PiperOrigin-RevId: 322474571
Change-Id: I7cb6bcbb101cb9b10d04b832279e62ea9066abca
2020-07-22 10:43:37 -07:00
Goldie Gadde
bb3c460114
Merge pull request from tensorflow-jenkins/version-numbers-2.3.0rc2-11909
Update version numbers for TensorFlow 2.3.0-rc2
2020-07-17 12:45:59 -07:00
TensorFlow Release Automation
f989a28561 Update version numbers to 2.3.0-rc2 2020-07-17 09:34:18 -07:00
Andrew Audibert
6b9a9d98bb Update "master" to "dispatch"/"dispatcher" in tf.data service terminology.
Dispatcher is more descriptive and follows the guidance in https://developers.google.com/style/word-list#master

PiperOrigin-RevId: 321613785
Change-Id: Iaa576d35f0581e21278101f8b31201ba737a6865
2020-07-16 13:07:28 -07:00
Mihai Maruseac
0b2321fdd1
Fix typo in estimator min bound
Should be `2.3.0rc0`, not `2.3.0-rc0`
2020-07-15 17:25:43 -07:00
Geeta Chavan
2f2ace8bc3 Updated estimator version 2020-07-07 14:25:36 -07:00
TensorFlow Release Automation
f89998cac6 Update version numbers to 2.3.0-rc1 2020-07-07 12:04:07 -07:00
Austin Anderson
5af8da4a17 Fix docker for numpy again
I forgot about the trouble using '<' in pip dependencies on the CLI.
This time I verified the build works.

PiperOrigin-RevId: 318332763
Change-Id: I347aee8121464232222e72d89409c600159ee80c
2020-06-25 16:51:08 -07:00
Austin Anderson
04bd81d7e6 Pin numpy below 1.19.0 in Dockerfiles
See .

PiperOrigin-RevId: 318122157
Change-Id: Ief46c5610f3aaf0cdd7d43ce1a10d6d87e8e8e01
2020-06-25 16:50:51 -07:00
A. Unique TensorFlower
f41584353a Add the "--define=no_tensorflow_py_deps=true" flag for the windows cpu release
builds.

PiperOrigin-RevId: 317968971
Change-Id: I7d4db21474d85620928f3a5ffb1e4cfebaa2be9f
2020-06-23 17:33:10 -07:00
Goldie Gadde
f9ca9abe78 Update setup.py 2020-06-23 14:19:47 -07:00
TensorFlow Release Automation
8d12b76309 Update version numbers to 2.3.0-rc0 2020-06-23 14:19:47 -07:00
Rick Chao
4d13d6416d Make cluster_resolver standard property in tf.distribute strategies.
PiperOrigin-RevId: 317771299
Change-Id: I71b5c585cef7bd7ef80e66b75e30287fddcf89e2
2020-06-22 18:19:14 -07:00
A. Unique TensorFlower
8c08608ff8 fix the numpy version to 1.16.0
PiperOrigin-RevId: 317743030
Change-Id: I8ac4e0c30cb67cfc611d351ba405e2b94e57c04a
2020-06-22 15:21:15 -07:00
Rick Chao
61c2e69663 Make task_type and task_id standard properties in tf.distribute cluster resolvers.
PiperOrigin-RevId: 317736970
Change-Id: Ia9c76462afc4c2fcc42a149960b50b2cbcafd482
2020-06-22 14:48:14 -07:00
Mihai Maruseac
79518facb4 Upper bound numpy dependency to 1.19.0.
Since `numpy==1.19.0` contains at least one breaking ABI change (), we need to either upper bound the dependency's range or fix our code to support both ABIs. Since the second requires more changes, we prefer the first one for now.

PiperOrigin-RevId: 317699730
Change-Id: Ia62a779f9ec42d63d3fac1b69cd75e6084358d2f
2020-06-22 12:28:41 -07:00
Christian Sigg
9b1e89b77c Add RBE Dockerfile for CUDA11+cuDNN8.
PiperOrigin-RevId: 317626204
Change-Id: I75d4dc8dbde5dd4f3c59e047afe38043cbfb5a1c
2020-06-22 04:02:13 -07:00
Ruoxin Sang
39a2286a0e Graduate TPUStrategy from experimental.
RELNOTES=Make TPUStrategy symbol non experimental.
PiperOrigin-RevId: 317482072
Change-Id: I8bf596729699cb02fa275dfb63855c2dc68c1d42
2020-06-20 13:10:50 -07:00
Ruoxin Sang
ae78d9c315 Add a TPUClusterResolver.connect API to simplify TPU initialization.
RELNOTES=Add a `tf.distribute.cluster_resolver.TPUClusterResolver.connect` API to simplify TPU initialization.
PiperOrigin-RevId: 317439811
Change-Id: I2f1a944f3c440356b21da27a72855c969f1c3b3b
2020-06-20 00:09:59 -07:00
Austin Anderson
f51b649394 Experimental internal CI changes
PiperOrigin-RevId: 317402932
Change-Id: Ibaef72f01e06f4518b85b21f82000599eed7e4bd
2020-06-19 16:47:47 -07:00
TensorFlower Gardener
2696475d77 Merge pull request from Intel-tensorflow:shwetaoj/enable_openmpi_horovod_docker
PiperOrigin-RevId: 317312853
Change-Id: I7a0b5ceb807428b98067067018a64aa44c3a5fdb
2020-06-19 08:38:23 -07:00
Xinyi Wang
158d4be42d Add get_next_as_optional method for a distributed iterator
The function is called on a distributed iterator and returns an `Optional` that contains the next value, the PerReplica input, from Distributed iterator or no value if this `iterator` has reached the end of the sequence.

PiperOrigin-RevId: 317248910
Change-Id: Ide217da1aff1d62f8d0d8f43423be2d859d933d3
2020-06-18 22:18:33 -07:00
TensorFlower Gardener
3d868aa1c6 Merge pull request from wwwind:interface_16x8
PiperOrigin-RevId: 317232781
2020-06-18 19:47:52 -07:00
Scott Zhu
0deffad6ac Make return_state as explicit kwarg in the Conv2DLSTM layer.
It was previously hide in the **kwargs, and we are also missing documentation for it.

The existing test case should already cover the functionality of it.

PiperOrigin-RevId: 317197835
Change-Id: Icfae1e177eeb886b41345078f6b93f282a94df5b
2020-06-18 15:55:19 -07:00
TensorFlower Gardener
f84adde4cf Merge pull request from cclauss:Fix-SyntaxWarnings
PiperOrigin-RevId: 317145119
Change-Id: I724dda9028bcacd21ba04b4f6f81d013247617f2
2020-06-18 11:48:25 -07:00
Srinivas Vasudevan
455750f362 Add StatelessParameterizedTruncatedNormal sampler.
This sampler supports broadcasting of its input parameters as well as puts the # samples at the left of the output shape, rather than the right.

PiperOrigin-RevId: 317129622
Change-Id: I4b62ad2e89a9637ae8b30b73af4b662ad0caa943
2020-06-18 10:28:38 -07:00
Srinivas Vasudevan
89b80c5fb9 Add banded triangular solve op.
PiperOrigin-RevId: 317124054
Change-Id: I54f090d7583b21fa18788a2deb02262d9c8231be
2020-06-18 10:03:35 -07:00
shwetaoj
55929ce6ae Reverting == in Dockerfile 2020-06-18 07:27:13 -07:00
shwetaoj
c65fccf0a6 Format changes as per Google's feedback 2020-06-18 07:26:58 -07:00
Srinivas Vasudevan
4f341bb742 Add Bessel functions to the public api:
- tf.math.special.bessel_i0
    - tf.math.special.bessel_i0e
    - tf.math.special.bessel_i1
    - tf.math.special.bessel_i1e
    - tf.math.special.bessel_k0
    - tf.math.special.bessel_k0e
    - tf.math.special.bessel_k1
    - tf.math.special.bessel_k1e
    - tf.math.special.bessel_j0
    - tf.math.special.bessel_j1
    - tf.math.special.bessel_y0
    - tf.math.special.bessel_y1

PiperOrigin-RevId: 317025879
Change-Id: I5c4407eda6bef0d1659b7a566979c7dbbad4ad83
2020-06-17 21:06:09 -07:00
Xinyi Wang
c0ba8a09a7 Export and Document DistributedDataset and DistributedIterator APIs
PiperOrigin-RevId: 317007583
Change-Id: I7d7c4615a12a19fb4fd151a0457f176ffe2cd765
2020-06-17 18:27:33 -07:00
Ken Franko
7a92859246 Add SaveOptions/CheckpointOptions to keras.Models.save_weights and keras_call_backs.ModelCheckpoint.
PiperOrigin-RevId: 316973333
Change-Id: I43f5b59ece4b862db41ab0e99f3c8df0a0d3b901
2020-06-17 15:09:44 -07:00
Edward Loper
b780ee931b Replace the mechanism used to register & look up Python types from c code in tensorflow/python/util.h with one that supports non-type symbols as well.
PiperOrigin-RevId: 316904361
Change-Id: I4ec98c861742efddcebd140ff9e1a6ff567cc94c
2020-06-17 09:43:37 -07:00
Scott Zhu
12ec80d239 Move the module test wrt to Keras private API to keras test.
PiperOrigin-RevId: 316695477
Change-Id: I4201f62e97bb1acb768b980a51d26bf0c76853ab
2020-06-16 09:23:32 -07:00
Bruce Fontaine
d29d8af754 Add InputOptions to experimental_distribute_dataset(s_from_function).
PiperOrigin-RevId: 316563848
Change-Id: I00d54d309395754a6182829725f42e1f968f14c4
2020-06-15 16:05:58 -07:00
Ken Franko
67fb07ba9f Add load option for loading SavedModel from specific io_device for distributed training.
A new class LoadOptions is created similar to the existing SavedOptions.  The option experimental_io_device is the only option added at this time and usd to set the io_device when loading a SavedModel for distributed training.

PiperOrigin-RevId: 316557681
Change-Id: If3f1eae18b09085ff11dc8a6882fabcb18f5f48e
2020-06-15 15:34:47 -07:00
Shanqing Cai
a8950d70bf [tfdbg2] Add tfdbg_run_id to metadata of data dumps
- A data dump file set generated by tfdbg2 can contain
  multiple subsets when there are multiple hosts involved
  in the instrumented TensorFlow job (e.g., TPUs and Parameter Servers).
  Currently, there is no bit in those subset of files that
  indicates they belong to the same instrumented TF job.
  - This CL addresses this problem by adding a field to the
    metadata proto used by those files (`tfdbg_run_id`)
- The DebugEventsWriter code is revised, so that this new
  field is written to the metadata file of the file set on the writer's
  construction.
- Also in this CL: remove the previous 1-arg `GetDebugEventsWriter(dump_root)`
  that creates the writer object if it doesn't exist at the specified
  dump_root. Replace it with `LookUpDebugEventsWriter(dump_root)` that only
  looks up the writer object and returns a non-OK status if such an object
  hasn't been created at `dump_root`. This makes the code less error prone by
  keeping only the fully-explicit, 3-arg `GetDebugEventsWriter()`.

PiperOrigin-RevId: 316537044
Change-Id: Id5be0b771fbf37c0fc796f1514ed858a0e6d38f0
2020-06-15 13:52:52 -07:00
A. Unique TensorFlower
694b502173 Fix Windows breakage.
PiperOrigin-RevId: 316173528
Change-Id: Ie6a759f7cf44d1db0acdf742fde48a837e0fb433
2020-06-12 14:21:07 -07:00
TensorFlower Gardener
ad4363bdcf Merge pull request from freedomtan:export_SetNumThreads_to_tflite_python
PiperOrigin-RevId: 316137187
Change-Id: I12729a4f760b786a57c36a481261f6232f7d3fee
2020-06-12 11:13:35 -07:00
Reed Wanderman-Milne
da9adcc701 Fix Windows breakage.
The breakage was caused by bef9713188.

PiperOrigin-RevId: 316010735
Change-Id: Ifeb048342a8e8ed306f3481bc98d2871f5b28355
2020-06-11 17:32:39 -07:00
Jiri Simsa
cfe037e3fe [tf.data] API changes.
This CL makes the following tf.data API-related changes:
1) `tf.data.Iterator` and `tf.data.IteratorSpec` are exposed in the v2 API
2) `tf.experimental.Optional` is exposed in the API (previously exposed as `tf.data.experimental.Optional`)
3) `tf.experimental.Optional.none_from_structure` and `tf.experimental.Optional.value_structure` is renamed to and `tf.experimental.Optional.empty` and `tf.experimental.Optional.element_spec` respectively
4) `tf.OptionalSpec.value_structure` is renamed to `tf.OptionalSpec.element_spec`
5) reflects these changes in documentation and code
6) adds testable docstring for newly exposed APIs

PiperOrigin-RevId: 316003328
Change-Id: I7b7e79942308b3d2f94b988c31729980fb69d961
2020-06-11 16:46:30 -07:00
Tomer Kaftan
7933b0e5e3 Export and add dispatch to overloaded tensor operators (that were not already exported under different api symbols) under the hidden namespace tf.__operators__.
This will make these built-in operators more amenable to dispatching for library developers.
This includes:
tf.__operators__.add
tf.__operators__.ne
tf.__operators__.eq
tf.__operators__.getitem

PiperOrigin-RevId: 315998480
Change-Id: Icf61e24a2c037eaf2c4d170967eb2b8ac18f5961
2020-06-11 16:20:41 -07:00
Jiri Simsa
4d58a67a9f [tf.data] Implementation of tf.data.experimental.save and tf.data.experimental.load. The former makes it possible to save the output of a dataset, while the latter makes it possible to load a previously saved data.
Fixes: 38483
PiperOrigin-RevId: 315991164
Change-Id: I30da604fdd489902ff4771b685e413447d3e9e9d
2020-06-11 15:37:49 -07:00
Mihai Maruseac
2bd19c69ae Move fft2d to stable fork
Release is at https://github.com/petewarden/OouraFFT/releases/tag/v1.0

PiperOrigin-RevId: 315986633
Change-Id: I94323922d827a79f3e1dce58acff7e91640b8e9c
2020-06-11 15:12:44 -07:00
Amit Patankar
5471319340 Fix a file typo for libtensorflow.
PiperOrigin-RevId: 315984335
Change-Id: Ie397ade323ea62c6abd450c86eb26f72bbf48082
2020-06-11 15:02:10 -07:00
Reed Wanderman-Milne
bef9713188 Add get_device_details API.
This API can get details about physical devices. Right now, only GPUs are supported, and the only fields are "name" and "compute_capability". The primary motivation is to determine whether mixed precision will run well, as it only results in significant speedups on GPUs with compute capability 7.0 and greater. In general, it's rare that querying device details is necessary, as TensorFlow runs most ops well on all devices, but mixed precision is an exception.

PiperOrigin-RevId: 315943445
Change-Id: I077fdc8f87a713ace74037fd2d82eede48740067
2020-06-11 11:42:48 -07:00
Amit Patankar
9f73322ffe Create a nightly libtensorflow.so symlink script that is copied into the GCS directory for nightly builds.
PiperOrigin-RevId: 315934586
Change-Id: Ic6dc4c345500f141c1f2f6ac5ccfd053250c9fe6
2020-06-11 11:09:35 -07:00