Commit Graph

103431 Commits

Author SHA1 Message Date
Christian Sigg
03c97a204f Remove unused @local_config_cuda//cuda:cuda_root.
PiperOrigin-RevId: 353654418
Change-Id: I0db632ebf8452fbb4b4bd3711c23542f0061bca7
2021-01-25 08:47:43 -08:00
Christian Sigg
bd1aa7a01c Update protobuf to v3.14.
PiperOrigin-RevId: 353652856
Change-Id: If8522f6b829fe9e0518685bfe1d6f8c14fe5e137
2021-01-25 08:37:46 -08:00
TensorFlower Gardener
efef5a50cf Merge pull request from rkuester:feature-micro-add-op-fill-pr4
PiperOrigin-RevId: 353642794
Change-Id: I5631b3e11c92a39a293f17d0d4ae1acac9280cfb
2021-01-25 07:43:49 -08:00
TensorFlower Gardener
e65099b2cd Merge pull request from patriklaurell:tflu-transpose-initial-port
PiperOrigin-RevId: 353642432
Change-Id: I333a12e062e1e4dfd09db8f32741de3d6f68f9db
2021-01-25 07:39:20 -08:00
TensorFlower Gardener
f63cffee03 Merge pull request from linux-on-ibm-z:micro_fix_18dec
PiperOrigin-RevId: 353642156
Change-Id: I32c09c758c6f0628928c666a4587b44d97dc4575
2021-01-25 07:33:58 -08:00
TensorFlower Gardener
13d240618e Merge pull request from rsun-bdti:issue-45196-pr3
PiperOrigin-RevId: 353641803
Change-Id: I3b87ea7e1308f8d68a37a2f94daa21b1ba800118
2021-01-25 07:29:06 -08:00
Peter Hawkins
fa018e022b [PJRT] Use absl::string_view to return non-owned strings from PJRT interfaces. NFC intended.
Add a pybind11 type_caster for absl::string_view.

PiperOrigin-RevId: 353639519
Change-Id: I50ff93b01cc617714df3eb9ca2f0271b9fd42828
2021-01-25 07:17:02 -08:00
A. Unique TensorFlower
742976df21 internal visibilty change
PiperOrigin-RevId: 353637297
Change-Id: I2af7377c94fb19d9af10ee8fd9127b56e3ab5e1a
2021-01-25 07:05:36 -08:00
TensorFlower Gardener
aa48c39e16 Merge pull request from rsun-bdti:issue-46268-pr1
PiperOrigin-RevId: 353637103
Change-Id: I256248c25e72401f3979f77f535da7f6f0f531f7
2021-01-25 07:00:10 -08:00
Etienne Pot
5a421f2ad0 Add a .element_spec property to DatasetSpec
Currently there is no way of recovering the inner spec.

This is an issue for example when using nested datasets when `ds.element_spec` will return the outer dataset spec `{'nested_ds': DatasetSpec({'img': TensorSpec(...)})})` but it's not possible to access the inner DatasetSpec.

PiperOrigin-RevId: 353636988
Change-Id: I4bcfb3ab31a0761834a2837075264f8117973861
2021-01-25 06:54:50 -08:00
A. Unique TensorFlower
24041b6681 Replace deprecated thread annotations macros.
PiperOrigin-RevId: 353633546
Change-Id: Ie8c7e1b59356b0a59527709051d05ba2639b153d
2021-01-25 06:29:34 -08:00
A. Unique TensorFlower
ec3f47d69a [mlir][hlo] Make min/max always propagate NaNs
This is the right behavior for TF and JAX and matches what TF does on GPU. It
doesn't match TF on CPU, but that's really a TF bug.

PiperOrigin-RevId: 353628258
Change-Id: Iadb0ce627e033b3fd730e899501f5818d6ecc78d
2021-01-25 05:46:34 -08:00
Benjamin Kramer
5933c337d9 [mlir][hlo] Make min/max always propagate NaNs
This is the right behavior for TF and JAX and matches what TF does on GPU. It
doesn't match TF on CPU, but that's really a TF bug.

PiperOrigin-RevId: 353624935
Change-Id: Ic54e718a45e412db031fd1b3772d135ac46ed8a1
2021-01-25 05:18:12 -08:00
A. Unique TensorFlower
c47651f4d3 Integrate LLVM at llvm/llvm-project@0057cc5a21
Updates LLVM usage to match
[0057cc5a215e](https://github.com/llvm/llvm-project/commit/0057cc5a215e)

PiperOrigin-RevId: 353618541
Change-Id: Ib5d8a07ecf3f5096923fdb148184be2aee3a94f5
2021-01-25 04:19:41 -08:00
A. Unique TensorFlower
5058eacec0 internal visibility change
PiperOrigin-RevId: 353608384
Change-Id: Ibe0cfbcb7fbceff73849931ca274b2c17834bfcd
2021-01-25 02:53:07 -08:00
A. Unique TensorFlower
aa94c61a3e Support Conv3d in MLIR converter
PiperOrigin-RevId: 353596630
Change-Id: I464f6a298c19d782df593dedd035a9442c6e34fc
2021-01-25 01:15:55 -08:00
A. Unique TensorFlower
2b3fd6580e compat: Update forward compatibility horizon to 2021-01-25
PiperOrigin-RevId: 353595300
Change-Id: I04dbaaebc10894006e015963d44e1b847d75cc79
2021-01-25 01:11:15 -08:00
A. Unique TensorFlower
3421c2def0 Update GraphDef version to 657.
PiperOrigin-RevId: 353595299
Change-Id: I3cb59f3b0dd8e384953b68b453145300ef772cce
2021-01-25 01:07:07 -08:00
Bixia Zheng
ee58e600bf [TF:TRT] Modify a test to workaround a bug.
Allow native segment execution for BinaryTensorWeightBroadcastTest when
TensorRT 7+ is used. This is to workaround b/176540862.

PiperOrigin-RevId: 353581801
Change-Id: Ic494e212c012a3fb2c260da64a191899e68ec866
2021-01-24 22:51:54 -08:00
Jaesung Chung
77a9b64c88 Add variable operators to Flex
This is required for enabling flex fallback for complicated variable operators
for stateful random operators and so on.

PiperOrigin-RevId: 353578616
Change-Id: Ic71f36199ff437c2efa6f259ed2fd474694617d9
2021-01-24 22:10:25 -08:00
Thai Nguyen
167d0c0532 Support Conv3d in MLIR converter
PiperOrigin-RevId: 353574259
Change-Id: I6ed4695ffa1bb2a57e377a05c83a8aa34a9b5584
2021-01-24 21:25:21 -08:00
Jay Shi
7d5d7d6ecb [tf.data] Rolls out the optimization map_parallelization as experiment to 50% of Borg jobs.
PiperOrigin-RevId: 353570967
Change-Id: I91d264da2c6d5cc5cd9de63b87977a82c6af3299
2021-01-24 20:57:12 -08:00
Chao Mei
6e3575fecd 1. Support random initialization for kTfLiteBool input tensors.
2. Ensure the specified input dimension size is same w/ that specified in the model.

PiperOrigin-RevId: 353569125
Change-Id: I3df81a9314b97689e1925ab88fc2e575f9579ffa
2021-01-24 20:41:38 -08:00
Lu Wang
b9559be1ad Update the link in the documentation to use the stable 0.1 build
PiperOrigin-RevId: 353551348
Change-Id: I861b4822985b8e6e0ffc9b0947f2b8824b8163e3
2021-01-24 17:05:25 -08:00
Christian Sigg
1e66b5790c [NFC] Internal change, simplify a copybara rule.
PiperOrigin-RevId: 353528845
Change-Id: Ic7bc176279e6e97227e5dfd7baca191ec33197eb
2021-01-24 11:47:24 -08:00
Meghna Natraj
fb6d7a79d3 Replace MNIST with a random dataset to avoid external network connections.
PiperOrigin-RevId: 353527450
Change-Id: Iecff06741d3e20316a5f4cb7a39ece27c0a65d86
2021-01-24 11:31:39 -08:00
Mihai Maruseac
adc2bef66a disable broken tests.
PiperOrigin-RevId: 353524993
Change-Id: Id863e04d36927221f3b870494c7604ce87e2b117
2021-01-24 10:49:36 -08:00
Raman Sarokin
7b507b6ca2 Using MTLStorageModePrivate for textures in Metal.
PiperOrigin-RevId: 353518410
Change-Id: Ifd4c5856353f8658817c3d4ed6ce1fbe9626193d
2021-01-24 09:14:15 -08:00
Meghna Natraj
ad4f87b0b4 disable broken tests.
PiperOrigin-RevId: 353516404
Change-Id: Ia4d614d9ee41f56d1db87f141876a287de482013
2021-01-24 08:40:53 -08:00
Raman Sarokin
4bbdace1a4 Pooling tasks modified to be Metal compatible.
Added pooling_test_util with unified tests.
Added Metal pooling unit tests.

PiperOrigin-RevId: 353513964
Change-Id: I5a58b319509b64f268904312611e4649b35a467a
2021-01-24 08:10:59 -08:00
Raman Sarokin
b65778df51 Metal Resize kernels replaced with resize tasks from common/tasks.
PiperOrigin-RevId: 353512089
Change-Id: Ide26441ec809c7772cdea8dcfb94d9c5bafad246
2021-01-24 07:45:51 -08:00
Raman Sarokin
1415cd282c MaxUnpooling task modified to be Metal compatible.
Added max_unpooling_test_util with unified tests.
Added Metal max unpooling unit test.

PiperOrigin-RevId: 353509117
Change-Id: If9a658f8be8786e731a4fb72ede6b2f023b601a9
2021-01-24 07:02:32 -08:00
Raman Sarokin
2cff21749d Metal Mean kernels replaced with reduce tasks from common/tasks.
Now Metal Mean supports any combination of axis reduction.
Metal supports reduction ops with any combination of axis.

PiperOrigin-RevId: 353507802
Change-Id: Ib032b83e6075c1004e5249b6b8c8f66a13b2cf79
2021-01-24 06:39:34 -08:00
Raman Sarokin
32e64f9b89 Metal Softmax kernels replaced with softmax tasks from common/tasks.
PiperOrigin-RevId: 353506943
Change-Id: Ia3b7f8d62858c425ccc65a35d32b1a5464677df7
2021-01-24 06:28:23 -08:00
A. Unique TensorFlower
7c4bd4669b compat: Update forward compatibility horizon to 2021-01-24
PiperOrigin-RevId: 353483684
Change-Id: Ife47976a62bd03613526da6c32bcc272cf22debf
2021-01-24 01:13:48 -08:00
A. Unique TensorFlower
2b425db9ae Update GraphDef version to 656.
PiperOrigin-RevId: 353483652
Change-Id: Iad16fb145719ded3ddbc7c8a349fe01077b9cc70
2021-01-24 01:09:07 -08:00
TensorFlower Gardener
48a4bf6691 Merge pull request from rsun-bdti:issue-45608-pr4
PiperOrigin-RevId: 353396913
Change-Id: Iafbe45292f1f68f22e426c129359043f86566e38
2021-01-23 03:30:53 -08:00
A. Unique TensorFlower
6793e589fa compat: Update forward compatibility horizon to 2021-01-23
PiperOrigin-RevId: 353386823
Change-Id: I09b9f6b3fd7c9a44f9d1c351333d9d3669114372
2021-01-23 01:11:31 -08:00
A. Unique TensorFlower
2e5a5183fa Update GraphDef version to 655.
PiperOrigin-RevId: 353386819
Change-Id: I2f8cedd1f6bf2551cf4f3bed091976b088c32cca
2021-01-23 01:07:05 -08:00
Dimitris Vardoulakis
18d8bcbe72 Fail if ToString of comparisons is called during initialization.
PiperOrigin-RevId: 353375663
Change-Id: I219656e849301c567091672d5a6ea19e64e2ee40
2021-01-22 22:24:44 -08:00
Sanjoy Das
a34316afa2 Print LLVM diagnostics only at VLOG(1)
These are not actionable by our end users, and it usually just confuses them.

PiperOrigin-RevId: 353372479
Change-Id: I0994bfd35f0a5145349f54e26b35b11bcb85f0ed
2021-01-22 21:50:19 -08:00
A. Unique TensorFlower
98e48ecca3 Go: Update generated wrapper functions for TensorFlow ops.
PiperOrigin-RevId: 353368288
Change-Id: I9a24bce0df8b2011adb7857deb9dbf8306e60230
2021-01-22 20:50:22 -08:00
A. Unique TensorFlower
d56de8e17e Add an explicit sharding attribute to XlaSharding op. This fixes the issue which the user added attribute cannot be found when computing gradients.
PiperOrigin-RevId: 353364146
Change-Id: Iee02f8df1fb0c987bf5866dfb112361d9c9e374e
2021-01-22 19:57:02 -08:00
Yunlu Li
01a9c4f7c0 Add test for combining sparsity and dynamic range quantization.
PiperOrigin-RevId: 353359449
Change-Id: Icdf54473b1b54dab6abda07abe73d7b6601251d3
2021-01-22 19:01:38 -08:00
A. Unique TensorFlower
97afdaef07 Go: Update generated wrapper functions for TensorFlow ops.
PiperOrigin-RevId: 353358654
Change-Id: I3318addb3547781d5434763705db0043e8d1ee20
2021-01-22 18:53:49 -08:00
A. Unique TensorFlower
62a1fad4fa Adding support to identify a subset of possible auxiliary
induction variables (AIV). Specifically, candidates are gtes, e.g.,
gte(param0, N). We check if the loop body plumbs the AIV
through the same tuple index at root, and that ops involving AIV
involve constants.
   op2 = op(constants, gte(param0, N), constants)
   op3 = op(constants, f(op2, gte(param0, N), constants)
   root = tuple(..., op3, ...)
Further, the ops are restricted to basic math ops (+,-,*,/).

PiperOrigin-RevId: 353357828
Change-Id: If2bbd7a4d4758982100c2a29e618ac40abf1de1e
2021-01-22 18:48:00 -08:00
Ken Franko
605c0759d1 Delete TPUOutsideCompilationCluster pass.
This is no longer needed as tpu_extract_outside_compilation correctly moves ops to host and minimizes communication without explicit clustering.

PiperOrigin-RevId: 353357796
Change-Id: I5babc694680991e5b7dcbbe4326180adeeb22c8e
2021-01-22 18:41:19 -08:00
A. Unique TensorFlower
07ff8de8c6 Replace the usages of async_wait with tf.experimental.async_scope.
PiperOrigin-RevId: 353357095
Change-Id: I8c097eb07fd64451492f2959212e39685a4ee54e
2021-01-22 18:35:27 -08:00
Ruoxin Sang
631f99ebc3 Add an explicit sharding attribute to XlaSharding op. This fixes the issue which the user added attribute cannot be found when computing gradients.
PiperOrigin-RevId: 353356183
Change-Id: I44681e5411edf4f8989a2333c2ad5c1c50f5ebf7
2021-01-22 18:26:54 -08:00
Xinyi Wang
30fb80d468 Swap the use of NcclAllReduce for NCCL Collective Ops in MirroredStrategy.
Also remove the use of async executor to launch collective ops in eager mode and use one thread per device instead. This resolves the issue of not being able to call numpy() on the result of async executor. This change applies to MWMS too.

PiperOrigin-RevId: 353355403
Change-Id: I9c9f30dfe18dc830a4a8fa9bbaec042c7c2edd8f
2021-01-22 18:19:19 -08:00