experiments/STT-tensorflow
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
rmothukuru-patch-1
STT-tensorflow/tensorflow/core/protobuf
History
Tayo Oguntebi 6983bacea1 Enables per-host dummy args for TPUExecute (TF1) and adds XLA options. 
Enabling this logic removes cross-worker send/recv dependencies required for TPUExecuteOp nodes to access a model's variables. This decreases overhead at the start of a training loop.

The approach used is to replace remote variable reads with zero tensors on each worker, except for the primary worker. The zero tensors feed TPUExecute nodes that are local to that worker.  For large distributed systems with large variables, this removes the need for the initial Send/Recv variable broadcast, which can be expensive.

PiperOrigin-RevId: 351904109
Change-Id: I9f1ed63c2401f227646010a94a70c04f1c96cb7e
2021-01-14 17:03:51 -08:00
..
tpu Enables per-host dummy args for TPUExecute (TF1) and adds XLA options. 2021-01-14 17:03:51 -08:00
autotuning.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
bfc_memory_map.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
BUILD Add clif bindings for the protocol buffers defined in tensorflow_server.proto. 2020-12-23 15:29:37 -08:00
cluster.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
config.proto Internal change 2020-12-14 18:08:03 -08:00
control_flow.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
conv_autotuning.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
critical_section.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
debug_event.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
debug.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
device_filters.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
device_properties.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
eager_service.proto Use the original output indices when adding a component function output to RemoteMgr. 2020-08-19 14:41:05 -07:00
error_codes.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
extension_type_variant.proto Add ExtensionTypeVariant class, which can be used to store any ExtensionType values (aka CompositeTensor values) in a variant scalar. 2020-11-23 10:00:58 -08:00
graph_debug_info.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
master_service.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
master.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
meta_graph.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
named_tensor.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
queue_runner.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
remote_tensor_handle.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
replay_log.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
rewriter_config.proto NCHW to NHWC conversion on CPU. 2020-08-17 23:05:35 -07:00
saved_model.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
saved_object_graph.proto Rationale: 2020-11-03 12:55:59 -08:00
saver.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
service_config.proto Move the data/experimental proto files into the proto top level directory. This effort is a part of the build file and package cleanup. 2020-11-17 17:02:55 -08:00
snapshot.proto Move the data/experimental proto files into the proto top level directory. This effort is a part of the build file and package cleanup. 2020-11-17 17:02:55 -08:00
struct.proto Remove ndarray wrapper from TF Numpy. We return tensors directly. 2020-10-24 15:21:32 -07:00
tensor_bundle.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
tensorflow_server.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
trackable_object_graph.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
transport_options.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
verifier_config.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
worker_service.proto Change the go_package name from core_protos_go_proto to for_protos_go_proto to match the new BUILD rule name. 2020-07-22 11:40:23 -07:00
worker.proto Exchange device attributes at group resolution again 2020-09-02 13:34:41 -07:00