STT-tensorflow/tensorflow/core/data/service
Andrew Audibert 631fcba18c [tf.data service] Relax locking during round robin deepcopy.
Copying data out of the round robin buffer requires only a shared lock, but we were using an exclusive lock. This causes contention among consumers, especially when dataset elements are large.

PiperOrigin-RevId: 351879643
Change-Id: I407fd1d5b296dcf514bc055fa5477c91430e8ccd
2021-01-14 14:57:08 -08:00
..
testdata Create BUILD files and corresponding targets for tensorflow/core/data/service/testdata. 2020-11-19 16:39:57 -08:00
BUILD [tf.data service] Improve cancellation for tf.data service requests. 2021-01-14 10:26:18 -08:00
common.proto [tf.data service] Add C++ API for setting num_consumers for jobs. 2020-11-25 10:56:05 -08:00
credentials_factory_test.cc [tf.data service] Improve pointer/reference usage in credentials_factories. 2020-08-31 11:25:31 -07:00
credentials_factory.cc [tf.data service] Improve pointer/reference usage in credentials_factories. 2020-08-31 11:25:31 -07:00
credentials_factory.h [tf.data service] Improve pointer/reference usage in credentials_factories. 2020-08-31 11:25:31 -07:00
data_service_test.cc [tf.data service] Add support for one_epoch processing mode. 2020-09-21 14:19:43 -07:00
data_service.cc [tf.data service] Improve cancellation for tf.data service requests. 2021-01-14 10:26:18 -08:00
data_service.h [tf.data service] Improve cancellation for tf.data service requests. 2021-01-14 10:26:18 -08:00
dataset_store_test.cc [tf.data service] Store datasets in a "datasets" directory. 2020-08-12 18:24:09 -07:00
dataset_store.cc [tf.data service] Move DatasetDef reading and writing to shared util. 2020-08-13 11:46:38 -07:00
dataset_store.h [tf.data service] Store datasets in a "datasets" directory. 2020-08-12 18:24:09 -07:00
dispatcher_impl.cc [tf.data service] Implement round-robin reads. 2021-01-13 11:29:05 -08:00
dispatcher_impl.h [tf.data service] Add C++ API for setting num_consumers for jobs. 2020-11-25 10:56:05 -08:00
dispatcher_state_test.cc [tf.data service] Add C++ API for setting num_consumers for jobs. 2020-11-25 10:56:05 -08:00
dispatcher_state.cc [tf.data service] Add C++ API for setting num_consumers for jobs. 2020-11-25 10:56:05 -08:00
dispatcher_state.h [tf.data service] Add C++ API for setting num_consumers for jobs. 2020-11-25 10:56:05 -08:00
dispatcher.proto [tf.data service] Add C++ API for setting num_consumers for jobs. 2020-11-25 10:56:05 -08:00
grpc_dispatcher_impl.cc [tf.data service] Combine CreateJob and GetOrCreateJob into one RPC. 2020-11-23 11:05:20 -08:00
grpc_dispatcher_impl.h [tf.data service] Combine CreateJob and GetOrCreateJob into one RPC. 2020-11-23 11:05:20 -08:00
grpc_util_test.cc [tf.data service] Add util for handling grpc errors. 2020-03-20 13:40:43 -07:00
grpc_util.cc [tf.data service] Retry stream removed errors. 2020-10-16 15:39:13 -07:00
grpc_util.h Enable profiler for tf.data service. 2020-08-12 16:02:57 -07:00
grpc_worker_impl.cc [tf.data service] Garbage collect old and unused jobs. 2020-09-10 12:33:41 -07:00
grpc_worker_impl.h Move the data/experimental proto files into the proto top level directory. This effort is a part of the build file and package cleanup. 2020-11-17 17:02:55 -08:00
journal_test.cc [tf.data service] Improve pointer/reference usage in journal. 2020-08-28 14:03:15 -07:00
journal.cc [tf.data service] Improve pointer/reference usage in journal. 2020-08-28 14:03:15 -07:00
journal.h [tf.data service] Improve pointer/reference usage in journal. 2020-08-28 14:03:15 -07:00
journal.proto [tf.data service] Add C++ API for setting num_consumers for jobs. 2020-11-25 10:56:05 -08:00
local_credentials_factory.cc [tf.data service] Improve pointer/reference usage in credentials_factories. 2020-08-31 11:25:31 -07:00
server_lib.cc [tf.data service] Garbage collect old and unused jobs. 2020-09-10 12:33:41 -07:00
server_lib.h Move the data/experimental proto files into the proto top level directory. This effort is a part of the build file and package cleanup. 2020-11-17 17:02:55 -08:00
split_provider.cc [tf.data service] Fix timeouts in distributed_epoch tests. 2020-10-19 14:44:44 -07:00
split_provider.h [tf.data service] Fix timeouts in distributed_epoch tests. 2020-10-19 14:44:44 -07:00
task_runner_test.cc [tf.data service] Improve cancellation for tf.data service requests. 2021-01-14 10:26:18 -08:00
task_runner.cc [tf.data service] Relax locking during round robin deepcopy. 2021-01-14 14:57:08 -08:00
task_runner.h [tf.data service] Improve cancellation for tf.data service requests. 2021-01-14 10:26:18 -08:00
test_cluster.cc Move the data/experimental proto files into the proto top level directory. This effort is a part of the build file and package cleanup. 2020-11-17 17:02:55 -08:00
test_cluster.h Update "master" to "dispatch"/"dispatcher" in tf.data service terminology. 2020-07-16 11:56:00 -07:00
test_util_test.cc [tf.data service] Add test utils for testing against dataset GraphDefs. 2020-03-20 13:15:11 -07:00
test_util.cc [tf.data service] Add test utils for testing against dataset GraphDefs. 2020-03-20 13:15:11 -07:00
test_util.h [tf.data service] Add test utils for testing against dataset GraphDefs. 2020-03-20 13:15:11 -07:00
utils_test.cc [tf.data service] Move DatasetDef reading and writing to shared util. 2020-08-13 11:46:38 -07:00
utils.cc [tf.data service] Move DatasetDef reading and writing to shared util. 2020-08-13 11:46:38 -07:00
utils.h [tf.data service] Move DatasetDef reading and writing to shared util. 2020-08-13 11:46:38 -07:00
worker_impl.cc [tf.data service] Implement round-robin reads. 2021-01-13 11:29:05 -08:00
worker_impl.h [tf.data service] Keep track of finished tasks ids on workers. 2020-12-17 15:53:52 -08:00
worker.proto [tf.data service] Server-side implementation for round-robin data consumption. 2020-12-04 13:26:10 -08:00