The CollectiveHints class is also renamed to CommunicationOptions. The communication enum is added to it. CommunicationOptions stays experimental since the detailed options may change, but it's rather clear we need an options argument for these cross device communications. PiperOrigin-RevId: 337547832 Change-Id: I376171672698d5923b4e52f2567d4a584c8e21b6
17 lines
387 B
Plaintext
17 lines
387 B
Plaintext
path: "tensorflow.distribute.experimental.CommunicationImplemenation"
|
|
tf_class {
|
|
is_instance: "<enum \'CommunicationImplemenation\'>"
|
|
member {
|
|
name: "AUTO"
|
|
mtype: "<enum \'CommunicationImplemenation\'>"
|
|
}
|
|
member {
|
|
name: "NCCL"
|
|
mtype: "<enum \'CommunicationImplemenation\'>"
|
|
}
|
|
member {
|
|
name: "RING"
|
|
mtype: "<enum \'CommunicationImplemenation\'>"
|
|
}
|
|
}
|