An Op to permute tensors across replicated TPU instances.
tf.raw_ops.CollectivePermute( input, source_target_pairs, name=None )
Each instance supplies its own input.
For example, suppose there are 4 TPU instances: [A, B, C, D]
. Passing source_target_pairs=[[0,1],[1,2],[2,3],[3,0]]
gets the outputs: [D, A, B, C]
.
Args | |
---|---|
input | A Tensor . Must be one of the following types: float32 , float64 , int32 , uint8 , int16 , int8 , complex64 , int64 , qint8 , quint8 , qint32 , bfloat16 , uint16 , complex128 , half , uint32 , uint64 . The local input to be permuted. Currently only supports float and bfloat16. |
source_target_pairs | A Tensor of type int32 . A tensor with shape [num_pairs, 2]. |
name | A name for the operation (optional). |
Returns | |
---|---|
A Tensor . Has the same type as input . |
© 2020 The TensorFlow Authors. All rights reserved.
Licensed under the Creative Commons Attribution License 3.0.
Code samples licensed under the Apache 2.0 License.
https://www.tensorflow.org/versions/r2.4/api_docs/python/tf/raw_ops/CollectivePermute