tf.contrib.data.map_and_batch

tf.contrib.data.map_and_batch(
    map_func,
    batch_size,
    num_parallel_batches=1,
    drop_remainder=False
)

Defined in tensorflow/contrib/data/python/ops/batching.py.

See the guide: Dataset Input Pipeline > Transformations on existing datasets

Fused implementation of map and batch.

Maps map_func across batch_size consecutive elements of this dataset and then combines them into a batch. Functionally, it is equivalent to map followed by batch. However, by fusing the two transformations together, the implementation can be more efficient. Surfacing this transformation in the API is temporary. Once automatic input pipeline optimization is implemented, the fusing of map and batch will happen automatically and this API will be deprecated.

Args:

• map_func: A function mapping a nested structure of tensors to another nested structure of tensors.
• batch_size: A tf.int64 scalar tf.Tensor, representing the number of consecutive elements of this dataset to combine in a single batch.
• num_parallel_batches: A tf.int64 scalar tf.Tensor, representing the number of batches to create in parallel. On one hand, higher values can help mitigate the effect of stragglers. On the other hand, higher values can increase contention if CPU is scarce.
• drop_remainder: A tf.bool scalar tf.Tensor, representing whether the last batch should be dropped in case its size is smaller than desired; the default behavior is not to drop the smaller batch.

Returns:

A Dataset transformation function, which can be passed to tf.data.Dataset.apply.