W3cubDocs

tf.keras.ops.silu

Sigmoid Linear Unit (SiLU) activation function, also known as Swish.

View aliases

Main aliases

tf.keras.ops.nn.silu, tf.keras.ops.nn.swish, tf.keras.ops.swish

tf.keras.ops.silu(
    x
)

The SiLU activation function is computed by the sigmoid function multiplied by its input. It is defined as f(x) = x * sigmoid(x).

Args
`x`	Input tensor.

Returns
A tensor with the same shape as `x`.

Example:

x = keras.ops.convert_to_tensor([-6.0, 1.0, 0.0, 1.0, 6.0])
keras.ops.sigmoid(x)
array([0.00247262, 0.7310586, 0.5, 0.7310586, 0.9975274], dtype=float32)
keras.ops.silu(x)
array([-0.0148357, 0.7310586, 0.0, 0.7310586, 5.9851646], dtype=float32)

© 2022 The TensorFlow Authors. All rights reserved.
Licensed under the Creative Commons Attribution License 4.0.
Code samples licensed under the Apache 2.0 License.
https://www.tensorflow.org/api_docs/python/tf/keras/ops/silu