rectified linear unit

English

Etymology

Coined by Vinod Nair and Geoffrey Hinton in 2010 after linear units used earlier. Displaced earlier term "analog threshold element" which hasn't caught on in 1969

Noun

rectified linear unit (plural rectified linear units)

1. A unit (artificial neuron) in an artificial neural network that employs a rectifier
2. The rectifier function itself

Synonyms

• ReLU