Output Functions

Softmax

The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$ and a weighting vector $w$ we have:

$$ P(y=j \mid{x}) = \frac{e^{x^{T}w_{j}}}{\sum^{K}_{k=1}e^{x^{T}wk}} $$

Papers


Paper Code Results Date Stars

Tasks


Task Papers Share
Language Modelling 44 6.18%
Retrieval 33 4.63%
Question Answering 25 3.51%
Large Language Model 23 3.23%
Semantic Segmentation 22 3.09%
Decoder 19 2.67%
Image Classification 18 2.53%
Object Detection 14 1.97%
Classification 13 1.83%

Components


Component Type
🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign

Categories