Piousbox: Created page with "Autoencoders are closely related to Principal Component Analysis (PCA). In fact, if the activation function used within the autoencoder is linear within each layer,..."

2024-01-19T03:40:05Z

Created page with "Autoencoders are closely related to Principal Component Analysis (PCA). In fact, if the activation function used within the autoencoder is linear within each layer,..."

New page

Autoencoders are closely related to [[ Principal Component Analysis ]] ([[PCA]]). In fact, if the activation function used within the autoencoder is linear within each layer, the latent variables present at the bottleneck (the smallest layer in the network, aka. code) directly correspond to the principal components from PCA. Generally, the activation function used in autoencoders is non-linear, typical activation functions are [[ ReLU ]] (Rectified Linear Unit) and [[ sigmoid ]].

Autoencoder - Revision history

Piousbox: Created page with "Autoencoders are closely related to Principal Component Analysis (PCA). In fact, if the activation function used within the autoencoder is linear within each layer,..."