Skip to content

Encoder

Definition
AI-generated

An encoder is the part of a neural network that maps raw inputs—tokens, images, counts, or continuous features—into an internal representation: a sequence of hidden states, a pooled vector, or latent parameters.

Topics
LLM and Agents Machine learning concepts
Related
Autoencoder BERT (Bidirectional Encoder Representations from Transformers) Cross-Attention

Why it matters in GWAS

Encoder choices determine what signal reaches variant scoring heads, single-cell latent spaces, or literature embeddings; shallow or mis-normalized encoders can entangle ancestry, batch, or library prep with biology, so GWAS-facing models need calibration and held-out genetic validation like any other predictor.

Example usage

"We froze the DNA Encoder layers and only trained the MLP head on UK Biobank labels to limit overfitting."

Autoencoder BERT (Bidirectional Encoder Representations from Transformers) Cross-Attention Decoder Embedding Large Language Model (LLM) Transformer Variational Autoencoder (VAE)
Related-term network

Click any node to open that term page.

Node order. The current term is first. Next come every page linked from Related terms, in the same top-to-bottom order as that list. Then new terms appear in two-hop layers: for each of those direct neighbors (in that same order), their related terms are appended if not already listed. A third pass does the same for two-hop nodes. The walk stops when a fixed maximum number of nodes is reached.

References

  • Vaswani A, et al. (2017). Attention is all you need. NeurIPS.
← Encyclopedia of DNA Elements (ENCODE) Enhancer →

Last updated (UTC · Git history)