Jaemin's Research Notes
Search
Search
Dark mode
Light mode
Contents
transformer
42 items with this tag.
Jul 31, 2026
An Image is Worth 16x16 Words
papers
architectures
transformer
vision
Jul 31, 2026
BERT
papers
architectures
transformer
language-model
Jul 31, 2026
Masked Autoencoders Are Scalable Vision Learners
papers
architectures
vision
transformer
self-supervised-learning
autoencoder
Jul 31, 2026
Emerging Properties in Self-Supervised Vision Transformers
papers
architectures
vision
transformer
self-supervised-learning
distillation
Jul 31, 2026
Scalable Diffusion Models with Transformers
papers
architectures
generative-models
diffusion
transformer
Jul 31, 2026
Universal Transformer
concepts
architectures
transformer
Jul 31, 2026
Universal Transformers
papers
architectures
transformer
recurrent
adaptive-computation
Jun 30, 2026
DeltaNet
papers
architectures
transformer
attention
linear-attention
efficient-attention
recurrent
sequence-modeling
Jun 30, 2026
Gated Linear Attention
papers
architectures
transformer
attention
efficient-attention
linear-attention
sequence-modeling
Jun 30, 2026
Transformer
architectures
transformer
attention
Jun 30, 2026
Jamba
papers
architectures
transformer
mamba
state-space-model
mixture-of-experts
language-models
Jun 30, 2026
Vision Transformer
architectures
transformer
vision
Jun 30, 2026
MetaFormer
papers
architectures
vision
transformer
Jun 30, 2026
Taming Transformers for High-Resolution Image Synthesis
papers
architectures
generative-models
transformer
image-generation
Jun 30, 2026
Gaussian Error Linear Units
papers
architectures
activation-function
transformer
Jun 30, 2026
BLIP-2
papers
architectures
multimodal
vision-language
q-former
transformer
Jun 30, 2026
Flamingo
papers
architectures
multimodal
vision-language
few-shot-learning
transformer
Jun 30, 2026
Segment Anything
papers
architectures
computer-vision
segmentation
foundation-model
promptable-model
transformer
Jun 30, 2026
DETR
papers
architectures
computer-vision
object-detection
transformer
Jun 30, 2026
Encoder-Only Transformer
architectures
transformer
representation-learning
Jun 30, 2026
DeBERTa
papers
architectures
transformer
encoder-only
attention
language-model
Jun 30, 2026
BigBird
papers
architectures
transformer
attention
long-context
sparse-attention
Jun 30, 2026
Linformer
papers
architectures
transformer
attention
efficient-attention
low-rank
Jun 30, 2026
Performer
papers
architectures
transformer
attention
efficient-attention
Jun 30, 2026
Reformer
papers
architectures
transformer
attention
efficient-transformer
long-context
Jun 30, 2026
Decoder-Only Transformer
architectures
transformer
autoregressive-model
Jun 30, 2026
Language Models are Unsupervised Multitask Learners
papers
architectures
transformer
language-model
Jun 30, 2026
Language Models are Few-Shot Learners
papers
architectures
transformer
language-model
scaling
in-context-learning
Jun 30, 2026
LLaMA
papers
architectures
transformer
language-model
foundation-model
Jun 30, 2026
Longformer
papers
architectures
transformer
attention
long-context
sparse-attention
Jun 30, 2026
ALiBi
papers
architectures
transformer
attention
positional-encoding
long-context
Jun 30, 2026
Positional Encoding
architectures
transformer
sequence-modeling
Jun 30, 2026
Attention Is All You Need
papers
architectures
transformer
attention
Jun 30, 2026
GQA
papers
architectures
attention
transformer
inference
Jun 30, 2026
GLU Variants Improve Transformer
papers
architectures
transformer
feed-forward-network
gating
Jun 30, 2026
Root Mean Square Layer Normalization
papers
architectures
normalization
transformer
Jun 30, 2026
RoFormer
papers
architectures
transformer
positional-encoding
Jun 30, 2026
Transformer-XL
papers
architectures
transformer
sequence-modeling
Jun 30, 2026
T5
papers
architectures
transformer
encoder-decoder
language-models
Jun 30, 2026
Swin Transformer
papers
architectures
vision
transformer
Jun 30, 2026
Attention Is All You Need를 지금 다시 읽는 법
posts
ai
transformer
papers
Jun 26, 2026
Normalization Placement
architectures
normalization
transformer