Jaemin's Research Notes

long-context

5 items with this tag.

  • Jun 30, 2026

    Mega

    • papers
    • architectures
    • attention
    • gating
    • sequence-modeling
    • long-context
  • Jun 30, 2026

    BigBird

    • papers
    • architectures
    • transformer
    • attention
    • long-context
    • sparse-attention
  • Jun 30, 2026

    Reformer

    • papers
    • architectures
    • transformer
    • attention
    • efficient-transformer
    • long-context
  • Jun 30, 2026

    Longformer

    • papers
    • architectures
    • transformer
    • attention
    • long-context
    • sparse-attention
  • Jun 30, 2026

    ALiBi

    • papers
    • architectures
    • transformer
    • attention
    • positional-encoding
    • long-context

Created with Quartz v5.0.0 © 2026

  • GitHub
  • Discord Community