Repository navigation

fix(nn): count CLS and embedding tokens in sequence lengths - #484

Open

ChrisW09 wants to merge 2 commits into

mainfrom

fix/cls-token-count

Open

fix(nn): count CLS and embedding tokens in sequence lengths#484
ChrisW09 wants to merge 2 commits into
mainfrom
fix/cls-token-count

Commits on Oct 21, 2026
- fix(nn): count CLS and embedding tokens in sequence lengths
  ChrisW09
  committed
  a724bdf
- docs: describe the dropped tokens precisely and document n_tokens
  ChrisW09
  committed
  4f5a62d