Model Card: Baidu Unlimited OCR 2
Baidu Unlimited OCR 2 (`baidu/Unlimited-OCR-2`): open-sourced 2026-10-27, 3.34B parameters (SAM ViT-B + CLIP-L encoder, 12-layer MoE decoder routing each token to 6-of-64 experts plus 2 shared experts), 131,072-token context window, MIT License; its core trick is SR-SWA (Sparse Reference Sliding Window Attention), which compresses cross-page text-visual attention into a fixed 512-token reference set; scores 84.6 on MPDocBench (dozens of pages) and 77.1 on MarathonDocBench (hundreds of pages) — only a 7.5-point drop; predecessor Unlimited-OCR 1.0 scored 0.0 on MarathonDocBench, and rival Qwen3.8-Max falls from 78.3 to 22.9; runs on a single NVIDIA A800-80GB with BF16 weights around 6.7GB