RT by @huggingface: 24GB VRAM is enough to run MOSS-VL locally.@Open_MOSS We’ve released FP8 and…

TL;DR - OpenMOSS released FP8 and NF4 quantized versions of its MOSS-VL image and video models, enabling local deployment on 24GB consumer GPUs. The releases substantially reduce VRAM usage while reportedly retaining performance close to BF16 on selected benchmarks.

• MOSS-VL-Instruct supports local image and video inference, batch processing, and serving.
• MOSS-VL-Realtime provides timestamp-aware understanding of cameras, livestreams, and continuous video.
• NF4 offers lower memory use and more headroom for long-context streaming; FP8 balances capability and inference performance.
• All four quantized checkpoints are available through Hugging Face and ModelScope.