From Data to Device: ELMOD An Efficient German-First 2.7B Language Model for Mobile Inference
TL;DR - ELMOD is a German-first 2.7B-parameter language model optimized for mobile and resource-constrained inference. It reportedly leads German models below 3B parameters and matches some 7B-model performance.
- Trained exclusively on public data using 55,000 H100 GPU hours.
- Uses German-specific preprocessing for morphology, compound words, and orthographic conventions.
- Quality filtering and rephrasing improved instructional data quality and annealing performance while reducing compute needs.
- Its compact architecture targets efficient on-device deployment.