From Data to Device: ELMOD An Efficient German-First 2.7B Language Model for Mobile Inference
Ranking
Overall
76
Content
80
Popularity
65
Observed public metrics from 1 member.
Merged summary
TL;DR - ELMOD is a German-first 2.7B-parameter language model optimized for mobile and resource-constrained inference. It reportedly leads German models below 3B parameters and matches some 7B-model performance.
- Trained exclusively on public data using 55,000 H100 GPU hours.
- Uses German-specific preprocessing for morphology, compound words, and orthographic conventions.
- Quality filtering and rephrasing improved instructional data quality and annealing performance while reducing compute needs.
- Its compact architecture targets efficient on-device deployment.
Sources (1)
From Data to Device: ELMOD An Efficient German-First 2.7B Language Model for Mobile Inference
Public signals
Hugging Face upvotes 1
TL;DR - ELMOD is a German-first 2.7B-parameter language model optimized for mobile and resource-constrained inference. It reportedly leads German models below 3B parameters and matches some 7B-model performance.
- Trained exclusively on public data using 55,000 H100 GPU hours.
- Uses German-specific preprocessing for morphology, compound words, and orthographic conventions.
- Quality filtering and rephrasing improved instructional data quality and annealing performance while reducing compute needs.
- Its compact architecture targets efficient on-device deployment.