LRZ AI Team Develops 10B Language Model
Bavarian, German and English – in one large language model: To enable AI to understand Bavarian, the LRZ developed and trained an own language model.
Do-you want to translate “Hock di hera, samma mera”* into German or English? Now there’s Llama-GENBA-10B. The trilingual language model is based on Meta’s Large Language Model (LLM) Llama, version 3.1-8B, and was trained by researchers at LRZ and Cerebras Systems with 10 billion parameters using a dataset of 164 billion tokens…
