Compact Greek language models from scratch: LexisLM-1B and LexisLM-500M decoder-only transformers pretrained on 22B tokens
Read the original at arxiv.org→arXiv:2611.10209v1 Announce Type: new Abstract: We present two compact decoder-only language models trained from scratch exclusively on Greek text: LexisLM-1B (1.09B parameters) and LexisLM-500M (502M parameters)....
Original headline: "Compact Greek Language Models from Scratch: Pretraining 500M- and 1B-Parameter Decoder-Only Transformers"
Coverage timeline
- Nov 10, 05:00 UTC arXiv cs.CL lead source Compact Greek Language Models from Scratch: Pretraining 500M- and 1B-Parameter Decoder-Only Transformers