This is the repo for A Fine-Grained Linguistic Evaluation of Low-Resource Luxembourgish–English MT. The paper introduces the Lux-MT-Test-Suite, enabling a semi-automatic evaluattion of Luxembourgish (lb) to English (en) machine translation (MT). The test suite includes 896 items spanning 12 linguistic categories, which are subdivided into 36 linguistic phenomena. Together, these phenomena cover lexical, syntactic, pragmatic, and discourse level features.

📖 Citation

If you use this work, please cite:

@inproceedings{rehlinger-2026-fine,
  title     = {A Fine-Grained Linguistic Evaluation of Low-Resource Luxembourgish--English MT},
  author    = {Rehlinger, Nils},
  editor    = {Ojha, Atul Kr. and
               Liu, Chao-hong and
               Vylomova, Ekaterina and
               Pirinen, Flammie and
               Washington, Jonathan and
               Oco, Nathaniel and
               Zhao, Xiaobing},
  booktitle = {Proceedings for the Ninth Workshop on Technologies for Machine Translation of Low Resource Languages (LoResMT 2026)},
  month     = mar,
  year      = {2026},
  address   = {Rabat, Morocco},
  publisher = {Association for Computational Linguistics},
  url       = {https://aclanthology.org/2026.loresmt-1.12/},
  doi       = {10.18653/v1/2026.loresmt-1.12},
  pages     = {138--150},
  isbn      = {979-8-89176-366-1}
}

## License

The Lux-MT-Test-Suite is licensed under the
Creative Commons Attribution 4.0 International (CC BY 4.0) license.

If you use this test suite in academic work, please cite the accompanying paper.