Multilingual evaluation
General benchmarks rarely reflect the languages of a real workflow. We treat Modern Standard Arabic, its dialects, French and English, and switching between them, as separate test conditions, together with the terminology of the domain.
Proposed method
Test questions per language · Code-switching cases · Domain terminology · Review by people who speak the language