Publications
Publications behind NativQA, NativMMQA, MultiNativQA, EverydayMMQA, SpokenNativQA, MENASpeechBank, and related culturally aligned LLM evaluation resources.
2026
-
MENASpeechBank: A Reference Voice Bank with Persona-Conditioned Multi-Turn Conversations for AudioLLMsarXiv preprint arXiv:2602.07036, 2026 -
Beyond MCQ: An Open-Ended Arabic Cultural QA Benchmark with Dialect VariantsIn The 15th edition of the Language Resources and Evaluation Conference (LREC 2026) , 2026
2025
-
OASIS: A Multilingual and Multimodal Framework for Culturally Grounded Spoken Visual QAarXiv preprint arXiv:2510.06371, 2025 -
NativQA Framework: Enabling llms with native, local, and everyday knowledgearXiv preprint arXiv:2504.05995, 2025 -
NativQA: Multilingual Culturally-Aligned Natural Query for LLMsIn Findings of the Association for Computational Linguistics ACL 2025 , Jul 2025 -
SpokenNativQA: Multilingual Everyday Spoken Queries for LLMsIn Proceedings of the 26th Interspeech Conference (Interspeech 2025) , Aug 2025 -
AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMsIn Proceedings of the 31st International Conference on Computational Linguistics , Jan 2025