Publications

Publications behind NativQA, NativMMQA, MultiNativQA, EverydayMMQA, SpokenNativQA, MENASpeechBank, and related culturally aligned LLM evaluation resources.

2026

  1. speechbank_pipeline.png
    MENASpeechBank: A Reference Voice Bank with Persona-Conditioned Multi-Turn Conversations for AudioLLMs
    Zien Sheikh Ali, Hunzalah Hassan Bhatti, Rabindra Nath Nandi , and 2 more authors
    arXiv preprint arXiv:2602.07036, 2026
  2. beyond_mcq_dataset_pipeline.png
    Beyond MCQ: An Open-Ended Arabic Cultural QA Benchmark with Dialect Variants
    Hunzalah Hassan Bhatti, and Firoj Alam
    In The 15th edition of the Language Resources and Evaluation Conference (LREC 2026) , 2026

2025

  1. everydaymmqa_framework.png
    OASIS: A Multilingual and Multimodal Framework for Culturally Grounded Spoken Visual QA
    Firoj Alam, Ali Ezzat Shahroor, Md. Arid Hasan , and 8 more authors
    arXiv preprint arXiv:2510.06371, 2025
  2. nativqa_framework.png
    NativQA Framework: Enabling llms with native, local, and everyday knowledge
    Firoj Alam, Md Arid Hasan, Sahinur Rahman Laskar , and 3 more authors
    arXiv preprint arXiv:2504.05995, 2025
  3. language_donut_chart.png
    NativQA: Multilingual Culturally-Aligned Natural Query for LLMs
    Md. Arid Hasan, Maram Hasanain, Fatema Ahmad , and 6 more authors
    In Findings of the Association for Computational Linguistics ACL 2025 , Jul 2025
  4. spokennativqa.png
    SpokenNativQA: Multilingual Everyday Spoken Queries for LLMs
    Firoj Alam, Md Arid Hasan, and Shammur Absar Chowdhury
    In Proceedings of the 26th Interspeech Conference (Interspeech 2025) , Aug 2025
  5. benchmarking_tasks_datasets.png
    AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMs
    Basel Mousi, Nadir Durrani, Fatema Ahmad , and 6 more authors
    In Proceedings of the 31st International Conference on Computational Linguistics , Jan 2025