MBZUAI NLP department

All

41 repositories

arabic-aes-bea25
Public
Repo for ARWI_generate_data (Arabic Read, Write and Improve)
Python
•0•0•0•0•Updated Jul 20, 2025Jul 20, 2025
qorgau-kaz-ru-safety
Public
A benchmark and evaluation framework for assessing the safety of language models in Kazakh and Russian.
Jupyter Notebook
•0•0•0•0•Updated Jul 11, 2025Jul 11, 2025
ArTST
Public
Python
•6•49•0•0•Updated Jul 10, 2025Jul 10, 2025
finchain
Public
A symbolic benchmark for verifiable chain-of-thought financial reasoning. Includes executable templates, 54 topics across 12 domains, and ChainEval metrics.
benchmark symbolic-reasoning financial-nlp llm chain-of-thought financial-reasoning
Python
•1•13•2•0•Updated Jul 4, 2025Jul 4, 2025
llm-media-profiling
Public
This repository contains the code, dataset, and resources for our ACL 2025 paper: "Profiling News Media for Factuality and Bias Using LLMs and the Fact-Checking Methodology of Human Experts"
Jupyter Notebook
•
MIT License
•0•2•1•0•Updated Jun 17, 2025Jun 17, 2025
NADI-2025---Subatsk-3-Diacritic-Restoration
Public
Python
•0•0•0•0•Updated Jun 12, 2025Jun 12, 2025
OpenFactCheck
Public
An Open-source Factuality Evaluation Demo for LLMs
natural-language-processing artificial-intelligence fact-checking
Python
•
GNU General Public License v3.0
•1•14•0•0•Updated Jun 11, 2025Jun 11, 2025
Arabic_safety_evaluation
Public
A Benchmark and Evaluation framework for evaluating Arabic LLM safeguards
Jupyter Notebook
•1•3•0•0•Updated Jun 11, 2025Jun 11, 2025
CASA
Public
Clinical Annotations for Stuttering Assessment
Python
•0•0•0•0•Updated Jun 9, 2025Jun 9, 2025
fire
Public
A lightweight, agent-style framework for fact-checking atomic claims using iterative retrieval and verification. Reduces LLM and search cost while maintaining strong factuality performance.
framework retrieval verification factchecking factuality llm llm-agent hallucination-detection
Python
•0•10•0•0•Updated Jun 4, 2025Jun 4, 2025
UrduFactCheck
Public
An Agentic Fact-Checking Framework for Urdu with Evidence Boosting and Benchmarking
Jupyter Notebook
•0•1•0•0•Updated May 30, 2025May 30, 2025
PAN-CLEF2025GenAIDetection-Subtask2
Public
Python
•1•3•0•0•Updated May 29, 2025May 29, 2025
entity-framing
Public
JavaScript
•0•0•0•0•Updated May 28, 2025May 28, 2025
arab_culture
Public
Other
•0•3•0•0•Updated May 26, 2025May 26, 2025
mixat
Public
Emirati-English Code-Switching project
Other
•0•6•0•0•Updated May 12, 2025May 12, 2025
AudioJailbreak
Public
Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language Models
Python
•1•15•0•0•Updated May 10, 2025May 10, 2025
ImageCLEF-2025-MultimodalReasoning
Public
multimodal reasoning shared task
Python
•1•2•0•0•Updated Apr 26, 2025Apr 26, 2025
PolyWER
Public
Python
•
Other
•0•3•0•0•Updated Mar 3, 2025Mar 3, 2025
MultiChoice2ExtractiveQA
Public
Official repository for the paper 'From Multiple-Choice to Extractive QA: A Case Study for English and Arabic' (COLING 2025). Includes datasets, scripts, and benchmarks for converting MCQA to EQA across English, Modern Standard Arabic, and Arabic dialects
question-answering arabic-nlp arabic-dialects eqa coling2025
Jupyter Notebook
•
Other
•1•2•0•0•Updated Feb 6, 2025Feb 6, 2025
data_laundering
Public
Data Laundering: Artificially Boosting Benchmark Results through Knowledge Distillation
Python
•1•9•1•0•Updated Jan 24, 2025Jan 24, 2025
COLING-2025-Workshop-on-MGT-Detection-Task1
Public
Python
•
Apache License 2.0
•3•11•2•0•Updated Jan 19, 2025Jan 19, 2025
LLM-DetectAIve
Public
Python
•0•9•1•0•Updated Dec 2, 2024Dec 2, 2024
Llama-3-Nanda-10B-Chat
Public
Hindi-LLM
0•4•1•0•Updated Nov 25, 2024Nov 25, 2024
sttatts
Public
Python
•4•26•0•0•Updated Oct 29, 2024Oct 29, 2024
ArabicMMLU
Public
Python
•7•27•0•0•Updated Sep 17, 2024Sep 17, 2024
M4GT-Bench
Public
Jupyter Notebook
•0•8•1•0•Updated Jun 12, 2024Jun 12, 2024
EXAMS-V
Public
0•0•0•0•Updated Jun 3, 2024Jun 3, 2024
SemEval2024-task8
Public
SemEval2024-task8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detection
Python
•
Apache License 2.0
•30•76•2•0•Updated Apr 22, 2024Apr 22, 2024
M4
Public
M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detection
4•30•1•1•Updated Apr 9, 2024Apr 9, 2024
Fakenews-dataset
Public
5•10•2•0•Updated Apr 7, 2024Apr 7, 2024