I am a PhD researcher at the University of Oxford, advised by Scott A. Hale. I work on factuality of LLMs and on training methods that ground model outputs in evidence. My research is funded by the Rhodes Scholarship.

I recently spent time as a Student Researcher at Google DeepMind, working with Miruna Pîslar on agentic student simulators for advancing AI tutors. Before that, I completed two AI Research Internships at JPMorganChase AI Research Lab, where I developed a synthetic data generation framework for financial NLI and a post-training recipe for a specialised 8B claim decomposition model.

I've worked on:

Previously, I worked as a Software Engineer for four years at Twiga Foods, a startup solving food security challenges across Africa, where I built Kotlin and Go microservices and Android application features to support over 40,000 farmers and vendors.

News

Recent updates

  1. Known By Their Actions was accepted to NeurIPS 2026.
  2. INCLUDE-2.0 was accepted to EMNLP 2026 Main as an oral.
  3. Distill and Align Decomposition (DAD) was accepted to Findings of EACL 2026.
  4. Started as a Student Researcher at Google DeepMind.
  5. Measuring what Matters was accepted to NeurIPS 2025 Datasets & Benchmarks.
  6. Co-leading the LLM practical at Deep Learning Indaba Kigali 2025.
  7. World Wide Recipe received a Best Paper Honourable Mention at FAccT 2025.
  8. Started an AI Research Internship at JPMorganChase AI Research (London).

Publications

An asterisk marks equal contribution.

2026

INCLUDE-2.0: Disentangling Knowledge Gaps in Multilingual LLM Evaluation

Angelika Romanou*, María Grandury*, Clara Meister, Negar Foroutan, Jabez Magomere, Anna Sotnikova, Orestis Papakyriakopoulos, Scott A. Hale, Shamsuddeen Hassan Muhammad, Antoine Bosselut

EMNLP 2026 Main Oral

The benchmark separates language proficiency from regional and community-grounded knowledge across 91 languages.

Distill and Align Decomposition for Enhanced Claim Verification

Jabez Magomere, Elena Kochkina, Samuel Mensah, Simerjot Kaur, Fernando Acero, Arturo Oncevay, Charese H. Smiley, Xiaomo Liu, Manuela Veloso

EACL 2026 (Findings)

A distilled, reinforcement-learned 8B decomposer improves verification while preserving the quality of complex subclaims.

2025

Measuring what Matters: Construct Validity in Large Language Model Benchmarks

Andrew M. Bean, Ryan Othniel Kearns, Angelika Romanou, Franziska Sofia Hafner, Harry Mayne, Jabez Magomere, et al.

Andrew M. Bean*, Ryan Othniel Kearns, Angelika Romanou, Franziska Sofia Hafner, Harry Mayne, Jan Batzner, Negar Foroutan, Chris Schmitz, Karolina Korgul, Hunar Batra, Oishi Deb, Emma Beharry, Cornelius Emde, Thomas Foster, Anna Gausen, María Grandury, Simeng Han, Valentin Hofmann, Lujain Ibrahim, Hazel Kim, Hannah Rose Kirk, Fangru Lin, Gabrielle Kaili-May Liu, Lennart Luettgau, Jabez Magomere, Jonathan Rystrøm, Anna Sotnikova, Yushi Yang, Yilun Zhao, Adel Bibi, Antoine Bosselut, Ronald Clark, Arman Cohan, Jakob Foerster, Yarin Gal, Scott A. Hale, Inioluwa Deborah Raji, Christopher Summerfield, Philip H. S. Torr, Cozmin Ududec, Luc Rocher, Adam Mahdi

NeurIPS 2025, Datasets & Benchmarks

A review of 445 benchmarks identifies recurring validity gaps and gives eight recommendations for better LLM evaluation.

The World Wide Recipe: A Community-Centred Framework for Fine-Grained Data Collection and Regional Bias Operationalisation

Jabez Magomere, Shu Ishida, Tejumade Afonja, Aya Salama, Daniel Kochin, Foutse Yuehgoh, Imane Hamzaoui, Raesetje Sefala, Aisha Alaagib, Samantha Dalal, Beatrice Marchegiani, Elizaveta Semenova, Lauren Crais, Siobhan Mackenzie Hall

FAccT 2025 🏅 Best Paper Honourable Mention

Community-led data collection exposes regional inaccuracies and cultural misrepresentation in text-to-image systems.

2024

Projects

Visual Diagnoser

2019

An Android application for home-based diabetic retinopathy screening. We trained a CNN in TensorFlow to classify retinal images with diabetic retinopathy and deployed it to low-end mobile devices using TensorFlow Lite.

Nairobi Tech Week 2019 🏅 Hackathon Winner

Ms Maji

2018

An IoT-based water management system designed for densely populated communities, built using Arduino and the IBM Watson IoT platform.

Demo ↗ IBM Water Hackathon 🏅 Most Innovative Solution

Elimu

2019

A personalised learning application using Deep Knowledge Tracing with LSTM networks to model student knowledge and adapt learning activities over time.

Personalised learning · undergraduate project

Teaching

Tutorials and talks

Tutorials

Developer talks