The NeoMundi AI Observatory is our public research program dedicated to the continuous, transparent and reproducible evaluation of generative AI systems.
We regularly publish thermodynamic cartographies and in-depth observations, including the NeoMundi AI Barometer, which tracks de-identified model profiles over time across multiple dimensions: stability, factual validity, informational density, factual-risk signals, semantic variation and cost efficiency. These publications reveal behavioral trends and silent regime changes that traditional one-shot benchmarks cannot capture.
All our work is built on open methodologies and publicly available data. Generation scripts, scoring protocols and raw datasets are released on GitHub, allowing researchers, developers and the wider AI community to audit, reproduce and build upon our observations.
In the framework of the NeoMundi AI Observatory’s work, we are publishing today a contribution by James Moore, founder of Nova Jema AI Systems and specialist in the governance of artificial intelligence systems under real-world execution conditions. He kindly shared with us a precise reflection on a frequently overlooked subject: once we measure an AI’s […]
All AI Barometers Building a baseline To produce this first Barometer, we first established a public baseline. It was built from 3 execution waves × 12 de-identified systems × 4 fixed questions × 100 repetitions, representing 14,400 completed observations. This baseline serves as the reference point for measuring changes observed in future weekly publications. View
Scientific Contributor / Data Scientist – NeoMundi AI Observatory Most discussions on AI governance start too late. We believe measurement must come first. We have developed ControlTower, a diagnostic, piloting, and traceability instrument designed to continuously observe the risk of AI responses in real-world conditions. ControlTower enables standardized and reproducible measurement campaigns, allows comparison of
Independent Audit Report by Pape Malick DIOP, Data Scientist and Machine Learning Researcher, June 10, 2026. At NeoMundi, we believe that the governance of generative systems cannot rely on a single signal. This is why we commissioned an independent external exploratory audit of our runtime signals: G-Score, ∆G, FLAG, regime, and benchmark accuracy. Pape Malick
1. For AI systems, price, stability and factual accuracy do not always move together We measured 12 major generative AI systems using the same protocol, in order to compare their observable stability, factual validity and relative cost per request. Each point represents an observed profile. Horizontal axis: observable stability · Vertical axis: evaluated factual validity
NeoMundi Recherche publishes a public, sanitized version of an independent methodological review of its real-time approach to measuring the stability of generative AI. The review is based on a May 2026 comparative cohort of eight anonymized providers. It examines what a real-time signal can and cannot capture, documents the current limits of the method, and
1. MURMURATION – Research on Collective Runtime Stability Distributed autonomous systems can now coordinate trajectories, distribute tasks, and maintain dynamic formations at scale. But one critical question remains largely unsolved: how can we measure the collective stability of a multi-agent system before a systemic failure in cohesion emerges? Current distributed architectures are designed to optimize:
