Author name: Admin

NeoMundi Research publishes reports, external audits, and numerous publications regarding AI (Artificial Intelligence, LLM) metrics, produced by the research laboratory and external contributors.

What the Average Conceals - Analysis of AI Barometers #6 and #7 by James Moore - NeoMundi AI Observatory
AI Observatory

What a Stable Average Can Conceal in Production AI

James Moore’s analysis of AI Barometers #6 and #7 shows how a minimal global shift can mask concentrated changes across specific profiles, tasks and alert types. NeoMundi’s AI Barometers were designed to make the behaviour of AI systems observable over time. Once the measurement is produced, however, another question becomes essential: what can an apparently […]

Privacy-First Design and Data Minimization in AI Behavioral Metrology – AI Governance Reference by NeoMundi Research
AI Governance Reference

Privacy-First Design and Data Minimization in AI Behavioral Metrology

Introduction AI behavioral metrology generates structured observations of generative systems in production. Because these observations are produced from real interactions, the design of the measurement system itself raises important questions related to data protection, privacy, and proportionality. This article examines how a privacy-first approach and the principle of data minimization can be applied to AI

Human Oversight and Decision Authority in Runtime Metrology Systems – AI Governance Reference by NeoMundi Research
AI Governance Reference

Human Oversight and Decision Authority in Runtime Metrology Systems

Introduction Runtime metrology produces structured behavioral signals from AI systems in production. These signals can inform governance processes, but they do not replace human or organizational judgment. Maintaining clear decision authority is a foundational requirement of responsible AI governance. This article examines the role of human oversight in systems that incorporate runtime metrology. It clarifies

From Controlled Measurement Campaigns to Continuous Production Monitoring – AI Governance Reference by NeoMundi Research
AI Governance Reference

From Controlled Measurement Campaigns to Continuous Production Monitoring

Introduction AI behavioral metrology can be applied in two complementary modes: controlled measurement campaigns and continuous production monitoring. These two modes are complementary rather than sequential. Each mode serves distinct purposes, operates under different constraints, and generates different types of insight. This article clarifies the relationship between these two approaches. It explains how controlled campaigns

Building Organizational Maturity in AI Governance Metrology – AI Governance Reference by NeoMundi Research
AI Governance Reference

Building Organizational Maturity in AI Governance Metrology

Introduction AI governance metrology is not only a technical capability. It is also an organizational practice that develops over time. Organizations differ in how systematically they measure AI behavior, interpret signals, and integrate observations into decision processes. This article outlines a maturity perspective on AI governance metrology. It describes progressive levels of capability and highlights

Baselines in AI Behavioral Metrology: Definition and Role - NeoMundi Research
AI Governance Reference

Baselines in AI Behavioral Metrology: Definition and Role

Introduction In AI behavioral metrology, measurements only become meaningful when they can be compared against a reference. Without a clear reference point, observed variations remain difficult to interpret. This reference point is commonly called a baseline. This article defines the concept of a baseline in the context of AI governance metrology, explains its role in

Evidence Trails and Traceability in AI Governance Measurement - NeoMundi Research
AI Governance Reference

Evidence Trails and Traceability in AI Governance Measurement

Introduction In AI governance, the value of a measurement depends not only on what is observed, but also on the ability to reconstruct how that observation was produced. Without traceability, signals remain difficult to audit, compare, or defend. This article defines the concept of evidence trails in the context of AI behavioral metrology, explains why

Integrating Runtime Metrology into Existing Governance Processes - NeoMundi Research
AI Governance Reference

Integrating Runtime Metrology into Existing Governance Processes

Introduction Runtime metrology provides structured behavioral signals from AI systems in production. However, the value of these signals depends on how effectively they are integrated into existing organizational governance processes. This article examines the practical considerations involved in connecting a runtime metrology layer to governance workflows. It focuses on integration principles, common challenges, and approaches

Limitations of AI Behavioral Measurement in Production - NeoMundi Research
AI Governance Reference

Limitations of AI Behavioral Measurement in Production

Introduction AI behavioral metrology provides structured methods for observing the behavior of generative systems in production. Like any measurement discipline, it is subject to important limitations. Recognizing these limitations is essential for responsible interpretation and for avoiding overconfidence in the resulting signals. This article outlines the principal limitations of current approaches to AI behavioral measurement

Multi-Signal Analysis for Robust AI Behavioral Monitoring – NeoMundi AI Governance Reference
AI Governance Reference

Multi-Signal Analysis for Robust AI Behavioral Monitoring

Introduction Relying on a single behavioral metric is rarely sufficient for effective AI governance in production. A model may appear stable while showing factual-risk signals, or it may produce coherent outputs that nevertheless drift over time. Multi-signal analysis addresses this limitation by combining several complementary behavioral indicators to form a richer and potentially more robust

Scroll to Top