Author name: Admin

NeoMundi Research publishes reports, external audits, and numerous publications regarding AI (Artificial Intelligence, LLM) metrics, produced by the research laboratory and external contributors.

What the Average Conceals - Analysis of AI Barometers #6 and #7 by James Moore - NeoMundi AI Observatory
AI Observatory

What a Stable Average Can Conceal in Production AI

James Moore’s analysis of AI Barometers #6 and #7 shows how a minimal global shift can mask concentrated changes across specific profiles, tasks and alert types. NeoMundi’s AI Barometers were designed to make the behaviour of AI systems observable over time. Once the measurement is produced, however, another question becomes essential: what can an apparently […]

Privacy-First Design and Data Minimization in AI Behavioral Metrology – AI Governance Reference by NeoMundi Research
AI Governance Reference

Privacy-First Design and Data Minimization in AI Behavioral Metrology

Introduction AI behavioral metrology generates structured observations of generative systems in production. Because these observations are produced from real interactions, the design of the measurement system itself raises important questions related to data protection, privacy, and proportionality. This article examines how a privacy-first approach and the principle of data minimization can be applied to AI

Human Oversight and Decision Authority in Runtime Metrology Systems – AI Governance Reference by NeoMundi Research
AI Governance Reference

Human Oversight and Decision Authority in Runtime Metrology Systems

Introduction Runtime metrology produces structured behavioral signals from AI systems in production. These signals can inform governance processes, but they do not replace human or organizational judgment. Maintaining clear decision authority is a foundational requirement of responsible AI governance. This article examines the role of human oversight in systems that incorporate runtime metrology. It clarifies

From Controlled Measurement Campaigns to Continuous Production Monitoring – AI Governance Reference by NeoMundi Research
AI Governance Reference

From Controlled Measurement Campaigns to Continuous Production Monitoring

Introduction AI behavioral metrology can be applied in two complementary modes: controlled measurement campaigns and continuous production monitoring. These two modes are complementary rather than sequential. Each mode serves distinct purposes, operates under different constraints, and generates different types of insight. This article clarifies the relationship between these two approaches. It explains how controlled campaigns

Building Organizational Maturity in AI Governance Metrology – AI Governance Reference by NeoMundi Research
AI Governance Reference

Building Organizational Maturity in AI Governance Metrology

Introduction AI governance metrology is not only a technical capability. It is also an organizational practice that develops over time. Organizations differ in how systematically they measure AI behavior, interpret signals, and integrate observations into decision processes. This article outlines a maturity perspective on AI governance metrology. It describes progressive levels of capability and highlights

Baselines in AI Behavioral Metrology: Definition and Role - NeoMundi Research
AI Governance Reference

Baselines in AI Behavioral Metrology: Definition and Role

Introduction In AI behavioral metrology, comparison with a reference helps interpret measurements and their variations. Without a clear reference point, observed variations remain difficult to interpret. This reference point is commonly called a baseline. This article defines the concept of a baseline in the context of AI governance metrology, explains its role in longitudinal monitoring

Evidence Trails and Traceability in AI Governance Measurement - NeoMundi Research
AI Governance Reference

Evidence Trails and Traceability in AI Governance Measurement

Introduction In AI governance, the value of a measurement depends not only on what is observed, but also on the ability to reconstruct how that observation was produced. Without traceability, signals remain difficult to audit, compare, or defend. This article defines the concept of evidence trails in the context of AI behavioral metrology, explains why

Integrating Runtime Metrology into Existing Governance Processes - NeoMundi Research
AI Governance Reference

Integrating Runtime Metrology into Existing Governance Processes

Introduction Runtime metrology provides structured behavioral signals from AI systems in production. However, the value of these signals depends on how effectively they are integrated into existing organizational governance processes. This article examines the practical considerations involved in connecting a runtime metrology layer to governance workflows. It focuses on integration principles, common challenges, and approaches

Limitations of AI Behavioral Measurement in Production - NeoMundi Research
AI Governance Reference

Limitations of AI Behavioral Measurement in Production

Introduction AI behavioral metrology provides structured methods for observing the behavior of generative systems in production. Like any measurement discipline, it is subject to important limitations. Recognizing these limitations is essential for responsible interpretation and for avoiding overconfidence in the resulting signals. This article outlines the principal limitations of current approaches to AI behavioral measurement

ControlTower: A Runtime Metrology Layer for AI Governance – NeoMundi Research reference article
AI Governance Reference

ControlTower: A Runtime Metrology Layer for AI Governance

Introduction As organizations move generative AI systems into production, the need for continuous, reproducible behavioral measurement becomes critical. Traditional observability tools focus primarily on infrastructure metrics, while static evaluations provide only periodic snapshots. A dedicated runtime metrology layer is required to bridge this gap. ControlTower is NeoMundi’s runtime metrology layer designed to measure and surface

Scroll to Top