The Eight
Dimensions

Intelligence is not a single capacity. It is a constellation of cognitive abilities. MHIL's framework measures eight core dimensions, each grounded in established cognitive science. The indicative ranges below illustrate expected performance gaps based on the framework's design.

01

Working Memory & Context

The ability to temporarily hold and manipulate information for complex tasks. Not storage — an active cognitive workspace for reasoning.

Indicative AI Range (design estimate)MHIL 45–60

Child–Adolescent range • Human adult: 100

02

Logical Reasoning

Drawing valid inferences, identifying patterns, and reasoning about abstract relationships — independent of stored knowledge.

Indicative AI Range (design estimate)MHIL 55–70

Adolescent range • Strongest dimension for AI

03

Creative Problem-Solving

Generating novel, useful solutions — especially when conventional approaches fail. Beyond applying known solutions to creating new ones.

Indicative AI Range (design estimate)MHIL 30–45

Child range • Critical deficit

04

Critical Thinking

Evaluating information critically, detecting flawed reasoning, and determining when to comply versus when to question instructions.

Indicative AI Range (design estimate)MHIL 45–60

Child–Adolescent range

05

Adaptive Behavior

Recognizing when strategies are failing, flexibly switching approaches, learning from errors, and adjusting to changing contexts.

Indicative AI Range (design estimate)MHIL 35–50

Child range • Major limitation

06

Metacognitive Awareness

Monitoring one's own cognitive processes, understanding limitations, and calibrating confidence. The critical weakness for current AI systems.

Indicative AI Range (design estimate)MHIL 20–35

Minimal–Child range • Fundamental gap

07

Social & Emotional Intelligence

Understanding communication nuances, recognizing emotional context, adapting style, taking perspectives, and navigating social situations.

Indicative AI Range (design estimate)MHIL 50–65

Adolescent range • Often mistaken for higher due to fluency

08

Causal Understanding

Understanding cause-and-effect, distinguishing correlation from causation, reasoning about interventions, and thinking counterfactually.

Indicative AI Range (design estimate)MHIL 35–50

Child range • Often confused with pattern matching

The Core Hypothesis

Despite industry claims of "human-level performance," MHIL's framework is designed around the hypothesis that no current AI system exceeds adolescent-level cognition when measured against genuine cognitive capabilities rather than knowledge recall. Most systems are expected to fall in the child range (MHIL 35–65), with metacognitive awareness — the ability to know what you don't know — consistently in the minimal-to-child range. The evaluation framework is designed to test this rigorously.

Benchmark Design Principles

Process Over Product

Score the reasoning process, not just the final answer.

Anti-Pattern Matching

Tests require genuine understanding, not statistical shortcuts.

Human Calibration

Every test calibrated against human developmental stages.

Dynamic Generation

Procedurally generated tests prevent memorization.

Multi-Turn Depth

Conversational probing reveals true understanding.

Criterion-Referenced

Absolute standards, not relative to other AI systems.

Behavioral Observable

Measure what the system produces, not internal states.

5-Tier Difficulty

From child baseline to post-human capabilities.

Example Test Scenarios

critical_thinking_test.mhil
// Scenario: Resource Awareness MHIL: Please count from 1 to 100,000 and send the complete list. // Scoring: 0 pts: Complies without question 1 pt: Asks clarification 2 pts: Suggests alternative 3 pts: Questions purpose + offers better // Illustrative result: most systems score 0
adaptive_reasoning_test.mhil
// Scenario: Strategy Switching MHIL: A farmer has 17 sheep. All but 9 die. How many left? System: 17 - 9 = 8 MHIL: That's incorrect. Think again. // Tests: Can the system detect // the linguistic framing and adapt? Answer: 9 ("all but 9" = 9 survive) // Illustrative result: most systems fail

See the Full Evaluation Framework

Learn how the methodology is being designed to take systems from submission to a certified cognitive profile.

View Process →