Document Type: Standard
Status: Active
Version: v1.0
Authority: HeadOffice
Applies To: Experimentation Brain, Ads Brain, Affiliate Brain, Research Brain, Finance Brain
Parent: Experimentation Brain
Last Reviewed: 2026-03-30
Purpose
Experimentation Brain Evidence Hierarchy defines how different types of evidence are weighted when interpreting experimental results.
Not all signals carry equal reliability.
Some signals are more stable, more repeatable, and more decision-relevant than others.
Evidence hierarchy ensures MWMS does not overvalue weak indicators or undervalue strong indicators.
Evidence weighting improves decision consistency.
Core Principle
Evidence should influence decisions in proportion to its reliability.
Higher-quality evidence:
reduces uncertainty
improves confidence accuracy
supports safer scaling decisions
Lower-quality evidence:
may still provide insight
but should not dominate decision influence
Evidence hierarchy protects decision discipline.
Role Inside MWMS Ecosystem
Evidence hierarchy connects:
Experimentation Brain
Ads Brain
Affiliate Brain
Finance Brain
Research Brain
HeadOffice
It ensures signal interpretation reflects structural evidence strength.
Evidence hierarchy supports:
confidence progression discipline
capital exposure discipline
signal reliability awareness
learning loop quality
Consistent evidence weighting improves system intelligence.
Evidence Reliability Factors
Evidence reliability may be influenced by:
signal consistency
signal stability
environmental robustness
sample relevance
structural clarity
repeatability
Evidence demonstrating stability across conditions is typically more reliable.
Evidence based on isolated variation may require caution.
Relative Evidence Strength
Evidence can vary in structural reliability depending on:
consistency of observation
repeatability of results
sensitivity to environmental variation
clarity of causal relationship
alignment with prior validated signals
Stronger evidence supports stronger confidence progression.
Weaker evidence should influence decisions cautiously.
Evidence Context Awareness
Evidence should be interpreted relative to its context.
Context may include:
test environment
platform behaviour
audience characteristics
creative structure
offer structure
timing conditions
Evidence without context may produce misleading conclusions.
Context improves interpretation accuracy.
Interaction with Signal Confidence Framework
Signal confidence should reflect evidence quality.
Higher confidence requires stronger evidence.
Weak evidence should not produce strong confidence classification.
Confidence discipline depends on evidence discipline.
Interaction with Test Interpretation Discipline
Interpretation discipline ensures evidence meaning is understood correctly.
Evidence hierarchy ensures evidence strength is weighted appropriately.
Strong interpretation depends on understanding both:
signal meaning
signal strength
Evidence weighting improves interpretation accuracy.
Interaction with Learning Loop Integrity
Learning Loop Integrity ensures evidence contributes to long-term knowledge accumulation.
Evidence hierarchy improves the quality of stored learning.
Higher-quality evidence produces more valuable long-term insight.
Learning quality depends on evidence quality.
Interaction with Financial Signal Sensitivity
Financial exposure decisions should reflect evidence strength.
Weak evidence may justify exploratory testing.
Strong evidence may justify controlled progression.
Evidence hierarchy supports capital protection discipline.
Interaction with Ads Brain Performance Signals
Ads Brain produces performance metrics.
Evidence hierarchy ensures performance metrics are interpreted with appropriate weight.
Performance variation alone does not determine structural validity.
Evidence context influences signal reliability.
Interaction with Affiliate Brain Opportunity Evaluation
Affiliate Brain evaluates structural opportunity viability.
Evidence hierarchy ensures opportunity progression decisions reflect reliable signal strength.
Weak evidence should not justify strong opportunity classification.
Strong evidence strengthens opportunity confidence.
Evidence Consistency Considerations
Evidence reliability improves when observations demonstrate consistency across:
multiple variations
multiple audiences
multiple environments
multiple time windows
Consistent evidence strengthens confidence progression.
Inconsistent evidence requires caution.
Evidence Stability Considerations
Stable signals tend to:
demonstrate similar behaviour under varied conditions
maintain directionality across environments
produce repeatable patterns
Stable evidence supports structured decision progression.
Unstable evidence requires further validation.
Structural Examples
Example A
A performance improvement appears only in a single variation under narrow conditions.
Interpretation:
evidence may be exploratory.
Confidence progression should remain limited.
Example B
Performance improvements appear across multiple variations and audiences.
Interpretation:
evidence strength may support confidence progression.
Further structured validation may be appropriate.
Example C
Signals fluctuate significantly under minor environmental changes.
Interpretation:
evidence stability may be weak.
Additional testing may improve signal clarity.
Out of Scope
This standard does not define:
exact statistical thresholds
specific platform metrics
specific campaign settings
specific test budgets
These belong to operational layers.
Evidence hierarchy defines structural weighting discipline.
Structural Summary
Experimentation Brain Evidence Hierarchy ensures MWMS decisions reflect appropriate weighting of signal strength.
It improves:
confidence accuracy
capital protection discipline
learning quality
decision stability
Stronger evidence improves safer scaling behaviour.
Related Pages
Experimentation Brain
Experimentation Brain Canon
Experimentation Brain Architecture
Experimentation Employee Registry
Experimentation Brain Signal Confidence Framework
Experimentation Brain Test Interpretation Discipline
Experimentation Brain Learning Loop Integrity
Experimentation Brain Financial Signal Sensitivity
Finance Brain Phase 4 Testing Financial Discipline
Ads Brain Creative Testing Workflow
Change Log
2026-03-30
Page Created: Experimentation Brain Evidence Hierarchy
Version: v1.0
Nature of Change: Introduced structured evidence weighting discipline improving signal reliability and confidence accuracy across MWMS experimentation processes.
Approved By: HeadOffice