Document Type: Framework
Page Title: MWMS Short Form Batch Testing And Outlier Library Framework
Parent Page: Content Brain
Suggested Slug: mwms-short-form-batch-testing-and-outlier-library-framework
Version: v1.0
Status: Active
Source Course: Kallaway Short Form Academy
Created Date: July 5, 2026
Last Reviewed Date: July 5, 2026
MWMS Short Form Batch Testing And Outlier Library Framework
Purpose
The MWMS Short Form Batch Testing And Outlier Library Framework defines how Content Brain should create, test, analyse, and reuse short form content in controlled production batches.
This framework exists so MWMS does not judge short form content one post at a time.
Short form performance is noisy.
One post can fail for reasons that are not strategically meaningful.
One post can win for reasons that are not yet understood.
The correct MWMS approach is to create content in batches, compare results, extract useful signals, and build a growing library of reusable creative components.
This framework turns short form production into a compounding system.
Core Principle
Short form content should be produced in controlled batches, not isolated guesses.
The MWMS rule is:
Do not overreact to one video.
Produce a batch, review the pattern, extract the winning bricks, and improve the next batch.
Batch Size Standard
The standard MWMS short form testing batch is:
10 videos
A batch of 10 is large enough to reveal early pattern signals but small enough to produce quickly.
The purpose of a 10 video batch is to test:
Formats
Topics
Hooks
Angles
Visual layouts
CTAs
Audience reactions
Platform behaviour
Lead capture paths
Creative execution quality
Why MWMS Uses Batches Of 10
Batches of 10 create several advantages.
They prevent emotional overreaction to one post.
They force enough publishing volume to generate signal.
They allow format comparison.
They create a reviewable production unit.
They help separate weak ideas from weak execution.
They create a clean learning loop.
They make it easier for Content Brain, Ads Brain, and HeadOffice Brain to review performance.
They allow controlled improvement from one batch to the next.
The Four Production Modes
MWMS can use four production modes depending on maturity, speed requirement, and confidence level.
Mode 1: Direct Outlier Replication
This is the beginner or emergency speed mode.
The process:
Find 10 proven outlier videos.
Choose outliers that match the intended avatar, niche, offer, or topic.
Replicate the structure closely.
Keep the format, hook, story flow, visual layout, and CTA mostly intact.
Change only the niche specific substance, example, offer, or avatar language where needed.
Publish the batch.
Review results.
This mode is not ideal long term because it can reduce originality.
However, it can help a new system get moving when no internal data exists.
Approved use cases:
Starting a new channel
Testing a new niche
Validating a new avatar
Building first performance benchmarks
Training a new content operator
Creating quick initial data
Not approved use cases:
Permanent brand strategy
Copying without adaptation
Using another creator’s personal story as if it were MWMS owned
Repeating unique proprietary claims
Using false proof
Replacing original thinking forever
Mode 2: Outlier Adaptation
This is the preferred early stage mode.
The process:
Find 10 proven outlier videos.
Keep the strongest parts of each outlier.
Change two or three bricks.
Publish the adapted batch.
Compare against source assumptions and internal results.
Bricks that may be changed include:
Substance
Avatar framing
Visual hook
Text hook
CTA
Visual layout
Example
Offer connection
Story structure
Platform caption
This mode balances proven market signal with original execution.
Approved use cases:
Affiliate funnel support
Lead magnet promotion
Creator authority building
New offer testing
Content Brain production training
Short form script generation
Mode 3: Format Cluster Testing
This is the preferred MWMS standard mode once enough outliers are available.
The process:
Find outlier examples.
Group them by format.
Select three core formats to test.
Produce 10 videos across those formats.
Usually use three videos per format, with one format receiving four.
Review format level performance after publishing.
Example batch:
3 Common Mistake videos
3 Case Study videos
4 Tutorial videos
Alternative batch:
3 Problem Solution videos
3 Comparison videos
4 Listicle videos
This helps MWMS avoid testing 10 unrelated formats at once.
The goal is to see which format family deserves more production.
Mode 4: Outlier Library Recombination
This is the advanced mode.
The process:
Build a library of winning bricks from many outliers.
Extract the strongest format, topic, seed, hook, structure, CTA, visual layout, and elements from different sources.
Recombine them into new original assets.
Publish the batch.
Review which combinations produce stronger performance.
Example:
Format from one outlier
Topic from another outlier
Spoken hook from another outlier
Visual layout from another outlier
CTA from an internal best performer
Substance from MWMS owned expertise
This is the highest value mode because it allows MWMS to use market data without becoming a clone of other creators.
MWMS Maturity Path
The short form testing system should mature through four stages.
Stage 1: Copy To Learn
Use close outlier modelling to understand platform patterns.
Goal:
Build basic publishing rhythm and learn execution mechanics.
Expected output:
First 10 to 20 videos.
Stage 2: Adapt To Fit
Change selected bricks while retaining proven structures.
Goal:
Start aligning outlier patterns with MWMS avatars, offers, and proof.
Expected output:
Videos 20 to 40.
Stage 3: Cluster To Discover
Test three intentional formats per batch.
Goal:
Discover which format families produce the best audience and business signal.
Expected output:
Videos 40 to 80.
Stage 4: Recombine To Own
Use a growing outlier and internal winner library to create original combinations.
Goal:
Build a distinctive MWMS short form style that is data backed but not derivative.
Expected output:
Ongoing production system.
Outlier Definition
An outlier is a content asset that performs significantly better than the relevant baseline.
Outliers may be identified from:
Competitor channels
Industry creators
Affiliate competitors
Offer owners
Educational creators
AI automation creators
Paid ad libraries
MWMS owned channels
Client channels
Internal historic content
An outlier is not automatically worth copying.
It must be relevant to the MWMS avatar, offer, niche, or content objective.
Outlier Qualification Criteria
Before an outlier is stored or used, Content Brain should assess:
Is the audience similar to the MWMS target avatar?
Is the topic relevant to MWMS business goals?
Is the format executable by MWMS?
Is the hook adaptable without being misleading?
Is the visual layout achievable?
Is the substance transferable?
Is the CTA relevant to a real funnel path?
Does the outlier show meaningful performance relative to its account size?
Is the performance likely due to the content itself rather than celebrity, controversy, trend luck, or platform anomaly?
Can this be adapted ethically and strategically?
Outlier Library Purpose
The outlier library is the memory system for winning creative patterns.
It stores what worked externally and internally so future content can be built faster and smarter.
The library should help MWMS answer:
What formats are working?
What topics are working?
What hooks are working?
What visual patterns are working?
What CTAs are working?
What layouts are working?
What substance angles are working?
What formats create reach?
What formats create leads?
What formats create sales?
What patterns are repeated across multiple winners?
Outlier Library Record Structure
Each outlier record should store:
Source Platform
Source Creator Or Brand
Source URL Or Reference
Date Captured
Niche
Audience
Format
Topic
Seed
Substance
Spoken Hook
Visual Hook
Text Hook
Story Structure
CTA
Visual Layout
Elements
Observed Performance
Baseline Comparison
Why It Appears To Have Worked
Transferability Score
MWMS Adaptation Notes
Related Offer Or Funnel
Recommended Use
Status
Brick Extraction
Every outlier should be broken into reusable bricks.
The required extraction fields are:
Format
Topic
Seed
Substance
Spoken Hook
Visual Hook
Text Hook
Story Structure
CTA
Visual Layout
Elements
This allows MWMS to reuse parts without blindly copying the entire asset.
Example:
The format may be useful but the topic is not.
The hook may be useful but the CTA is weak.
The visual layout may be useful but the substance is shallow.
The CTA may be useful for lead magnets but not for affiliate offers.
The story structure may be useful for Ads Brain even if the organic video itself is not.
Winning Brick Bank
The Winning Brick Bank is a simplified reference layer created from many outlier records.
It should group reusable winners by brick type.
Format Bank
Stores the strongest formats by niche, avatar, and performance goal.
Examples:
Common Mistake
Problem Solution
Case Study
Comparison
Tutorial
Listicle
Reaction
Hero Journey
Topic Bank
Stores high interest audience topics.
Examples:
Affiliate conversion mistakes
AI automation use cases
Lead magnet creation
Paid traffic creative testing
Content bottlenecks
Offer positioning
Email list growth
Hook Bank
Stores high performing hook structures.
Examples:
Most people think X, but the real issue is Y
The fastest way to fix X is not what you think
Here are three mistakes costing you X
I tested X so you do not have to
Before you build X, watch this
Substance Bank
Stores useful explanations, examples, mechanisms, and proof angles.
Examples:
Before and after breakdowns
Step by step processes
Decision rules
Common traps
Mechanism explanations
Comparison criteria
Conversion logic
CTA Bank
Stores proven calls to action by funnel goal.
Examples:
Comment for the checklist
Download the template
Save this for later
Watch part two
Book a call
Join the free training
Start the trial
Visual Layout Bank
Stores layouts that repeatedly support strong performance.
Examples:
Split screen tutorial
Visual greenscreen explainer
Hybrid talking head and B roll
Faceless screen recording
Whiteboard explainer
Comparison clone
Vlog voiceover
Element Bank
Stores reusable visual and audio assets.
Examples:
Caption style
Motion graphic style
B roll category
Screen recording style
Zoom pattern
Transition type
Sound effect style
Music pacing
Batch Planning Record
Before producing a batch, Content Brain should create a Batch Planning Record.
Required fields:
Batch Name
Project
Brand
Platform
Batch Number
Batch Goal
Primary Avatar
Primary Offer Or Funnel
Number Of Videos
Production Mode
Selected Formats
Selected Topics
Outlier Sources
Lead Magnet Connection
CTA Strategy
Publishing Window
Review Date
Success Criteria
Batch Goal Types
Every batch must have one primary goal.
Approved goal types:
Reach
Audience Validation
Format Testing
Hook Testing
Lead Capture
Offer Education
Affiliate Funnel Support
Newsletter Growth
Paid Creative Discovery
Authority Building
Retargeting Asset Creation
Product Launch Support
Client Proof Support
A batch may have secondary goals, but it must have one primary goal.
Batch Construction Rules
A 10 video batch should not be random.
It should follow one of these structures:
Structure A: One Format, Ten Angles
Use when testing depth of one format.
Example:
10 Common Mistake videos across different affiliate funnel errors.
Structure B: Three Formats, One Topic Cluster
Use when testing format fit for one core topic.
Example:
3 Tutorials
3 Comparisons
4 Problem Solution videos
All on lead magnet creation.
Structure C: Three Topics, One Format
Use when testing topic resonance.
Example:
10 Listicles across three topic buckets.
Structure D: One Funnel, Multiple Creative Jobs
Use when supporting a specific lead magnet or offer.
Example:
3 Awareness videos
3 Problem agitation videos
2 Proof videos
2 CTA videos
Structure E: Outlier Adaptation Batch
Use when starting with proven external examples.
Example:
10 adapted outliers with changed substance, examples, and CTA.
Batch Review
After publishing, Content Brain must review the batch as a system.
Do not only ask:
Which video got the most views?
Also ask:
Which format performed best?
Which topic attracted the right audience?
Which hook produced retention?
Which CTA produced action?
Which visual layout helped comprehension?
Which asset generated comments or saves?
Which asset generated clicks or leads?
Which asset has paid ad potential?
Which asset should be remade?
Which brick should enter the Winning Brick Bank?
Performance Metrics
Metrics should be grouped by purpose.
Attention Metrics
Views
Reach
Impressions
Hook Retention
Average Watch Time
Completion Rate
Replays
Engagement Metrics
Likes
Comments
Shares
Saves
Profile Visits
Followers Gained
Business Metrics
Link Clicks
Email Opt Ins
DMs
Comment Keyword Triggers
Bookings
Product Sales
Affiliate Clicks
Affiliate Sales
Cost Per Lead
Revenue Per View
Learning Metrics
Winning Format
Winning Topic
Winning Hook
Winning CTA
Winning Visual Layout
Best Remix Candidate
Best Paid Creative Candidate
Strongest Audience Signal
Weakest Execution Point
Performance Classification
Each video in the batch should be classified.
Failed Test
The asset performed below baseline and produced no useful business signal.
Action:
Record the failure reason.
Do not remake unless the idea was strategically important.
Extract any useful negative learning.
Weak But Useful
The asset underperformed but revealed something useful.
Action:
Keep the learning.
Improve one brick.
Retest only if aligned with the batch goal.
Baseline
The asset performed normally.
Action:
Store as reference.
Retest only if one component seems promising.
Strong Performer
The asset exceeded expected performance.
Action:
Extract winning bricks.
Create variations.
Consider adding to a future batch.
Outlier
The asset significantly outperformed baseline or produced valuable business action.
Action:
Add to Winning Brick Bank.
Create a new batch around its winning components.
Consider paid ad test.
Repurpose into long form, newsletter, article, or lead magnet.
Post Batch Learning Note
Every batch should produce a Post Batch Learning Note.
Required sections:
Batch Summary
What Worked
What Failed
Best Format
Best Topic
Best Hook
Best Visual Layout
Best CTA
Best Business Signal
Recommended Next Batch
Bricks Added To Library
Bricks To Avoid
Paid Creative Candidates
Content Repurposing Candidates
Lead Magnet Opportunities
Offer Messaging Insights
Outlier To Ad Creative Path
When an organic short form asset becomes an outlier, Ads Brain should review it for paid creative testing.
The review should ask:
Did the hook create attention?
Did the topic attract the right buyer?
Did the format explain the offer clearly?
Did the CTA create action?
Is the asset compliant for paid traffic?
Can the opening be turned into a paid ad hook?
Can the substance become an ad body?
Can the CTA become a funnel click?
Can the visual layout be reused in multiple ad variations?
If approved, the asset becomes:
Organic Winner
Creative Test Candidate
Paid Ad Variation
Creative Signal Record
Content To Lead Magnet Path
When a short form asset generates saves, comments, DMs, or repeated questions, AIBS Brain and Newsletter Brain should review it for lead magnet potential.
Potential lead magnet types include:
Single Document Download
Checklist
Template
Mini Email Course
Free Community
Free Training
Product Trial
Sales Page
Booking Page
Content Brain should flag lead magnet opportunities when:
The audience asks for the next step
The same question appears repeatedly
The video explains a process that could become a checklist
The topic creates strong saves
The CTA produces comments or DMs
The asset points to a clear problem worth solving
Content To Long Form Path
Strong short form assets can be repurposed into:
Blog posts
Affiliate support pages
Newsletter issues
YouTube scripts
Lead magnet sections
Sales page sections
Ad scripts
Email sequences
Community posts
Training modules
The Winning Brick Bank should therefore not be limited to social.
It becomes a broader creative intelligence layer for MWMS.
Brain Routing
Content Brain Owns
Batch planning
Short form production
Outlier library structure
Brick extraction
Performance learning notes
Next batch recommendations
Content repurposing candidates
Research Brain Supports
External outlier discovery
Competitor monitoring
Audience language
Topic validation
Trend signals
Market proof
Ads Brain Supports
Creative signal testing
Paid ad adaptation
Hook testing
Offer angle testing
Creative performance comparison
AIBS Brain Supports
Comment automation
DM automation
Lead magnet delivery
CRM routing
Booking flow
Digital product delivery
Automated follow up
Newsletter Brain Supports
Email capture paths
Newsletter topic conversion
Email course creation
Subscriber nurturing
Affiliate Brain Supports
Product angle matching
Affiliate offer fit
Buyer objection mapping
Commission path alignment
Product comparison logic
HeadOffice Brain Oversees
Priority control
Cross Brain coordination
Performance interpretation
Strategic fit
Resource allocation
Minimum Operational Version
The minimum usable version of this system requires:
One Batch Planning Record
10 Short Form Asset Records
At least 10 source outliers or internal references
One publishing window
One review date
One Post Batch Learning Note
One Winning Brick Bank update
If these are not present, the system is not operating as a true batch testing loop.
Example Batch Planning Record
Batch Name: Affiliate Review Conversion Batch 1
Project: Affiliate Brain Funnel Support
Platform: TikTok, Instagram Reels, YouTube Shorts
Batch Number: 1
Batch Goal: Lead Magnet Promotion
Primary Avatar: New Affiliate Marketer
Primary Offer Or Funnel: Affiliate Review Checklist
Production Mode: Format Cluster Testing
Selected Formats: Common Mistake, Problem Solution, Comparison
Selected Topics: Review page trust, buyer objection handling, product comparison
Number Of Videos: 10
CTA Strategy: Comment Checklist
Review Date: Seven days after final post
Success Criteria: Saves, comments, profile visits, checklist opt ins
Outlier Sources: Affiliate marketing creators, content marketing creators, ecommerce review breakdowns
Expected Output: Identify strongest format and hook family for future affiliate content
Example Post Batch Learning Note
Batch Name: Affiliate Review Conversion Batch 1
Summary: Common Mistake format produced the strongest saves and comments. Comparison format produced better watch time but weaker lead action. Problem Solution videos were baseline.
Best Format: Common Mistake
Best Topic: Reviews repeating product claims without buyer objection handling
Best Hook: Traffic is not why your affiliate review is failing
Best Visual Layout: Hybrid talking head with page screenshot
Best CTA: Comment Checklist
Best Business Signal: Checklist opt ins from comment CTA
Next Batch: Create 10 Common Mistake videos focused on affiliate review conversion problems
Bricks Added To Library: Traffic Is Not The Problem hook, review screenshot visual layout, comment checklist CTA
Paid Creative Candidates: Video 3 and Video 7
Lead Magnet Opportunity: Affiliate review audit checklist
Governance Rules
The batch testing system must follow these rules.
Do not judge strategy from one video.
Do not keep producing without review.
Do not store outliers without extracting bricks.
Do not copy forever when adaptation is possible.
Do not chase views if the business goal is leads or sales.
Do not treat tool outputs as strategy.
Do not approve misleading hooks.
Do not use false proof.
Do not let visual style overpower substance.
Do not build a content library that cannot be searched, reused, or analysed.
MWMS Operating Rule
Every batch must produce at least one of the following:
A stronger content format
A stronger hook family
A stronger topic cluster
A stronger CTA
A stronger visual layout
A stronger lead magnet idea
A stronger ad creative candidate
A stronger audience insight
A stronger offer angle
A stronger internal production process
If a batch produces only posts and no learning, it failed as a system.
Relationship To MWMS Short Form Content Lego Brick Production Framework
The MWMS Short Form Content Lego Brick Production Framework defines the parts of each short form asset.
This framework defines how those assets are produced, tested, reviewed, and used across batches.
The first framework answers:
What is inside a short form asset?
This framework answers:
How do we test and compound short form assets over time?
Both frameworks should be used together.
System Change Log
v1.0
Created new Content Brain framework from Kallaway Short Form Academy course absorption.
Added the batch of 10 short form testing standard.
Defined four production modes:
Direct Outlier Replication
Outlier Adaptation
Format Cluster Testing
Outlier Library Recombination
Added MWMS maturity path:
Copy To Learn
Adapt To Fit
Cluster To Discover
Recombine To Own
Added Outlier Library, Winning Brick Bank, Batch Planning Record, Batch Review, Post Batch Learning Note, Outlier To Ad Creative Path, Content To Lead Magnet Path, and Brain Routing.
Defined minimum operational version and governance rules for controlled short form testing.
END OF FULL FILE OUTPUT