Calibration - Steamboat Bill, Jr. (1928)
Standardized famous-scene calibration screening: measure the HotHH 12-agent panel response to the falling facade and house-askew sequence from Steamboat Bill, Jr. (1928).
Who: 12-agent US panel (ages 29–62; majority rural, a few urban/suburban; mixed occupations).
What they said: Strong near-miss tension and widespread respect for stuntcraft; many found the scene easy to follow narratively but almost no one perceived a call-to-action, yielding neutral/negative intent.
Segment patterns: older technical men emphasized craft/realism, younger urban women emphasized unpredictability/personal threat, frontline workers focused safety/cost, and rural viewers reported straightforward storm→collapse→survival clarity.
Main insights: The clip is a reliable tension generator with craft admiration, but functions poorly as advertising-message clarity is “scene clear, ad unclear,” and action intent is near-zero across segments.
Takeaways: Designate this scene as a negative-control for action/CTA, and run low-cost wrapper tests (endcards/lower-thirds, plus a one-line “real in‑camera stunt” slate) to quantify lifts in clarity and CTA recognition.
Add a valence probe to separate tension from positive excitement and enable segment-sliced reporting, optionally benchmarking against a modern near-miss ad to establish contemporary norms.
Emotional response
n=12That falling-house bit landed on me pretty strongly - not in a sentimental way, but in a hold-your-breath, well-that-could-have-gone-wrong sort of way. I felt the precision of it, and I respect craft when it’s that clean.
The chaos and near-misses hit pretty hard. Watching all the structures come down and things keep barely missing him definitely made me feel tense and locked in.
Watching it, I felt a real jolt from the chaos and the sudden collapse. That kind of total unpredictability - the structure giving way, everything slightly off balance - landed strongly for me because it feels like the opposite of safety and order, even if the staging is controlled.
That falling house bit hit me pretty good. You can tell it's old and a little staged, but the stunt still lands and makes you tense up some.
Action intent
n=12I watched it, and there just wasn't any clear action for me to take. So I'm neutral on it.
Watching it, I did not come away with a clear action to take. It felt more like a striking visual moment than something directing me toward a next step, so for me that lands neutral.
I didn't see any actual call to do anything. I watched it as a scene, not something inviting me to act, so for me it's a no.
Neutral. What I watched was memorable and well-executed, but it did not give me a clear action to take, so I cannot honestly say I’d be likely to do much beyond note that it held my attention.
Message clarity
n=12It came through plain enough. Guy's stuck in a bad storm, everything's blowing apart, and that's the whole point. Clear to watch, even if it wasn't saying much beyond that.
It was very clear to me. Even without anybody spelling things out, I could follow the whole bit visually from start to finish, and the gag landed cleanly.
Watching it, I did not come away with a clear main message. It felt more like a memorable visual sequence than an ad telling me what I was supposed to understand or do, so for me that is neutral.
The point came through plain as day from what I watched. The visual gag and timing were straightforward, so I never had to wonder what it was trying to get across.
Sam Norstrom
62 · Rural, NE, USA · Driver
Peace Evangelista
31 · Somerville, MA, USA · Human Resources Specialist
Sandra Falcinelli
61 · Rural, PA, USA · Designer
Kaila Smith
29 · Ann Arbor, MI, USA · Business Operations Specialist
Daniel Sassaman
55 · Rural, LA, USA · Engineer
Precious Rai
40 · Rural, IL, USA · Medical Records Specialist
Brent Guevara
52 · Fort Myers, FL, USA · Personal Care Aide
Gregory Cumbo
60 · Rural, OH, USA · Brokerage Clerk
Brianna Chapman
32 · Rural, WV, USA · Hairdresser and Cosmetologist
Maribel Miller
35 · Rural, NH, USA · Retail Sales Supervisor
John Grimm
62 · Rural, IA, USA · Civil Engineer
Mario Bockus
58 · Rural, VA, USA · Retail Sales Supervisor
Sam Norstrom
62 · Rural, NE, USA · Driver
Peace Evangelista
31 · Somerville, MA, USA · Human Resources Specialist
Sandra Falcinelli
61 · Rural, PA, USA · Designer
Kaila Smith
29 · Ann Arbor, MI, USA · Business Operations Specialist
Daniel Sassaman
55 · Rural, LA, USA · Engineer
Precious Rai
40 · Rural, IL, USA · Medical Records Specialist
Brent Guevara
52 · Fort Myers, FL, USA · Personal Care Aide
Gregory Cumbo
60 · Rural, OH, USA · Brokerage Clerk
Brianna Chapman
32 · Rural, WV, USA · Hairdresser and Cosmetologist
Maribel Miller
35 · Rural, NH, USA · Retail Sales Supervisor
John Grimm
62 · Rural, IA, USA · Civil Engineer
Mario Bockus
58 · Rural, VA, USA · Retail Sales Supervisor
| Age bucket | Male count | Female count |
|---|
| Income bucket | Participants | US households |
|---|
Brianna Chapman
32 - Rural, WV
"Well, that's a mess, isn't it- he's lucky he got out of the way before it really came down."
Kaila Smith
29 - Ann Arbor, MI
"It's still just so interesting to look at the angles here and figure out how they managed to make the house appear like that."
Maribel Miller
35 - Rural, NH
"Okay, that dog is really moving fast - I'm just trying to piece together what just happened there."
Peace Evangelista
31 - Somerville, MA
"The ongoing risk presented by the structural compromise of that building is deeply concerning, especially with an individual still present inside."
Sam Norstrom
62 - Rural, NE
"Well, that's just a dumb place to stand when a building's falling."
Sandra Falcinelli
61 - Rural, PA
"That building looks like it's about to totally give out."
Brent Guevara
52 - Fort Myers, FL
"<i>Ay</i>, that's just a terrible thing to see, all that investment, just gone. It makes you wonder what happened."
Daniel Sassaman
55 - Rural, LA
"It's something to see that fellow just standing in the doorway of a building leaning that hard."
Mario Bockus
58 - Rural, VA
"Man, he's making a real commotion with those critters, just tearing through everything!"
Precious Rai
40 - Rural, IL
"Well, they certainly moved fast for that call board, I wonder what the issue is."
Gregory Cumbo
60 - Rural, OH
"I wouldn't want to be anywhere near that place, <i>not with it leaning like that</i>."
John Grimm
62 - Rural, IA
"That's quite a lean, always comes down to the foundation or the soil conditions underneath."
Summary
Themes
| Theme | Count | Example Participant | Example Quote |
|---|
Outliers
| Agent | Snippet | Reason |
|---|
Overview
Key Segments
| Segment | Attributes | Insight | Supporting Agents |
|---|---|---|---|
| Older technical/educated males |
|
This group emphasizes craft, staging and technical realism over visceral fear; responses are analytical, focusing on precision and plausibility, and often include critique of how the stunt was executed. They are less likely to interpret the clip as an ad and more likely to situate it within filmmaking technique. | Daniel Sassaman, John Grimm, Mario Bockus |
| Younger urban / professional females |
|
Prioritize the jolt, unpredictability and personal-safety threat; language centers on 'hold-your-breath' tension and anxiety. They register the sequence as emotionally immediate and are more likely to describe physical danger than technical craft. | Kaila Smith, Peace Evangelista |
| Rural viewers (mixed ages) |
|
Tend to read the sequence as a clear, linear narrative (storm → collapse → escape) and report straightforward comprehension of the beat. Their responses cluster around survival/near-miss storytelling rather than meta-commentary about cinematic technique. | Sandra Falcinelli, Brianna Chapman, Gregory Cumbo, Sam Norstrom |
| Lower-income / frontline service workers |
|
Frame the scene in pragmatic terms: immediate safety concerns, likely damage, and associated costs. This group is less inclined to admire stuntcraft and more likely to imagine real-world consequences and resource burdens. | Brent Guevara, Precious Rai, Maribel Miller |
| Cross-demographic ad-response |
|
Nearly universal perception that the clip lacks a clear call-to-action or advertising purpose. Across segments, viewers are neutral or negative about taking any next step prompted by the clip. | Sandra Falcinelli, Peace Evangelista, Daniel Sassaman, Kaila Smith, Precious Rai, Brent Guevara, Brianna Chapman, Gregory Cumbo, Maribel Miller, John Grimm, Mario Bockus, Sam Norstrom |
Shared Mindsets
| Trait | Signal | Agents |
|---|---|---|
| Near-miss / tension response | Most viewers experienced an immediate physiological/affective reaction characterized by tension and a 'hold-your-breath' feeling; language across demographics emphasized jolt, suspense and relief. | Sandra Falcinelli, Kaila Smith, Peace Evangelista, Sam Norstrom, Brianna Chapman, Brent Guevara, Precious Rai, Maribel Miller, Gregory Cumbo |
| Respect for stuntcraft / timing | Even when not emotionally moved, a broad subset noted precision, timing and clever physical staging, treating the moment as an example of skilled filmmaking execution. | Sandra Falcinelli, Daniel Sassaman, Mario Bockus, Sam Norstrom, Maribel Miller |
| No clear call-to-action | Respondents across demographics explicitly stated the clip did not present a next step or persuasive objective, generating low ad-readiness or intent to act. | Sandra Falcinelli, Peace Evangelista, Daniel Sassaman, Kaila Smith, Precious Rai, Brent Guevara, Brianna Chapman, Gregory Cumbo, Maribel Miller, John Grimm, Mario Bockus, Sam Norstrom |
| Perceived scene clarity | Many respondents described the visual sequence as easy to parse narratively, typically summarized as a man in danger experiencing a near-miss and surviving. | Sam Norstrom, Sandra Falcinelli, Daniel Sassaman, Gregory Cumbo, Brianna Chapman |
Divergences
| Segment | Contrast | Agents |
|---|---|---|
| Lower-income / frontline workers vs. older technical males | Frontline workers interpret the scene through practical consequences (damage, safety, cost), whereas older technical males foreground craft and staging, offering analytical critique rather than pragmatic concern. | Brent Guevara, Precious Rai, Maribel Miller, Daniel Sassaman, John Grimm, Mario Bockus |
| Younger urban females vs. older / rural viewers | Younger urban women emphasize immediate personal threat and unpredictability, reporting higher subjective anxiety; rural and older respondents emphasize narrative clarity or technical aspects and are less affectively alarmed. | Kaila Smith, Peace Evangelista, Sandra Falcinelli, Sam Norstrom, Gregory Cumbo |
| Within older technical/rural group (John Grimm exception) | While many older technical/rural respondents foreground craft and clear narrative, at least one (civil engineer, age 62) described the gag as 'odd' and 'muddy', indicating intra-segment variability in perceived coherence and humor. | John Grimm, Daniel Sassaman, Mario Bockus |
Calibration Summary: Steamboat Bill, Jr. (1928) - Falling Facade/House-Askew
Objective and context. A+E Global ran a standardized famous-scene calibration with the HotHH 12‑agent panel to benchmark affect, action, and clarity on the Steamboat Bill, Jr. falling‑facade sequence. Across 36 coded responses, the clip reliably produced a near‑miss tension response and respect for stuntcraft, while almost universally failing to signal any call‑to‑action. These patterns make the scene a strong negative‑control for ad‑intent and message‑clarity measures.
Cross‑question learnings (grounded in panel evidence)
- Q1: Affective intensity (Arousal). A shared near‑miss/tension response surfaced across demographics, with “hold‑your‑breath” language and relief on survival noted by Sandra Falcinelli, Kaila Smith, Peace Evangelista, Sam Norstrom, Brianna Chapman, Brent Guevara, Precious Rai, Maribel Miller, and Gregory Cumbo. Many also expressed respect for timing/craft (e.g., Sandra Falcinelli, Daniel Sassaman, Mario Bockus, Sam Norstrom, Maribel Miller).
- Q2: Action/CTA. Cross‑demographic consensus that the clip contained no clear call‑to‑action; respondents reported neutrality or inaction (supported by all 12 named agents across segments). This establishes a reliable floor for ad‑intent.
- Q3: Message clarity. Most viewers found the sequence narratively clear-typically “storm → collapse → escape/near‑miss”-as noted by Sam Norstrom, Sandra Falcinelli, Daniel Sassaman, Gregory Cumbo, and Brianna Chapman. One exception: a civil engineer (age 62) flagged the gag as “odd/muddy,” showing intra‑segment variability.
Persona correlations and demographic nuances
- Older technical/educated males (rural, higher income). Frame the moment through craft, staging, and plausibility; analytical tone and occasional critique of execution. Less likely to interpret as an ad (Daniel Sassaman, John Grimm, Mario Bockus).
- Younger urban/professional females. Emphasize unpredictability and immediate personal threat; language centers on anxiety and the jolt (Kaila Smith, Peace Evangelista).
- Rural viewers (mixed ages/occupations). Prioritize linear survival storytelling over meta‑commentary (Sandra Falcinelli, Brianna Chapman, Gregory Cumbo, Sam Norstrom).
- Lower‑income/frontline workers. Use pragmatic frames-safety, damage, and cost-over admiration of stuntcraft (Brent Guevara, Precious Rai, Maribel Miller).
- Key divergences. Practical cost/safety framing (frontline) versus craft‑first analysis (older technical males); younger urban women report higher subjective anxiety than rural/older viewers; within the technical/rural cluster, at least one civil engineer found coherence/humor lacking (John Grimm vs. peers).
Implications and recommendations
- Designate as a CTA negative control. Use to anchor action‑likelihood floors and detect survey drift given the near‑universal “no CTA” read.
- Run wrapper/overlay experiments. Test endcards, lower‑third CTAs, and a 1‑line craft slate (“Real in‑camera stunt”) to quantify lifts in message clarity and action.
- Add a valence probe to Q1. Explicitly separate tension from delight so arousal is not misread as positive affect.
- Segment‑sliced reporting. Codify four observed mindsets: craft‑first, unpredictability‑first, narrative‑first, and pragmatic cost/safety.
Risks and measurement guardrails
- Floor effects on action. Treat classics as negative controls; validate lifts via wrappers.
- Sampling bias. Tighten quotas on age/locale/income; monitor segment stability.
- Arousal ≠ positivity. Add valence and code tension vs. delight distinctly.
- Order/demand effects. Use randomized Latin‑square designs and masked objectives.
Next steps and how we will measure success
- Weeks 1–2: Implement CTA overlays and the Q1 valence probe; formally mark the scene as a negative control; stand up a segment‑sliced dashboard template.
- Weeks 2–4: Finalize Calibration Framework v1 with three indices: Affective Intensity Index (AII), CTA Recognition Rate (CRR), and Message Clarity Score.
- Weeks 3–6: Launch wrapper/context experiments; quantify net lifts and segment‑level effect sizes.
- Weeks 4–8: Expand a small library of tension/near‑miss scenes (public domain prioritized); annotate narrative and craft cues; pre‑register expected control patterns.
- Weeks 6–9: Publish v1 benchmarks and segment norms; enable partner‑facing reporting with negative‑control checks.
- KPIs: AII Stability ±0.25 SD monthly; CRR Lift +30 pp vs. control; Message Clarity Lift +15 points (0–100) with wrappers; Segment Divergence Stability ≥0.70 (rank correlation); Negative‑Control Gap (Affect→Action) ≥40 points.
Who: 12-agent US panel (ages 29–62; majority rural, a few urban/suburban; mixed occupations).
What they said: Strong near-miss tension and widespread respect for stuntcraft; many found the scene easy to follow narratively but almost no one perceived a call-to-action, yielding neutral/negative intent.
Segment patterns: older technical men emphasized craft/realism, younger urban women emphasized unpredictability/personal threat, frontline workers focused safety/cost, and rural viewers reported straightforward storm→collapse→survival clarity.
Main insights: The clip is a reliable tension generator with craft admiration, but functions poorly as advertising-message clarity is “scene clear, ad unclear,” and action intent is near-zero across segments.
Takeaways: Designate this scene as a negative-control for action/CTA, and run low-cost wrapper tests (endcards/lower-thirds, plus a one-line “real in‑camera stunt” slate) to quantify lifts in clarity and CTA recognition.
Add a valence probe to separate tension from positive excitement and enable segment-sliced reporting, optionally benchmarking against a modern near-miss ad to establish contemporary norms.
| Participant | Response | Actions |
|---|