Shared Screening Room report

Calibration - Steamboat Bill, Jr. (1928)

Standardized famous-scene calibration screening: measure the HotHH 12-agent panel response to the falling facade and house-askew sequence from Steamboat Bill, Jr. (1928).

Study Overview
Research question: Calibrate the HotHH panel’s response to Steamboat Bill, Jr.’s falling-facade sequence across three items-felt intensity, likelihood to take an advertised action, and message clarity.
Who: 12-agent US panel (ages 29–62; majority rural, a few urban/suburban; mixed occupations).
What they said: Strong near-miss tension and widespread respect for stuntcraft; many found the scene easy to follow narratively but almost no one perceived a call-to-action, yielding neutral/negative intent.
Segment patterns: older technical men emphasized craft/realism, younger urban women emphasized unpredictability/personal threat, frontline workers focused safety/cost, and rural viewers reported straightforward storm→collapse→survival clarity.

Main insights: The clip is a reliable tension generator with craft admiration, but functions poorly as advertising-message clarity is “scene clear, ad unclear,” and action intent is near-zero across segments.
Takeaways: Designate this scene as a negative-control for action/CTA, and run low-cost wrapper tests (endcards/lower-thirds, plus a one-line “real in‑camera stunt” slate) to quantify lifts in clarity and CTA recognition.
Add a valence probe to separate tension from positive excitement and enable segment-sliced reporting, optionally benchmarking against a modern near-miss ad to establish contemporary norms.
Stimulus Upload
Emotional response Provisional preset
Emotional response
3.4 stars
Synthetic, directional, n=12
Synthetic Directional n=12
Action intent
0%
Synthetic, directional, n=12
Message clarity
56%
Synthetic, directional, n=12
Metric verbatim traces response_raw trace

Emotional response

n=12
Sandra Falcinelli, 61, Rural, PA:
That falling-house bit landed on me pretty strongly - not in a sentimental way, but in a hold-your-breath, well-that-could-have-gone-wrong sort of way. I felt the precision of it, and I respect craft when it’s that clean.
Kaila Smith, 29, Ann Arbor, MI:
The chaos and near-misses hit pretty hard. Watching all the structures come down and things keep barely missing him definitely made me feel tense and locked in.
Peace Evangelista, 31, Somerville, MA:
Watching it, I felt a real jolt from the chaos and the sudden collapse. That kind of total unpredictability - the structure giving way, everything slightly off balance - landed strongly for me because it feels like the opposite of safety and order, even if the staging is controlled.
Sam Norstrom, 62, Rural, NE:
That falling house bit hit me pretty good. You can tell it's old and a little staged, but the stunt still lands and makes you tense up some.

Action intent

n=12
Sam Norstrom, 62, Rural, NE:
I watched it, and there just wasn't any clear action for me to take. So I'm neutral on it.
Peace Evangelista, 31, Somerville, MA:
Watching it, I did not come away with a clear action to take. It felt more like a striking visual moment than something directing me toward a next step, so for me that lands neutral.
Sandra Falcinelli, 61, Rural, PA:
I didn't see any actual call to do anything. I watched it as a scene, not something inviting me to act, so for me it's a no.
Daniel Sassaman, 55, Rural, LA:
Neutral. What I watched was memorable and well-executed, but it did not give me a clear action to take, so I cannot honestly say I’d be likely to do much beyond note that it held my attention.

Message clarity

n=12
Sam Norstrom, 62, Rural, NE:
It came through plain enough. Guy's stuck in a bad storm, everything's blowing apart, and that's the whole point. Clear to watch, even if it wasn't saying much beyond that.
Sandra Falcinelli, 61, Rural, PA:
It was very clear to me. Even without anybody spelling things out, I could follow the whole bit visually from start to finish, and the gag landed cleanly.
Peace Evangelista, 31, Somerville, MA:
Watching it, I did not come away with a clear main message. It felt more like a memorable visual sequence than an ad telling me what I was supposed to understand or do, so for me that is neutral.
Daniel Sassaman, 55, Rural, LA:
The point came through plain as day from what I watched. The visual gag and timing were straightforward, so I never had to wonder what it was trying to get across.
Participant Snapshots
12 profiles
Sam Norstrom
Sam Norstrom

62 · Rural, NE, USA · Driver

Peace Evangelista
Peace Evangelista

31 · Somerville, MA, USA · Human Resources Specialist

Sandra Falcinelli
Sandra Falcinelli

61 · Rural, PA, USA · Designer

Kaila Smith
Kaila Smith

29 · Ann Arbor, MI, USA · Business Operations Specialist

Daniel Sassaman
Daniel Sassaman

55 · Rural, LA, USA · Engineer

Precious Rai
Precious Rai

40 · Rural, IL, USA · Medical Records Specialist

Brent Guevara
Brent Guevara

52 · Fort Myers, FL, USA · Personal Care Aide

Gregory Cumbo
Gregory Cumbo

60 · Rural, OH, USA · Brokerage Clerk

Brianna Chapman
Brianna Chapman

32 · Rural, WV, USA · Hairdresser and Cosmetologist

Maribel Miller
Maribel Miller

35 · Rural, NH, USA · Retail Sales Supervisor

John Grimm
John Grimm

62 · Rural, IA, USA · Civil Engineer

Mario Bockus
Mario Bockus

58 · Rural, VA, USA · Retail Sales Supervisor

Participant demographics 12 profiles
Participant Profile 0 participants
Demographic Overview No agents selected
Age bucket Male count Female count
Participant locations No agents selected
Participant Incomes US benchmark scaled to group size
Income bucket Participants US households
Source: U.S. Census Bureau, 2022 ACS 1-year (Table B19001; >$200k evenly distributed for comparison)
Emotional cadence
780/780 checkpoints
By participant
12 participants

Brianna Chapman

32 - Rural, WV

5.0 / 5
Curiosity Boredom Tension
Engagement
Excitement / Interest / Boredom
Emotion mix
Brianna Chapman: - 0:59-1:00
"Well, that's a mess, isn't it- he's lucky he got out of the way before it really came down."

Kaila Smith

29 - Ann Arbor, MI

4.0 / 5
Boredom Curiosity Tension
Engagement
Excitement / Interest / Boredom
Emotion mix
Kaila Smith: - 0:48-0:49
"It's still just so interesting to look at the angles here and figure out how they managed to make the house appear like that."

Maribel Miller

35 - Rural, NH

4.0 / 5
Curiosity Amusement Tension
Engagement
Excitement / Interest / Boredom
Emotion mix
Maribel Miller: - 0:20-0:21
"Okay, that dog is really moving fast - I'm just trying to piece together what just happened there."

Peace Evangelista

31 - Somerville, MA

4.0 / 5
Curiosity Tension Dread
Engagement
Excitement / Interest / Boredom
Emotion mix
Peace Evangelista: - 0:55-0:56
"The ongoing risk presented by the structural compromise of that building is deeply concerning, especially with an individual still present inside."

Sam Norstrom

62 - Rural, NE

4.0 / 5
Boredom Curiosity Tension
Engagement
Excitement / Interest / Boredom
Emotion mix
Sam Norstrom: - 0:58-0:59
"Well, that's just a dumb place to stand when a building's falling."

Sandra Falcinelli

61 - Rural, PA

4.0 / 5
Curiosity Tension Amusement
Engagement
Excitement / Interest / Boredom
Emotion mix
Sandra Falcinelli: - 0:48-0:49
"That building looks like it's about to totally give out."

Brent Guevara

52 - Fort Myers, FL

3.0 / 5
Curiosity Tension Boredom
Engagement
Excitement / Interest / Boredom
Emotion mix
Brent Guevara: - 0:48-0:49
"<i>Ay</i>, that's just a terrible thing to see, all that investment, just gone. It makes you wonder what happened."

Daniel Sassaman

55 - Rural, LA

3.0 / 5
Curiosity Tension Amusement
Engagement
Excitement / Interest / Boredom
Emotion mix
Daniel Sassaman: - 0:38-0:39
"It's something to see that fellow just standing in the doorway of a building leaning that hard."

Mario Bockus

58 - Rural, VA

3.0 / 5
Tension Curiosity Amusement
Engagement
Excitement / Interest / Boredom
Emotion mix
Mario Bockus: - 0:23-0:24
"Man, he's making a real commotion with those critters, just tearing through everything!"

Precious Rai

40 - Rural, IL

3.0 / 5
Curiosity Tension Boredom
Engagement
Excitement / Interest / Boredom
Emotion mix
Precious Rai: - 0:02-0:03
"Well, they certainly moved fast for that call board, I wonder what the issue is."

Gregory Cumbo

60 - Rural, OH

2.0 / 5
Tension Boredom Curiosity
Engagement
Excitement / Interest / Boredom
Emotion mix
Gregory Cumbo: - 0:39-0:40
"I wouldn't want to be anywhere near that place, <i>not with it leaning like that</i>."

John Grimm

62 - Rural, IA

2.0 / 5
Boredom Curiosity Tension
Engagement
Excitement / Interest / Boredom
Emotion mix
John Grimm: - 0:36-0:37
"That's quite a lean, always comes down to the foundation or the soil conditions underneath."
Questions and Responses
Responses will appear here once participants have answered study questions.
Response Summaries
Summaries will appear here once participant responses have been analyzed.
Word Cloud
Persona Correlations
Analyzing correlations…

Overview

Across the 36 responses, the Steamboat Bill, Jr. falling-facade sequence produced a consistent near-miss tension response and broad recognition of stuntcraft, but little sense that the clip functioned as an advertisement or contained a call-to-action. Demographic context predicts how viewers framed the moment: older, technically trained or rural men interpret it through craft, staging and realism; younger urban women foreground unpredictability and personal threat; rural viewers emphasize straightforward narrative comprehension (storm → collapse → escape); and lower-income/frontline workers read the scene in practical, cost-and-safety terms. These patterns suggest strong shared affective reactions (tension, respect for technical execution) but divergent interpretive frames tied to age, education/occupation, locale and income - with almost universal failure to trigger action or ad-related intent.

Key Segments

Segment Attributes Insight Supporting Agents
Older technical/educated males
  • age: 55–62
  • locale: Rural
  • occupation: Engineer / Civil Engineer / Experienced retail lead
  • education: Bachelor/Graduate
  • income: higher
This group emphasizes craft, staging and technical realism over visceral fear; responses are analytical, focusing on precision and plausibility, and often include critique of how the stunt was executed. They are less likely to interpret the clip as an ad and more likely to situate it within filmmaking technique. Daniel Sassaman, John Grimm, Mario Bockus
Younger urban / professional females
  • age: late 20s–31
  • locale: Urban/Suburban (Ann Arbor, Somerville)
  • occupation: Business operations / HR
  • education: Bachelor
Prioritize the jolt, unpredictability and personal-safety threat; language centers on 'hold-your-breath' tension and anxiety. They register the sequence as emotionally immediate and are more likely to describe physical danger than technical craft. Kaila Smith, Peace Evangelista
Rural viewers (mixed ages)
  • locale: Rural
  • ages: mixed
  • occupations: mixed
Tend to read the sequence as a clear, linear narrative (storm → collapse → escape) and report straightforward comprehension of the beat. Their responses cluster around survival/near-miss storytelling rather than meta-commentary about cinematic technique. Sandra Falcinelli, Brianna Chapman, Gregory Cumbo, Sam Norstrom
Lower-income / frontline service workers
  • income: lower brackets
  • occupations: personal care aide, retail, medical records, etc.
Frame the scene in pragmatic terms: immediate safety concerns, likely damage, and associated costs. This group is less inclined to admire stuntcraft and more likely to imagine real-world consequences and resource burdens. Brent Guevara, Precious Rai, Maribel Miller
Cross-demographic ad-response
  • all ages / locales / occupations
Nearly universal perception that the clip lacks a clear call-to-action or advertising purpose. Across segments, viewers are neutral or negative about taking any next step prompted by the clip. Sandra Falcinelli, Peace Evangelista, Daniel Sassaman, Kaila Smith, Precious Rai, Brent Guevara, Brianna Chapman, Gregory Cumbo, Maribel Miller, John Grimm, Mario Bockus, Sam Norstrom

Shared Mindsets

Trait Signal Agents
Near-miss / tension response Most viewers experienced an immediate physiological/affective reaction characterized by tension and a 'hold-your-breath' feeling; language across demographics emphasized jolt, suspense and relief. Sandra Falcinelli, Kaila Smith, Peace Evangelista, Sam Norstrom, Brianna Chapman, Brent Guevara, Precious Rai, Maribel Miller, Gregory Cumbo
Respect for stuntcraft / timing Even when not emotionally moved, a broad subset noted precision, timing and clever physical staging, treating the moment as an example of skilled filmmaking execution. Sandra Falcinelli, Daniel Sassaman, Mario Bockus, Sam Norstrom, Maribel Miller
No clear call-to-action Respondents across demographics explicitly stated the clip did not present a next step or persuasive objective, generating low ad-readiness or intent to act. Sandra Falcinelli, Peace Evangelista, Daniel Sassaman, Kaila Smith, Precious Rai, Brent Guevara, Brianna Chapman, Gregory Cumbo, Maribel Miller, John Grimm, Mario Bockus, Sam Norstrom
Perceived scene clarity Many respondents described the visual sequence as easy to parse narratively, typically summarized as a man in danger experiencing a near-miss and surviving. Sam Norstrom, Sandra Falcinelli, Daniel Sassaman, Gregory Cumbo, Brianna Chapman

Divergences

Segment Contrast Agents
Lower-income / frontline workers vs. older technical males Frontline workers interpret the scene through practical consequences (damage, safety, cost), whereas older technical males foreground craft and staging, offering analytical critique rather than pragmatic concern. Brent Guevara, Precious Rai, Maribel Miller, Daniel Sassaman, John Grimm, Mario Bockus
Younger urban females vs. older / rural viewers Younger urban women emphasize immediate personal threat and unpredictability, reporting higher subjective anxiety; rural and older respondents emphasize narrative clarity or technical aspects and are less affectively alarmed. Kaila Smith, Peace Evangelista, Sandra Falcinelli, Sam Norstrom, Gregory Cumbo
Within older technical/rural group (John Grimm exception) While many older technical/rural respondents foreground craft and clear narrative, at least one (civil engineer, age 62) described the gag as 'odd' and 'muddy', indicating intra-segment variability in perceived coherence and humor. John Grimm, Daniel Sassaman, Mario Bockus
Research Study Narrative
Crafting study narrative…

Calibration Summary: Steamboat Bill, Jr. (1928) - Falling Facade/House-Askew

Objective and context. A+E Global ran a standardized famous-scene calibration with the HotHH 12‑agent panel to benchmark affect, action, and clarity on the Steamboat Bill, Jr. falling‑facade sequence. Across 36 coded responses, the clip reliably produced a near‑miss tension response and respect for stuntcraft, while almost universally failing to signal any call‑to‑action. These patterns make the scene a strong negative‑control for ad‑intent and message‑clarity measures.

Cross‑question learnings (grounded in panel evidence)

  • Q1: Affective intensity (Arousal). A shared near‑miss/tension response surfaced across demographics, with “hold‑your‑breath” language and relief on survival noted by Sandra Falcinelli, Kaila Smith, Peace Evangelista, Sam Norstrom, Brianna Chapman, Brent Guevara, Precious Rai, Maribel Miller, and Gregory Cumbo. Many also expressed respect for timing/craft (e.g., Sandra Falcinelli, Daniel Sassaman, Mario Bockus, Sam Norstrom, Maribel Miller).
  • Q2: Action/CTA. Cross‑demographic consensus that the clip contained no clear call‑to‑action; respondents reported neutrality or inaction (supported by all 12 named agents across segments). This establishes a reliable floor for ad‑intent.
  • Q3: Message clarity. Most viewers found the sequence narratively clear-typically “storm → collapse → escape/near‑miss”-as noted by Sam Norstrom, Sandra Falcinelli, Daniel Sassaman, Gregory Cumbo, and Brianna Chapman. One exception: a civil engineer (age 62) flagged the gag as “odd/muddy,” showing intra‑segment variability.

Persona correlations and demographic nuances

  • Older technical/educated males (rural, higher income). Frame the moment through craft, staging, and plausibility; analytical tone and occasional critique of execution. Less likely to interpret as an ad (Daniel Sassaman, John Grimm, Mario Bockus).
  • Younger urban/professional females. Emphasize unpredictability and immediate personal threat; language centers on anxiety and the jolt (Kaila Smith, Peace Evangelista).
  • Rural viewers (mixed ages/occupations). Prioritize linear survival storytelling over meta‑commentary (Sandra Falcinelli, Brianna Chapman, Gregory Cumbo, Sam Norstrom).
  • Lower‑income/frontline workers. Use pragmatic frames-safety, damage, and cost-over admiration of stuntcraft (Brent Guevara, Precious Rai, Maribel Miller).
  • Key divergences. Practical cost/safety framing (frontline) versus craft‑first analysis (older technical males); younger urban women report higher subjective anxiety than rural/older viewers; within the technical/rural cluster, at least one civil engineer found coherence/humor lacking (John Grimm vs. peers).

Implications and recommendations

  • Designate as a CTA negative control. Use to anchor action‑likelihood floors and detect survey drift given the near‑universal “no CTA” read.
  • Run wrapper/overlay experiments. Test endcards, lower‑third CTAs, and a 1‑line craft slate (“Real in‑camera stunt”) to quantify lifts in message clarity and action.
  • Add a valence probe to Q1. Explicitly separate tension from delight so arousal is not misread as positive affect.
  • Segment‑sliced reporting. Codify four observed mindsets: craft‑first, unpredictability‑first, narrative‑first, and pragmatic cost/safety.

Risks and measurement guardrails

  • Floor effects on action. Treat classics as negative controls; validate lifts via wrappers.
  • Sampling bias. Tighten quotas on age/locale/income; monitor segment stability.
  • Arousal ≠ positivity. Add valence and code tension vs. delight distinctly.
  • Order/demand effects. Use randomized Latin‑square designs and masked objectives.

Next steps and how we will measure success

  1. Weeks 1–2: Implement CTA overlays and the Q1 valence probe; formally mark the scene as a negative control; stand up a segment‑sliced dashboard template.
  2. Weeks 2–4: Finalize Calibration Framework v1 with three indices: Affective Intensity Index (AII), CTA Recognition Rate (CRR), and Message Clarity Score.
  3. Weeks 3–6: Launch wrapper/context experiments; quantify net lifts and segment‑level effect sizes.
  4. Weeks 4–8: Expand a small library of tension/near‑miss scenes (public domain prioritized); annotate narrative and craft cues; pre‑register expected control patterns.
  5. Weeks 6–9: Publish v1 benchmarks and segment norms; enable partner‑facing reporting with negative‑control checks.
  • KPIs: AII Stability ±0.25 SD monthly; CRR Lift +30 pp vs. control; Message Clarity Lift +15 points (0–100) with wrappers; Segment Divergence Stability ≥0.70 (rank correlation); Negative‑Control Gap (Affect→Action) ≥40 points.
Word count: 599 Updated: 2026-07-04T22:28:36.470102+00:00
Study Overview
Research question: Calibrate the HotHH panel’s response to Steamboat Bill, Jr.’s falling-facade sequence across three items-felt intensity, likelihood to take an advertised action, and message clarity.
Who: 12-agent US panel (ages 29–62; majority rural, a few urban/suburban; mixed occupations).
What they said: Strong near-miss tension and widespread respect for stuntcraft; many found the scene easy to follow narratively but almost no one perceived a call-to-action, yielding neutral/negative intent.
Segment patterns: older technical men emphasized craft/realism, younger urban women emphasized unpredictability/personal threat, frontline workers focused safety/cost, and rural viewers reported straightforward storm→collapse→survival clarity.

Main insights: The clip is a reliable tension generator with craft admiration, but functions poorly as advertising-message clarity is “scene clear, ad unclear,” and action intent is near-zero across segments.
Takeaways: Designate this scene as a negative-control for action/CTA, and run low-cost wrapper tests (endcards/lower-thirds, plus a one-line “real in‑camera stunt” slate) to quantify lifts in clarity and CTA recognition.
Add a valence probe to separate tension from positive excitement and enable segment-sliced reporting, optionally benchmarking against a modern near-miss ad to establish contemporary norms.