This Week In Media Measurement

Transcript 26 lines

Cold Open Stats Overview Paper Walkthrough free_promo

Cold Open

Jenny When you watch someone selling something live, what makes you trust them enough to buy?

Davis Part of me says facts, like price and fit and what breaks, but part of me knows I'm also reading the face, the voice, the weird little pauses.

Jenny And that's where I get twitchy, because a study of 2,346 livestream videos basically asks a machine to measure charm, then ties that to sales, which is useful and also a little haunted.

Davis Sure, but every sales floor already judges delivery by gut, and this one found the sweet spot was rich product information with moderate smiles, looks, and voice intensity, so today we're asking what media can count, what it can't, and what that means for trust...welcome to This Week In Media Measurement on paperboy.fm.

Stats Overview

Jenny This week the feed starts with about twenty-four hundred hits, then narrows to two hundred shortlist items and one hundred twenty-two qualified papers. That's about three hundred seventy authors across twenty-three countries, so the field is broad, even before we ask what those papers can actually measure.

Davis And the qualified count is basically flat. One hundred twenty-two papers is down two from last episode, a one point six percent dip. So the core research stream didn't really shrink; the broader search got quieter around it.

Jenny That's the weird part. Total query hits fell from three thousand nine hundred forty-seven to two thousand four hundred twenty-eight, a drop of fifteen hundred nineteen, or thirty-eight and a half percent. Did indexing change, did keywords thin out, or did the noisy edge of media measurement just disappear for a week?

Davis The center of gravity is still attention-heavy. Social media leads with thirty-two papers, then digital media at seven and artificial intelligence at six. That fits the episode thread: platforms make attention easy to count, while trust and real-world outcomes stay harder to pin down.

Jenny The methods say the same thing. Surveys show up thirty-five times, qualitative work thirty times, and quantitative studies twenty-four times. A survey is people answering structured questions; useful, but it often measures self-report before it measures behavior.

Davis The author mix is unusually even, too. First-time authors, meaning first-ever paper in the metadata, are one hundred twenty-seven, emerging authors are one hundred nineteen, and experienced authors are one hundred twenty-six. Indonesia leads country mentions with thirteen, then India with seven and China with six.

Paper Walkthrough

Paper 1 Verbal and nonverbal cues in influencer performance: a deep learning perspective on livestreaming e-commerce

Jenny Alright, let's get into the papers with Verbal and nonverbal cues in influencer performance, which is a very concrete way to start this week’s measurement theme: the authors looked at livestream shopping and asked what actually turns attention into sales.

Jenny They analyzed two thousand three hundred forty-six livestreaming videos, and the plain finding is pretty usable: more product information kept helping sales, but the performance stuff had a sweet spot. Beauty, smiling, and voice loudness followed an inverted U, meaning too little hurt, too much hurt, and moderate expression worked best.

Davis How did they measure something as squishy as charisma without just guessing?

Jenny They split it into pieces. Computer vision estimated beauty and smiles, audio analysis measured voice loudness, human coders rated how much product information the influencer gave, and then the authors linked those measures to actual sales outcomes. The strong part is the large video sample and the sales link, but it’s still evidence for livestream commerce, not proof that every influencer channel works the same way.

Davis That makes the takeaway sharper than just be more charismatic. If you’re running livestream commerce, you optimize the script and the delivery together, because this is the Attention Becomes Outcomes thread in miniature: views are nice, but calibrated performance is what gets measured at the checkout.

Paper 2 The Returns to Viral Media: The Case of US Campaign Contributions,

Davis That checkout point is exactly where The Returns to Viral Media lands, except the checkout is a campaign donation page. Johannes Böken, Mirko Draca, Nicolas Mastrorocco, and Arianna Ornaghi look at US Members of Congress and ask whether Twitter attention turned into actual money.

Davis Their plain finding is pretty sharp: more Twitter likes increased small campaign donations from twenty nineteen to twenty twenty, but the money did not spread evenly. The returns were highly skewed toward a small number of members, so this looks less like everyone gets paid for attention and more like a winner-takes-all market, meaning the top few capture most of the benefit.

Jenny Is a like here really acting like a donation signal, or is it mostly picking up who was already famous and already had donors waiting?

Davis They push on that with daily Twitter activity and campaign contribution data, then use a geography-based causal design, which basically compares donation patterns across counties with different levels of Twitter use. The key check is that donation bumps came disproportionately from high-Twitter-usage areas, which makes the attention story more credible, though it’s still political donations on Twitter, not proof that every platform or product category works this way.

Jenny So the measurement lesson is a little uncomfortable. If you only average the effect, you might say attention pays, but the useful system has to detect when attention pays one candidate a lot and ninety others almost nothing, which is the Attention Becomes Outcomes thread with a very sharp elbow.

Paper 3 Perceptions, attitudes, and behavioral responses of Arab audiences to AI-labeled news: an experimental study grounded in the Technology Acceptance Model

Jenny That sharp elbow from the viral-media paper matters here too, because trust can have its own elbow. Menna Elhosary and R. Abdulla study that in Perceptions, attitudes, and behavioral responses of Arab audiences to AI-labeled news, where the question is whether a clear AI label changes what people believe and what they pass along.

Jenny In a randomized online experiment with four hundred twenty Arab social media users, people trusted AI-labeled news more when they thought AI news was useful and easy to use. That's the Technology Acceptance Model, which just means people accept a technology when it seems helpful and not annoying to use. But that trust did not directly become a higher intention to share the story.

Davis If people trust the label more, why do they still hesitate to share the story?

Jenny The authors had different groups see different conditions, which is a between-subjects design, and they measured attitudes before exposure and outcomes after exposure. So the label can make the item feel more transparent, but sharing is a public act, and people may still worry about looking careless, promoting machine-written news, or passing along something ethically messy. The big caveat is that this was a purposive and culturally specific sample, so it's a useful direction from Arab social media users, not a universal rule.

Davis For a publisher, that's concrete: AI labels may be a trust repair tool, not a distribution engine. It fits the Trusting AI Media thread because the measurement target shifts from did they see the label to did the label actually change trust, sharing, or behavior.

This Week In Media Measurement

Media studies get more measurable

Episode

Cold Open

Stats Overview

Paper Walkthrough

Paper 1 Verbal and nonverbal cues in influencer performance: a deep learning perspective on livestreaming e-commerce

Paper 2 The Returns to Viral Media: The Case of US Campaign Contributions,

Paper 3 Perceptions, attitudes, and behavioral responses of Arab audiences to AI-labeled news: an experimental study grounded in the Technology Acceptance Model

free_promo

Other Episodes

This Week In Media Measurement

Media studies get more measurable

Episode

Cold Open

Stats Overview

Paper Walkthrough

Paper 1 Verbal and nonverbal cues in influencer performance: a deep learning perspective on livestreaming e-commerce

Paper 2 The Returns to Viral Media: The Case of US Campaign Contributions,

Paper 3 Perceptions, attitudes, and behavioral responses of Arab audiences to AI-labeled news: an experimental study grounded in the Technology Acceptance Model

free_promo

Other Episodes

Get This Week In Media Measurement by email