Measuring Media’s Messy Effects
This week’s featured papers treat media less as a vague influence and more as something to be measured: through algorithms, platform analytics, surveys, interviews, and smartphone logs. The common question is practical and uneasy: what can digital media reveal, and where do its measurements strain trust?
- Several papers foreground measurement through platform analytics, smartphone logs, surveys, interviews, and tool-building rather than treating media influence only in general terms.
- Social platforms are being studied as accountability, crisis, and government communication channels, not just audience megaphones.
- Digital media research in this set also reaches intimate outcomes, including body image, attractiveness, and self-injury or suicidal behaviors.
Better instruments, harder questions
The role of generative algorithms in changing the structure of knowledge production and improving the quality of measurement tools in digital media research
It directly asks how generative algorithms may reshape knowledge production and improve measurement tools in digital media research, while raising reliability and epistemological concerns.
Objectively Measured Social Media Duration in Relation to Non-Suicidal Self-Injury, Suicide Ideation, and Suicide Attempt Among Young Adults.
It addresses a measurement weakness in prior social media research by using smartphone monitoring rather than self-reported use to study associations with non-suicidal self-injury and suicidal behaviors.
Planning and Evaluation of Social Media Content for the Dissemination of Chinese Culture
It treats platform analytics—engagement, reach, and user interaction—as part of evaluating cultural social media content, making measurement central to dissemination.
Platforms as public infrastructure
Moroccan Social Media Users’ Views on Facebook and YouTube as Media Accountability Instruments
It examines Facebook and YouTube as media accountability instruments in Morocco, combining a user survey with journalist interviews and identifying an empowerment-responsiveness gap.
The effectiveness of media content in crisis communication management for official spokespeople in government agencies in the Kingdom of Saudi Arabia
It studies crisis communication by official Saudi government spokespeople through qualities such as clarity, credibility, and timely response.
The effectiveness of digital government communication via the X platform in reaching the local audience: An applied study on the account of the Eastern Province Municipality
It focuses on whether a Saudi municipality’s X account effectively reaches local audiences, tying government communication to transparency and direct public interaction.
Media meets the body
Body image and self-attractiveness in a relationship during the menopausal transition: associations with digital media and perceived media influence
It examines associations among internet and social media use, perceived media influence, body image, and self-perceived attractiveness among women in the menopausal transition.
Summary written from this week's papers and fact-checked against their abstracts.
Episode
2026-06-17 – 2026-06-24
124 papers
Covered in this episode
Papers:
Engagement without approval: comparing YouTube discourse, interpretive framing, and sentiment integrity of Usher and Kendrick Lamar Super Bowl halftime shows
Modeling recreational visitation at Bureau of Land Management sites
Propensity Score Adjustment (PSA)weighting technique for reducing bias in web panel surveys
Trust, trustworthiness and credibility in corporate social media communication: a TCM-ADO framework-based systematic review
+16 more
Transcript 28 lines
Cold Open
Jenny
When a post blows up, do you assume people actually liked it?
Davis
I want to say no, because I'm a grown adult, but if everyone is talking about it I still catch myself filing that as a win.
Jenny
That's the trap this week, because the countable thing is loudness, and loudness can be delight, outrage, fandom, dunking, or just people trying to be seen.
Davis
So the useful question isn't did it travel, it's what kind of attention traveled, and whether the measurement can tell applause from a pile-on.
Jenny
Exactly, and in a Super Bowl YouTube study, Kendrick Lamar pulled far more comments, but Usher had the stronger sentiment integrity signal, meaning the approval looked cleaner and more consistent...welcome to This Week In Media Measurement on paperboy.fm.
Stats Overview
Davis
This week, we scanned just over 2,000 hits and ended up with 124 qualified papers, from about 420 unique authors across 22 countries. So the raw pile got smaller, but the usable stack got a little bigger.
Jenny
That's the interesting split: query hits fell from 2,415 to 2,047, down about 15%, while qualified papers rose from 114 to 124, up 10 papers, or 8.8%. I wouldn't call that a surge yet; the visible driver looks like topic fit, because social media and survey-heavy work are exactly the kinds of studies this feed catches cleanly.
Davis
The author map widens and narrows at the same time. Unique authors rose from 362 to 420, up 16%, but country coverage dropped from 29 to 22, with Indonesia at 24 papers, China at 8, and Saudi Arabia at 5, so it looks like more people publishing inside fewer national lanes.
Jenny
And the career mix is almost evenly split: 137 first-time authors, meaning first-ever paper in the metadata, 150 emerging authors, and 133 experienced authors. That's about a third in each bucket, which makes me ask whether this is a stable measurement field or a lot of new entrants using familiar survey tools.
Davis
Theme-wise, social media dominates with 26 papers, then digital media and elementary education sit at 7 each. Method-wise, surveys lead with 46 papers, ahead of quantitative at 30 and qualitative at 29, which fits the week’s through-line: the easiest media numbers to count are still doing a lot of the talking.
Paper Walkthrough
Paper 1 Engagement without approval: comparing YouTube discourse, interpretive framing, and sentiment integrity of Usher and Kendrick Lamar Super Bowl halftime shows
Jenny
Alright, let's get into the papers with Philip Kang and Samantha Smith's Engagement without approval, a twenty twenty-six study in Sport, Business and Management that asks a very clean media-measurement question: when a Super Bowl halftime video blows up on YouTube, is that love, or just heat?
Jenny
They analyzed one hundred thirty-eight thousand seven hundred thirty-four comments on the official NFL videos for Usher and Kendrick Lamar. Usher had twenty-six thousand nine hundred eighty-two comments, Kendrick had one hundred eleven thousand seven hundred fifty-two, but the bigger pile was not the cleaner win.
Jenny
Usher's discussion was eighty-eight point eight percent concentrated on one topic, mostly people treating the show as entertainment, which the authors call a hedonic frame, meaning pleasure, nostalgia, performance, vibes. Kendrick's discussion spread across one hundred three topics and mixed entertainment talk with symbolic and political readings, so the attention was much more contested.
Davis
How did they decide whether attention was actually approval, instead of just a hundred eleven thousand seven hundred fifty-two people arguing under the same video?
Jenny
They used automated topic modeling, which is software grouping comments by recurring language, then human-reviewed the themes, classified the frames, ran multilingual sentiment analysis, and built a Sentiment Integrity Index, basically a score meant to separate raw activity from positive evaluation. That's a pretty strong design for YouTube comments at this scale, but it's still two official NFL videos on one platform, not a universal law of audience sentiment.
Davis
So the practical warning is simple: don't sell engagement as favorability unless you've measured the feeling underneath it. This is our first Engagement Is Not Approval paper, and it's such a good opener because the dashboard number says Kendrick got more action, while the comment structure says Usher got the more unified reception.
Paper 2 Modeling recreational visitation at Bureau of Land Management sites
Davis
That dashboard-versus-reality problem shows up in the dirt, too. Modeling recreational visitation at Bureau of Land Management sites asks how you estimate visits to public lands when the trailhead counter is hard to install, the road is remote, or there are three ways in.
Davis
Hanson, Wood, Rappaport, Wilkins, and Schuster looked at seventy Bureau of Land Management sites in the U.S. and used one thousand three hundred twenty-eight site-months of on-site counts, meaning one site measured for one month, as the ground truth. The big finding is that phone movement helps, but the model gets smarter when it also knows what kind of place it's measuring.
Jenny
So what happened when the model relied on mobility data alone?
Davis
It lost useful context. They trained three random forest models, meaning many decision trees voting together, and the better versions combined fifteen site-level characteristics with three digital traces: mobile device locations, geolocated social media, and community science observations. Cross-validation on held-out sites showed the catch: predictions traveled best when the training set already included sites with similar traits.
Jenny
That's the measurement-stack lesson in hiking boots. Alternative data can fill gaps where counters are expensive or impossible, but it's not a stand-alone replacement for ground truth, and it's exactly why this belongs in Measurement Needs Better Instruments.
Paper 3 Propensity Score Adjustment (PSA)weighting technique for reducing bias in web panel surveys
Jenny
That hiking-boots lesson carries straight into surveys, because a web panel is another convenient trace that can look cleaner than it is. Md. Musa Khan's paper is called Propensity Score Adjustment weighting technique for reducing bias in web panel surveys, and it uses a Bangladesh education case at International Islamic University Chittagong.
Jenny
The plain point is simple: if the people who answer your online survey aren't randomly chosen, your result can tilt toward the people who were easiest to recruit. The paper uses Propensity Score Adjustment, which means estimating each person's chance of being in the sample and then weighting the data so overrepresented groups count less and underrepresented groups count more.
Davis
What would we need to know before trusting a weighted web panel result here?
Jenny
We'd want the variables used to build those propensity scores, because the adjustment only helps for bias you can actually model. Khan collected web panel survey data on social networking site use in education at IIUC, then used the weighting to address non-random participant selection, while naming the usual web-panel trouble spots: nonresponse bias, selection bias, and measurement bias.
Jenny
The big limitation is that the abstract doesn't give a sample size, so I wouldn't treat this as a benchmark for Bangladeshi students or education technology broadly. I would treat it as a methods reminder from IIUC Business Review: plan the bias correction before turning quick survey answers into audience claims.
Davis
Right, this is Measurement Needs Better Instruments in survey clothes. The technique is established enough to take seriously, but the practical takeaway is humble: web panels are useful, cheap, and fast, and they're still not magic just because the spreadsheet has weights.
free_promo
Paperboy.fm
This is the free version of the podcast. Subscribe at paperboy.fm to access a dozen different paper review podcasts for five dollars a month.
Other Episodes
2026-07-15
2026-07-08 – 2026-07-15
134 papers
2026-07-08
2026-07-01 – 2026-07-08
86 papers
2026-07-01
2026-06-24 – 2026-07-01
111 papers
2026-06-17
2026-06-10 – 2026-06-17
114 papers
2026-06-10
2026-06-03 – 2026-06-10
103 papers
2026-06-03
2026-05-27 – 2026-06-03
97 papers
2026-05-27
2026-05-20 – 2026-05-27
116 papers
2026-05-20
2026-05-13 – 2026-05-20
106 papers
2026-05-13
2026-05-06 – 2026-05-13
117 papers
2026-05-06
2026-04-29 – 2026-05-06
95 papers
2026-04-29
2026-04-22 – 2026-04-29
137 papers
2026-04-22
2026-04-15 – 2026-04-22
121 papers
2026-04-15
2026-04-08 – 2026-04-15
110 papers
2026-04-08
2026-04-01 – 2026-04-08
97 papers
2026-04-01
2026-03-25 – 2026-04-01
111 papers
2026-03-25
2026-03-18 – 2026-03-25
105 papers
2026-03-11
2026-03-04 – 2026-03-11
120 papers
2026-03-04
2026-02-25 – 2026-03-04
58 papers
2026-02-25
2026-02-18 – 2026-02-25
112 papers
2026-02-18
2026-02-11 – 2026-02-18
120 papers
2026-02-11
2026-02-04 – 2026-02-11
94 papers
2026-02-04
2026-01-28 – 2026-02-04
111 papers
2026-01-28
2026-01-21 – 2026-01-28
107 papers
2026-01-21
2026-01-14 – 2026-01-21
124 papers
2026-01-14
2026-01-07 – 2026-01-14
105 papers
2026-01-07
2025-12-31 – 2026-01-07
115 papers
2025-12-31
2025-12-24 – 2025-12-31
113 papers
2025-12-24
2025-12-17 – 2025-12-24
139 papers
2025-12-17
2025-12-10 – 2025-12-17
120 papers
2025-11-19
2025-11-12 – 2025-11-19
103 papers
2025-11-26
2025-11-19 – 2025-11-26
103 papers
2025-12-03
2025-11-26 – 2025-12-03
87 papers
2025-12-10
2025-12-03 – 2025-12-10
116 papers