This Week In Wellbeing Measurement

Transcript 29 lines

Cold Open Stats Overview Paper Walkthrough free_promo

Cold Open

Davis If a report says things are improving, whose everyday life would you want it to check first?

Jenny The person who still can't get dinner without two buses and a backup plan, because averages are very good at hiding that person.

Davis Right, and that's where I get less cynical about dashboards, because the right one can turn a hidden pattern into something a city council has to look at.

Jenny Maybe, but a lot of dashboards are pretty maps with a login screen, and pretty maps can make bad measurement feel official.

Davis That's the tension this week: community stories showed food need that public numbers were missing, so the measure changed once people could speak into it...welcome to This Week In Wellbeing Measurement on paperboy.fm.

Stats Overview

Davis This week we’re looking at about one thousand papers in the search pile, with ninety-eight making the cut, from four hundred eighty-one authors across twenty-one countries. So the feed is wide, but not evenly mapped; we’ve got country counts, and basically no city or institution detail to lean on.

Jenny The headline is odd in a useful way: qualified papers rose from ninety-one to ninety-eight, up seven papers, or about eight percent. But total query hits fell from twelve hundred thirty-nine to ten hundred thirteen, down two hundred twenty-six, so is the search getting cleaner, or did this week’s topics just line up better with our filter?

Davis And the author base got bigger while the pile got smaller: four hundred seven unique authors last time, four hundred eighty-one now, up seventy-four, or about eighteen percent. That means more voices per relevant paper, even though the countries dropped from twenty-seven to twenty-one.

Jenny The author tiers make that feel less like the same club repeating itself: eighty-five authors, about eighteen percent, are first-time authors, meaning first-ever paper in the metadata, not just new to our feed. Then one hundred fifty-eight are emerging, about a third, and two hundred thirty-eight are experienced, about half.

Davis Methods are the big tell this week. Qualitative leads with twenty-two papers, which means interviews, focus groups, or coded lived experience, then surveys at fifteen, and cross-sectional and quantitative at ten each, so the measurement story is moving toward local texture as much as scoreboard numbers.

Jenny That fits the theme sweep: mental health shows up nine times, wellbeing six, sustainability four, with student wellbeing, autism, AI, and machine learning close behind at three each. The useful caution is the episode’s through-line: these metrics are getting more powerful and more personal, but the softer the measure, the easier it is to mistake the number for the thing people actually live.

Paper Walkthrough

Paper 1 Making inequities visible: a call for participatory food system dashboards for SDG monitoring

Davis Alright, let's get into the papers with one that fits the whole week: Making inequities visible: a call for participatory food system dashboards for SDG monitoring, by R. Ilieva, Yvette Ng, and Nevin Cohen in Frontiers in Sustainable Food Systems in twenty twenty-six.

Davis The plain version is this: they built two prototype food equity dashboards in New York State so cities could see food insecurity at the neighborhood level, not just report big averages to the United Nations. SDG monitoring means tracking the Sustainable Development Goals, and here the indicators were mapped back to goals one, two, three, four, ten, eleven, and seventeen.

Jenny How did they avoid making a shiny dashboard that just repeats the same blind spots as the old data, especially with only two prototypes?

Davis They used mixed methods, meaning numbers plus lived experience, and participatory co-design, meaning community groups, service providers, and government people helped choose and refine the measures. The dashboards combined administrative datasets with web-scraped grocery prices, anonymized mobility data, app-based food pantry reservation data, online store reviews, surveys, interviews, and community narratives. That made gaps visible in very concrete ways: different school meal participation in schools with similar poverty levels, SNAP eligibility not matching enrollment by community district, emergency food access changing by place and time, and basic grocery prices varying sharply by neighborhood. The limit is real, though: these are New York State prototypes, so the strongest claim is about what becomes visible locally, not a universal food-equity model.

Jenny That feels like the Equity Needs Disaggregation thread in one screen: an average can say the city is fed, while one neighborhood is paying more for staples and another is missing pantry access after work hours. I like the ambition, but the dashboard only earns trust if residents can challenge the numbers, not just get displayed by them.

Paper 2 What Gets Measured, Gets Managed: Guidance for Recovery Measurement in Addiction Recovery Science.

Jenny That point about residents being able to challenge the dashboard is a nice bridge, because this next paper is basically the same warning inside addiction science: What Gets Measured, Gets Managed: Guidance for Recovery Measurement in Addiction Recovery Science.

Jenny Jordan Jurinsky and eleven coauthors argue that recovery can't be reduced to one easy marker, like abstinence, because recovery also includes recovery capital, meaning the money, housing, relationships, identity, and support someone can draw on to keep going.

Jenny They flag three undermeasured pieces in particular: relationship and family functioning, sense of purpose, and community, which is a very different picture from a clinic report that only asks whether someone used substances in the last thirty days.

Davis If recovery is multidimensional, who gets to decide which dimensions count most: the researcher, the treatment program, the funder, or the person actually trying to rebuild a life?

Jenny The authors don't test a new scale on a new sample here; they draw on a working group with academic and lived-experience expertise, then place existing recovery measures in historical context around abstinence and recovery capital, and they explicitly say they're not prescribing one comprehensive framework.

Jenny So the useful guidance is intentional matching: if a program claims it supports family repair, purpose, or community belonging, it should measure those domains directly, and the limitation is that this is expert guidance rather than fresh empirical evidence showing which measure predicts better outcomes.

Davis That's the Metrics That Govern Us thread in a very human form, because if funding only rewards clean drug screens, services may manage toward clean drug screens, while the harder work of trust, housing, family, and purpose gets treated like background noise.

Paper 3 Are mental health services fit for purpose in modern multicultural Australia?

Davis That clean-drug-screen problem has a cousin here: if the system only counts the people it can easily see, it can mistake invisibility for lower need. The paper is Are mental health services fit for purpose in modern multicultural Australia?, and it's asking whether Australia's mental health system has kept up with one of the world's most culturally and linguistically diverse populations.

Davis The headline is awkward but important: national data can make anxiety and mood disorders look less common among overseas-born Australians, while the same paper points to delayed and unequal access to care. They draw on the twenty twenty to twenty twenty-two National Study of Mental Health and Wellbeing, and the authors' read is that lower recorded prevalence may reflect barriers in the system, not simply better mental health.

Jenny So could that apparent lower prevalence be a measurement artifact rather than a sign of lower need? Like, are we partly measuring who can answer the survey, who trusts the service, and who gets grouped into a giant category called overseas-born?

Davis Yes, and the authors are pretty direct about that. This is a perspective built from secondary analysis of that national survey, plus a rapid review of Australian community-based interventions and national stakeholder consultations with culturally diverse communities and providers; the big limitation is that people with limited English proficiency were excluded, and privacy-driven aggregation hides differences between communities.

Jenny That's the What Counting Leaves Out thread in a very literal form. The evidence is moderate, because it's existing data plus stakeholder input rather than a new all-language population study, but the policy ask is still concrete: their six recommendations push multicultural mental health into service design, workforce, leadership, policy, and data infrastructure as core business, not the little side program you remember after the budget is already spent.

This Week In Wellbeing Measurement

Wellbeing measures meet real life

Episode

Cold Open

Stats Overview

Paper Walkthrough

Paper 1 Making inequities visible: a call for participatory food system dashboards for SDG monitoring

Paper 2 What Gets Measured, Gets Managed: Guidance for Recovery Measurement in Addiction Recovery Science.

Paper 3 Are mental health services fit for purpose in modern multicultural Australia?

free_promo

Other Episodes

This Week In Wellbeing Measurement

Wellbeing measures meet real life

Episode

Cold Open

Stats Overview

Paper Walkthrough

Paper 1 Making inequities visible: a call for participatory food system dashboards for SDG monitoring

Paper 2 What Gets Measured, Gets Managed: Guidance for Recovery Measurement in Addiction Recovery Science.

Paper 3 Are mental health services fit for purpose in modern multicultural Australia?

free_promo

Other Episodes

Get This Week In Wellbeing Measurement by email