This Week In Art Education

Transcript 41 lines

Cold Open Stats Overview Paper Walkthrough free_promo

Cold Open

Jenny When a class adds a shiny new tool—like an app or a headset—how do you tell if it’s helping or just distracting?

Davis I mean, if kids are actually making more work, and coming back on their own time, I’m tempted to call that a win, even before we argue about test scores.

Jenny But “coming back” can just mean it’s fun, right, and fun can be a decoy—so what did they measure, learning, time-on-task, or just clicks?

Davis Okay, but here’s the thing that made me sit up: one 12-week classroom experiment says adding VR, AR, and multimedia blew the audience wide open—like, reach across China—and visitor counts jumped by almost 13 times.

Jenny Thirteen times is huge, and it’s exactly the kind of number that makes me ask what “visitor” even meant in the study, and whether any of that attention turned into skill…welcome to This Week In Art Education on paperboy.fm.

Stats Overview

Davis Quick map of the week: we pulled about eighteen hundred hits, and we actually analyzed all 1,772 of them. Out of that, 67 papers made the cut, with 136 unique authors across 9 countries.

Jenny And that “made the cut” number slid a bit: 67 qualified papers, down from 78 last episode, so 11 fewer, about a 14% dip. Do we know if that’s a real drop in publishable work, or did our mix tilt toward methods that don’t travel well—like the 35 qualitative and 17 case studies?

Davis The bigger funnel shrank too: total query hits fell to 1,772 from 2,339, down 567, about 24%. That feels like a quieter week in the databases, or maybe our search terms are catching less of the “digital and inclusive” stuff and more of the classic lanes, like music education leading with 7 papers.

Jenny The geographic spread is the one that makes me squint: unique countries dropped from 25 to 9, down 16, a 64% narrowing. And the country counts we do have are lopsided—China shows up with 12, Brazil and Indonesia with 3 each, then singletons like the US and Australia—so is this a real shift in who’s publishing, or just what our query surfaced this week?

Davis Author-wise, it’s a pretty fresh bench: 44 first-time authors, meaning their first-ever paper, that’s about 32%. Then 55 emerging researchers at about 40%, and 37 experienced at about 27%, which fits a field where a lot of the evidence is still small and local.

Jenny Theme sweep lines up with the through-line: music education is on top, higher ed is next with 4, and then visual arts, inclusive education, early childhood, community engagement, and aesthetic education all cluster at 3 each, plus Universal Design for Learning at 2—UDL being “design lessons so more learners can access them without special add-ons.” But with only 4 experimental studies and just 6 surveys, the big question is how many of these digital and community claims are being tested versus described.

Paper Walkthrough

Paper 1 An investigation of art education students’ perceptions of 21st-century skills competence and critical thinking tendencies

Jenny Alright, let’s get into the papers, and we’re starting with one called An investigation of art education students’ perceptions of 21st-century skills competence and critical thinking tendencies.

Jenny It’s Şenol Afacan in the Online Journal of Music Sciences, and it’s a survey of one hundred sixty-five art-ed students across two Turkish universities in spring of the twenty twenty-four to twenty twenty-five year.

Jenny Plain version is simple: the more students say they’ve got modern, job-ready skills, the more they also say they think critically.

Jenny And the link is big in their data: the correlation is point seven-zero-seven, with p less than point zero-one, meaning the two scores rise together way more than you’d expect by chance.

Davis Okay, but if it’s self-perception on both sides, what would convince you it translates into real critical-thinking performance, like actually spotting a bad argument in a critique or choosing evidence for an interpretation?

Jenny Yeah, because what they actually did was two scales: a 21st-century skills competence perception scale and a critical thinking tendencies scale, and students mostly agreed with items on both, so it’s confidence plus disposition, not a timed reasoning test.

Jenny They also checked differences by department, gender, and grade level—skills perceptions differed by department and grade level, gender didn’t, and critical thinking didn’t differ overall by department—but the core limitation is it’s two self-reports, so it can’t show skills training caused better thinking.

Davis Still, with one hundred sixty-five students and a correlation that strong, I buy it as a real signal inside those two programs, even if it’s not a cause-and-effect claim.

Davis If I’m designing an art-ed course, I’m pairing studio projects with explicit “show your reasoning” routines—like source-checking, alternatives, and a short written defense—and measuring both over the semester, because this paper says the two mindsets travel together.

Paper 2 Digital Presentation and Communication Efficacy Enhancement of Traditional Cultural Elements in the Language Curriculum

Davis You just said “measure both over the semester,” and this next paper actually tries to do that with a comparison class, not just a survey.

Davis It’s called Digital Presentation and Communication Efficacy Enhancement of Traditional Cultural Elements in the Language Curriculum, and it’s a twelve-week high school unit in China using VR and AR to teach traditional culture inside language class.

Davis Plain version: the class that got the digital stuff learned more culture and got more interested, and the project got way more reach outside the classroom.

Davis They say visitor counts jumped by nearly thirteen times, and the dissemination went from three provinces to the whole country, with “efficiency” up by nearly ten times, while the experimental class used VR, AR, and multimedia interaction across ancient poems, literary texts, and festival culture.

Jenny Okay but what counts as “knowledge of culture” here—are we talking test scores on the poems, or a survey like “I feel I understand,” or something else?

Davis From the abstract, it’s mixed-methods: questionnaires, interviews, case tracking, plus platform access statistics, and they analyze it in SPSS, which is just the standard stats software a lot of education papers use.

Davis But the big limitation is exactly what you’re poking at: we don’t get the basics in the summary—no sample size, no example items, no actual score changes—so we can’t tell if “knowledge” is a hard assessment or mostly self-report, even though the design is quasi-experimental, meaning two classes compared without full random assignment.

Jenny This lands for me as part of our “digital tools, real learning” thread: the strongest bit is they tracked actual usage, not just vibes, but the learning claim is hard to trust until I can see the test or the rubric and how big the gain was.

Jenny If I’m a teacher hearing “VR boosts culture learning,” I’m stealing the structure, not the headline: run a control class, track clicks and time-on-task, and make the culture quiz so concrete a kid can’t pass it by just saying they’re “more interested.”

Paper 3 Interactive E-Flipbook as Digital Learning Innovation in Project-Based Craft Education

Jenny Okay, speaking of us begging for basics like sample size and what the measure even was, here’s a paper that’s basically all measurement, but it’s a different kind.

Jenny It’s called Interactive E-Flipbook as Digital Learning Innovation in Project-Based Craft Education, and it’s about building an interactive e-flipbook for a tote bag painting project.

Jenny Plain version first: they’re not claiming kids learned more yet, they’re claiming experts agree the thing is built right for the job.

Jenny They did expert validation with six validators total—three media experts and three subject-matter experts—and the media side scored an S-CVI/Ave of zero point nine five and an S-CVI/UA of zero point eight five.

Jenny Quick translation: CVI is a content validity index, meaning reviewers check whether the content matches the learning goals, and those numbers mean strong agreement overall, with the stricter “universal agreement” still pretty high.

Davis So after “experts agree it’s content-valid,” what’s the next proof step—do students actually learn more with it, or even use it, compared to a normal handout or a video?

Jenny Yeah, and this paper doesn’t go there yet, because their ADDIE work stops at analysis, design, and development, then they do validation rather than a classroom trial.

Jenny Also, look at the material side: S-CVI/Ave is zero point nine zero, but S-CVI/UA drops to zero point six nine, which is basically “not everyone agreed on every single item,” even if the average looks great.

Jenny So the meaningful limitation is it validates the resource with experts, but it doesn’t test student learning outcomes or engagement in an actual project-based class.

Davis I like it as a clean “digital tools, real learning” checkpoint, because it’s honest about what kind of evidence it has—strong build-quality signals from six experts, not a learning gain.

Davis If I’m a teacher, I’d treat this like a vetted starting kit for tote bag painting, then I’d run the next step myself: one class on the flipbook, one class on whatever I already use, and track a rubric score plus who actually opened the thing.