Direct survey questions overestimate negative media attitudes in Japan compared to list experiments, study finds
By
Miura, Asako
Summary
This research note examines whether direct survey questions overestimate negative attitudes toward news media in Japan compared to an indirect list experiment method. Two survey-embedded randomized experiments compared a direct question condition against a double-list experiment design, using the statement "the mass media are harmful to society." Results showed agreement was significantly higher in the direct question condition (45.1%) than in the pooled list experiment estimate (29.7%), revealing a 15.4 percentage point gap. The double-list design showed no clear design effects, suggesting that direct questions may inflate reported negative media attitudes due to social desirability bias or other measurement artifacts.
Source
bskyDirect survey questions overestimate negative media attitudes in Japan compared to list experiments, study findsacademic.oup.comKey quotes
· 3 pulledAcross both studies, agreement was higher in the DQ condition than in the pooled LE estimate: 45.1% versus 29.7%, a 15.4-point gap.
This research note tests whether direct questions (DQs) overestimate negative attitudes toward the news media in Japan relative to an indirect list experiment (LE).
The double-list design showed no clear design effects
You might also wanna read
Americans overestimate how many social media users post harmful content
Majority of Teens Hold Negative Views of News Media, Report Finds
A report finds that a majority of teenagers hold negative views of news media, with about half believing journalists frequently make up deta
The Noisy Room: How a Toxic Minority Distorts Our Perception of Social Media
This interactive essay examines how a tiny minority of users posting severely toxic content on social media creates widespread misperception
The Noisy Room·1mo ago
Experimental Study Reveals Ideological Biases in Leading Large Language Models
The article presents an experimental investigation into whether leading Large Language Models (LLMs) from companies like OpenAI and Google e
anomify.ai·8mo ago
Counterfactual Evaluation Methods for Recommendation Systems: Addressing Causal Effects in Offline Assessment
This article discusses the limitations of traditional offline evaluation methods for recommendation systems, which treat recommendations as
eugeneyan.com·5mo ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.