Post-publication Comment · Critical AI
Comment on “Made With AI: Consumer Engagement with Social Media Containing AI Disclosures”
Critical AI · published 2026-06-15 · v1.0 · CRIT-000007
Concerning: Stephan Carney, Ignacio Riveros, Stephanie Tully · Journal of Consumer Research · 2026-05-05
Why this paper was selected
Directly informs AI-disclosure policy on social platforms; with regulators mandating AI labels, the study's mechanism and generalisation claims carry real policy weight and merit scrutiny.
AI/AGI centrality 4/5 · societal relevance 5/5 · source-journal note: The Journal of Consumer Research is a top-tier, FT50 marketing/consumer-behaviour journal. Tier S.
Summary
As platforms and regulators start requiring creators to label AI-generated content, this paper asks what such labels do to the audience. Combining real engagement data from TikTok's disclosure policy with eight preregistered experiments, the authors find that AI disclosures reduce engagement — and, interestingly, not because people doubt the quality or distrust AI, but because the label weakens the felt personal bond between viewer and creator (what they call parasocial connection), partly because AI content seems to take less effort. They show that signalling effort can soften the hit. The mixed-methods evidence is a real strength and the mechanism is carefully isolated. Our cautions, from the abstract, are modest: the field evidence comes from a single platform (TikTok), so the size of the effect elsewhere is uncertain, and 'parasocial connection' is one mechanism the experiments support among the possible drivers, so the policy reading should stay tied to the specific disclosure designs tested.
Central claims & evidence map
| Claim | Type | Evidence offered | Support | Overclaiming | Main weakness |
|---|---|---|---|---|---|
| AI-content disclosures reduce consumer engagement. | Causal | The abstract reports that "disclosures reduce consumer engagement", from "Analysis of engagement behavior on TikTok following the introduction of their AIGC disclosure policy and eight preregistered experiments". | Strong | None | The field component is a single platform (TikTok); the magnitude elsewhere, and under different disclosure wordings, is not established by the abstract. |
| The effect runs specifically through reduced parasocial connection. | Causal | The abstract identifies "a novel process: AIGC disclosures reduce parasocial connection—one-sided emotional bonds between consumers and creators", driven partly by perceived creator effort. | Moderate | Minor | One mechanism is foregrounded; the abstract does not rule out complementary pathways that could matter more in other settings. |
Per-claim assessment
C1. AI-content disclosures reduce consumer engagement.
The convergence of a real-platform policy change with eight preregistered experiments is strong evidence for the direction of the effect. This is the best-supported claim in the abstract and is appropriately stated.
C2. The effect runs specifically through reduced parasocial connection.
A carefully isolated mechanism, and the effort-signal moderation is a nice confirmatory test. As a single named pathway it is well-supported for the tested stimuli; whether it is the dominant mechanism across content types and platforms is a broader claim the abstract does not settle.
Scorecard
Sub-scores are 0–5 editorial judgements on fixed scales (higher is better, except methodological risk and overclaiming where higher is worse). They are contestable and open to a severity challenge from authors.
What the paper does
Using TikTok's AIGC disclosure policy as a field setting plus eight preregistered experiments, the paper shows that AI disclosures reduce engagement and attributes the effect to reduced parasocial connection — not to quality concerns or general AI aversion — with perceived creator effort as a partial driver and an effort signal as a mitigator.
Single-platform field evidence, one named mechanism
Two modest cautions from the abstract. The field evidence is one platform (TikTok), so the effect size under other platforms and disclosure wordings is uncertain. And parasocial connection, while carefully isolated, is presented as the mechanism; the policy implication should stay tied to the specific disclosure designs the experiments tested rather than to AI labelling in general.
Strongest critique
The mechanism and policy framing generalise a single-platform field result and one experimentally-isolated pathway (parasocial connection) toward AI-disclosure design broadly, where other platforms, content types and label wordings could shift both the size and the route of the effect.
Strongest fair defence
The pairing of a real platform-policy change with eight preregistered experiments is unusually strong for a behavioural claim, and the authors specifically rule out obvious alternatives (quality doubts, AI aversion) before naming the parasocial mechanism, which makes the causal story credible for the tested settings.
Conclusion
A methodologically strong, policy-relevant study whose central effect is well supported; the cautions, visible from the abstract, are single-platform field evidence and the foregrounding of one mechanism, so the disclosure-design implications should stay close to what was tested. Severity low.
Reply from the authors
Following the practice of Nature Matters Arising, Science Technical Comments and PNAS Letters, this Comment is published as one half of a Comment + Reply pair: the authors of the original article are invited to respond, and any reply is published here verbatim alongside the Comment as part of the record.
Reply: not yet invited. No reply has been received for publication.
The authors have a right of reply and no veto. A reply may request a factual correction, a methodological rebuttal, a clarification, a data/code update, or a severity challenge, and is published unedited. See the right-of-reply policy.
Editorial action after reply: Founding pilot: authors will be invited to reply once the standing board is ratified; this critique addresses claims, framing and generalisation only, never the authors.
References
Every external source this Comment cites, each with a verified link. 0 fabricated.
Source-grounding attestation
- ✓Verbatim source spans present in the critique — 3/3 provenance spans re-derived in the critique prose
- ✓Passes the publication validator — no errors
- ✓Zero fabricated citations — 0 fabricated
- ✓Severity within the access-basis cap — severity "low" ≤ cap "moderate" for abstract_only
Every verbatim span the critique relies on is re-derived in the prose in-app; span-in-source is re-verifiable offline (the abstract is re-fetched, not stored, per the no-reproduce policy).
Re-verify span-in-source offline: python3 scripts/verify-queue-critiques.py
Independent faithfulness review
A refute-by-default adversarial panel (two independent reviewers — an overreach lens and a mischaracterization lens — that fetched the real source) tried to prove this critique misread the paper. This is an AI adversarial review recorded with its reasoning, not a deterministic check.
Both adversarial refuters independently retrieved the real abstract for DOI 10.1093/jcr/ucag013 (via the OpenAlex API, reconstructed from the abstract_inverted_index, and cross-confirmed against the Oxford Academic/JCR page and the SSRN preprint), and both, working their assigned lenses (overreach and mischaracterization), failed to manufacture a sustained misreading despite trying multiple angles. The critique's C1 (disclosures reduce engagement; support=strong, overclaiming=none) matches the abstract verbatim, and its lone weakness — that the field component is TikTok-only, so magnitude under other platforms or label wordings is unestablished — is a genuine, abstract-level gap rather than an overreach. C2 (the parasocial-connection mechanism; support=moderate, overclaiming=minor) faithfully quotes the named process, preserves the paper's "in part" effort qualifier, and credits the authors in strongestFairDefence for ruling out quality concerns, AI wariness, and general AI aversion — so it cannot be charged with either strawmanning a monocausal claim or ignoring the paper's alternative-explanation evidence. The generalization and dominance-across-settings cautions target scope dimensions the abstract genuinely does not speak to. If anything the critique is more charitable than the source requires; no contestable concern rises to the level of disclosure. Verdict: faithful.
Version & correction history
| Version | Date | Change |
|---|---|---|
| v1.0 | 2026-06-15 | Initial publication. |
No silent substantive corrections — every change is versioned and visible.
How to cite this Comment
Critical AI. Comment on “Made With AI: Consumer Engagement with Social Media Containing AI Disclosures” (Stephan Carney et al., Journal of Consumer Research, 2026). Critical AI; 2026. https://policywindow.org/critique/c/made-with-ai-consumer-engagement-with-social-media
A registered DOI will replace the URL once minted; until then the canonical URL is the persistent identifier. Highwire/Dublin-Core citation tags and a schema.org Review record are embedded in this page for Google Scholar and reference managers.