{"$schema":"https://policywindow.org/critique/api/schema","critique_id":"CRIT-000007","slug":"made-with-ai-consumer-engagement-with-social-media","url":"https://policywindow.org/critique/c/made-with-ai-consumer-engagement-with-social-media","doi":null,"status":"published","critique_type":"editorially_approved_ai_native_critique","publication_date":"2026-06-15","current_version":"1.0","target_paper":{"title":"Made With AI: Consumer Engagement with Social Media Containing AI Disclosures","authors":["Stephan Carney","Ignacio Riveros","Stephanie Tully"],"journal":"Journal of Consumer Research","doi":"10.1093/jcr/ucag013","url":"https://doi.org/10.1093/jcr/ucag013","publicationDate":"2026-05-05","paperType":"empirical","accessBasis":"abstract_only","fullTextUsed":false,"fictional":false,"doi_url":"https://doi.org/10.1093/jcr/ucag013"},"source_journal":{"tier":"S","rankingSources":["https://doi.org/10.1093/jcr/ucag013","https://openalex.org/W7160542529"],"rankingNote":"The Journal of Consumer Research is a top-tier, FT50 marketing/consumer-behaviour journal. Tier S."},"selection":{"aiAgiCentralityScore":4,"societalRelevanceScore":5,"aiAgiCategories":["human_AI_interaction","law_regulation"],"selectionReason":"Directly informs AI-disclosure policy on social platforms; with regulators mandating AI labels, the study's mechanism and generalisation claims carry real policy weight and merit scrutiny."},"scores":{"aiAgiContribution":3,"evidentiarySupport":4,"methodologicalRisk":2,"overclaiming":2,"reproducibilityOrAuditability":3,"societalImpactRelevance":5,"severity":"low","confidence":"low"},"severity_cap_for_access_basis":"moderate","plain_language_summary":"As platforms and regulators start requiring creators to label AI-generated content, this paper asks what such labels do to the audience. Combining real engagement data from TikTok's disclosure policy with eight preregistered experiments, the authors find that AI disclosures reduce engagement — and, interestingly, not because people doubt the quality or distrust AI, but because the label weakens the felt personal bond between viewer and creator (what they call parasocial connection), partly because AI content seems to take less effort. They show that signalling effort can soften the hit. The mixed-methods evidence is a real strength and the mechanism is carefully isolated. Our cautions, from the abstract, are modest: the field evidence comes from a single platform (TikTok), so the size of the effect elsewhere is uncertain, and 'parasocial connection' is one mechanism the experiments support among the possible drivers, so the policy reading should stay tied to the specific disclosure designs tested.","claims":[{"id":"C1","text":"AI-content disclosures reduce consumer engagement.","type":"causal","evidenceOffered":"The abstract reports that \"disclosures reduce consumer engagement\", from \"Analysis of engagement behavior on TikTok following the introduction of their AIGC disclosure policy and eight preregistered experiments\".","support":"strong","overclaiming":"none","assessment":"The convergence of a real-platform policy change with eight preregistered experiments is strong evidence for the direction of the effect. This is the best-supported claim in the abstract and is appropriately stated.","mainWeakness":"The field component is a single platform (TikTok); the magnitude elsewhere, and under different disclosure wordings, is not established by the abstract.","confidence":"medium"},{"id":"C2","text":"The effect runs specifically through reduced parasocial connection.","type":"causal","evidenceOffered":"The abstract identifies \"a novel process: AIGC disclosures reduce parasocial connection—one-sided emotional bonds between consumers and creators\", driven partly by perceived creator effort.","support":"moderate","overclaiming":"minor","assessment":"A carefully isolated mechanism, and the effort-signal moderation is a nice confirmatory test. As a single named pathway it is well-supported for the tested stimuli; whether it is the dominant mechanism across content types and platforms is a broader claim the abstract does not settle.","mainWeakness":"One mechanism is foregrounded; the abstract does not rule out complementary pathways that could matter more in other settings.","confidence":"low"}],"sections":[{"id":"what","title":"What the paper does","body":"Using TikTok's AIGC disclosure policy as a field setting plus eight preregistered experiments, the paper shows that AI disclosures reduce engagement and attributes the effect to reduced parasocial connection — not to quality concerns or general AI aversion — with perceived creator effort as a partial driver and an effort signal as a mitigator."},{"id":"scope","title":"Single-platform field evidence, one named mechanism","body":"Two modest cautions from the abstract. The field evidence is one platform (TikTok), so the effect size under other platforms and disclosure wordings is uncertain. And parasocial connection, while carefully isolated, is presented as the mechanism; the policy implication should stay tied to the specific disclosure designs the experiments tested rather than to AI labelling in general."}],"strongest_critique":"The mechanism and policy framing generalise a single-platform field result and one experimentally-isolated pathway (parasocial connection) toward AI-disclosure design broadly, where other platforms, content types and label wordings could shift both the size and the route of the effect.","strongest_fair_defence":"The pairing of a real platform-policy change with eight preregistered experiments is unusually strong for a behavioural claim, and the authors specifically rule out obvious alternatives (quality doubts, AI aversion) before naming the parasocial mechanism, which makes the causal story credible for the tested settings.","final_judgment":"A methodologically strong, policy-relevant study whose central effect is well supported; the cautions, visible from the abstract, are single-platform field evidence and the foregrounding of one mechanism, so the disclosure-design implications should stay close to what was tested. Severity low.","review_process":{"aiAgentsUsed":["claim_extraction","ai_agi_relevance","overclaiming","adversarial","author_defence","citation_integrity","legal_risk","plain_language","meta_review"],"reviewRounds":1,"humanEditor":{"name":"Founding editorial review (Policy Window)","role":"Editor-in-chief (founding)","approvalDate":"2026-06-15","declaredConflict":"none"},"expertCertification":{"used":false}},"author_response":{"notified":false,"status":"not_yet_invited","editorialActionAfterResponse":"Founding pilot: authors will be invited to reply once the standing board is ratified; this critique addresses claims, framing and generalisation only, never the authors."},"versions":[{"version":"1.0","date":"2026-06-15","note":"Initial publication.","changeType":"initial"}],"transparency":{"modelCardUrl":"/critique/model-card","publicAuditSummary":"Abstract-only critique: the target's abstract was reconstructed from the OpenAlex record and every verbatim span the critique relies on was checked to be an exact substring of it. The bibliographic record (DOI) was independently confirmed via Crossref. Severity is capped to the abstract-only access basis; the critique engages the paper's framing and stated claims only, not internal validity that the full text would be needed to assess.","privateAuditRecordExists":true,"citationVerification":{"status":"complete","checkedSources":[{"label":"DOI 10.1093/jcr/ucag013","url":"https://doi.org/10.1093/jcr/ucag013","verified":true},{"label":"OpenAlex work record (abstract source)","url":"https://openalex.org/W7160542529","verified":true}],"fabricatedCitations":0},"riskReview":{"copyright":"completed","defamation":"completed","note":"Abstract quoted sparingly under criticism/review. Critique targets the paper's claims, framing and generalisation only — never the authors."}}}