{"$schema":"https://policywindow.org/critique/api/schema","critique_id":"CRIT-000043","slug":"human-ai-feedback-loops-bias-amplification","url":"https://policywindow.org/critique/c/human-ai-feedback-loops-bias-amplification","doi":null,"status":"published","critique_type":"editorially_approved_ai_native_critique","publication_date":"2026-07-05","current_version":"1.0","target_paper":{"title":"How human–AI feedback loops alter human perceptual, emotional and social judgements","authors":["Moshe Glickman","Tali Sharot"],"journal":"Nature Human Behaviour","doi":"10.1038/s41562-024-02077-2","url":"https://doi.org/10.1038/s41562-024-02077-2","publicationDate":"2025","paperType":"empirical","accessBasis":"open_access","fullTextUsed":true,"fictional":false,"doi_url":"https://doi.org/10.1038/s41562-024-02077-2"},"source_journal":{"tier":"A","rankingSources":["resolved from the monitored-venue determination"],"rankingNote":"A-tier per the monitored-venue determination; Nature Human Behaviour is elite interdisciplinary (Nature family), WoS JCR Q1. Critiqued from the open-access version of record (CC BY, hybrid OA)."},"selection_provenance":{"id":"human-ai-feedback-loops-bias-amplification","venue":"Nature Human Behaviour","inMonitoredSet":true,"determinedTier":"A","recordedTier":"A","effectiveTier":"A","kind":"monitored","disclosed":true,"offListPeerReviewed":false},"selection":{"aiAgiCentralityScore":5,"societalRelevanceScore":5,"aiAgiCategories":["ai_societal_impact"],"selectionReason":"Autonomous production cycle (psychology deepening); OA full-text critique via two-stage produce+sharpen + 3-lens convergence gate (2 survives, 1 weakened).","domain":"psychology"},"scores":{"aiAgiContribution":5,"evidentiarySupport":4,"methodologicalRisk":3,"overclaiming":4,"reproducibilityOrAuditability":3,"societalImpactRelevance":5,"severity":"moderate","confidence":"high"},"severity_cap_for_access_basis":"high","plain_language_summary":"Glickman & Sharot (2025) report experiments with 1,401 participants showing that biased AI systems transmit and amplify bias in human perceptual, emotional, and social judgements through a single pass of interaction: biased human data trains an AI algorithm that amplifies the bias, and new humans who interact with that biased AI become more biased themselves. The central critique is that the paper frames this single-pass transmission as a demonstrated 'feedback loop' and 'snowball effect,' but the loop is never closed — newly biased humans are never used to retrain the AI. Whether iterative cycling would amplify, stabilize, or reverse bias remains entirely untested, making the paper's central mechanistic framing an extrapolation beyond its evidence. Secondary concerns include a confounded control condition in the Stable Diffusion experiment, absence of preregistration across all studies, and unreported participant demographics.","claims":[{"id":"CLAIM-001","text":"The paper frames its central finding as a 'feedback loop' and 'snowball effect' in which small biases escalate through iterative human–AI cycling, but the experimental design only tests a single pass of bias transmission. The loop is never closed: newly biased humans are never used to retrain the AI, which would then interact with another cohort.","type":"causal","evidenceOffered":"These results demonstrate an algorithmic bias feedback loop; training an AI algorithm on a set of slightly biased human data results in the algorithm amplifying it. Subsequent interactions of other humans with this algorithm further increase the humans’ initial bias levels, creating a feedback loop.","support":"moderate","overclaiming":"moderate","assessment":"A feedback loop requires repeated cycling: biased humans produce biased AI, which produces more-biased humans, who produce even-more-biased AI, and so on. The experiments test only one pass (Level 1 humans → CNN → Level 3 humans). The claimed 'snowball effect where small errors in judgement escalate into much larger ones' is an extrapolation from single-pass transmission, not an empirical demonstration of iterative escalation. The authors demonstrate both necessary links of the loop (human bias amplified by AI, and AI bias learned by humans), which establishes the mechanism, but calling it a demonstrated feedback loop overstates what a single-pass design can support.","mainWeakness":"The paper uses 'feedback loop' and 'snowball effect' language throughout — title, abstract, results, discussion — to describe a single-pass causal chain. Whether iterative cycling would amplify, stabilize, or reverse bias is entirely untested, yet the framing implies demonstrated iterative escalation.","confidence":"high"},{"id":"CLAIM-002","text":"In Experiment 3, the treatment group views AI-generated images of financial managers (overwhelmingly White men) while the control group views fractal images. This is not a matched control: the treatment exposes participants to people in a professional context while the control shows abstract patterns, conflating AI-specific bias amplification with generic anchoring to professional headshot content.","type":"causal","evidenceOffered":"Participants in the control group were shown fractal images instead of financial manager images.","support":"moderate","overclaiming":"moderate","assessment":"A tighter control would show participants real photographs of financial managers with demographic proportions matching actual workforce statistics, or demographically balanced AI-generated images. Comparing AI-generated professional headshots against abstract fractals leaves open the possibility that any exposure to images of mostly White male professionals — AI-generated or not — would produce the same anchoring effect. The paper's conclusion that AI-specific bias amplification drives the result is not fully supported by this control design.","mainWeakness":"The fractal control isolates order and test-retest effects but cannot distinguish AI-specific bias transmission from generic visual priming by professional headshot content.","confidence":"high"},{"id":"CLAIM-003","text":"No preregistration is mentioned for any of the experiments. For a study with multiple experiments, numerous conditions, several supplementary experiments, and multiple analytic choices, the absence of preregistration leaves the boundary between confirmatory and exploratory findings unspecified.","type":"methodological","evidenceOffered":"Sample sizes were determined based on pilot studies to achieve a power of 0.8 (α = 0.05) using G*Power70.","support":"moderate","overclaiming":"minor","assessment":"The authors report power analyses from pilot studies and share all data and code publicly, which partially mitigates this concern. However, without preregistration, the choice of primary hypotheses, exclusion criteria, and specific analytic models cannot be verified as pre-specified, particularly given six supplementary experiments and multiple dependent measures.","mainWeakness":"Without preregistration, the analytic flexibility across the main and supplementary experiments leaves it unclear which findings were confirmatory versus exploratory.","confidence":"moderate"},{"id":"CLAIM-004","text":"All 1,401 participants were recruited from Prolific. While age and gender are reported per sub-sample, participant nationality, ethnicity, and education are never reported. The paper generalizes to 'humans' broadly without qualifying the demographic constraints of its online convenience sample.","type":"descriptive","evidenceOffered":"Participants were recruited via Prolific (https://prolific.com/) and received, in exchange for participation, a payment of £7.50 per hour","support":"moderate","overclaiming":"minor","assessment":"Prolific samples skew young, educated, and disproportionately from Western English-speaking countries. The paper's Discussion extends its claims to domains such as hiring, medical diagnosis, and children's cognition without acknowledging that the sample may not generalize to these populations or professional contexts. In Experiment 3 specifically, cultural priors about who 'is most likely to be a financial manager' vary across populations, making sample demographics especially relevant.","mainWeakness":"Universal claims about human cognition and AI interaction are drawn from an online convenience sample whose demographic composition beyond age and gender is never characterized.","confidence":"moderate"}],"sections":[],"strongest_critique":"The paper claims to demonstrate a 'feedback loop' and 'snowball effect' in which small biases escalate through iterative human–AI cycling, but the experimental design only tests a single pass of bias transmission: biased human data trains an AI, and a new group of humans then becomes more biased after interacting with that biased AI. The loop is never closed — newly biased humans are never fed back to retrain the AI, which would then interact with yet another cohort. Whether iterative cycling would amplify, stabilize, or reverse bias remains entirely untested. The design demonstrates bias transmission, not a feedback loop.","strongest_fair_defence":"The paper is methodologically careful in several respects: it uses a well-designed 2×2 factorial decomposition (AI vs human input crossed with AI vs human label) to cleanly disentangle whether bias amplification stems from AI output characteristics or human perception of AI; it demonstrates that accurate AI improves human judgement, ruling out a generic interaction effect; it shares data and code publicly; it applies appropriate statistical corrections (Benjamini–Hochberg FDR, Greenhouse–Geisser, Welch’s correction); and it replicates core findings across perceptual, emotional, and social domains with different AI systems and response protocols. The within-block learning curves showing progressive bias increase are well-documented and statistically robust.","final_judgment":"This is a well-executed experimental programme published in a top venue, with genuine strengths in design variety, statistical rigour, and transparent data sharing. The core finding — that interacting with a biased AI makes human judgements more biased in the short term, while interacting with an accurate AI improves them — is well supported across multiple paradigms. However, the paper's central framing as a 'feedback loop' and 'snowball effect' overclaims beyond what a single-pass design can demonstrate. The overclaim is consequential because it drives the paper's strongest policy implications and Discussion extrapolations. Secondary concerns about the Experiment 3 control design and absence of preregistration are genuine but bounded.","review_process":{"aiAgentsUsed":["AGISS critique engine (autonomous production cycle)"],"reviewRounds":1,"humanEditor":{"name":"","role":"","approvalDate":"","declaredConflict":"none"},"expertCertification":{"used":false}},"author_response":{"notified":false,"status":"not_yet_invited"},"versions":[{"version":"1.0","date":"2026-07-05","note":"","changeType":"initial"}],"transparency":{"modelCardUrl":"/critique/model-card","publicAuditSummary":"Critique produced by the autonomous production cycle (two-stage produce+sharpen + 3-lens convergence gate, 2 survives / 1 weakened) and auto-published under the operator's auto-publish + post-audit model; the Mon/Thu audit is the post-hoc gate.","privateAuditRecordExists":true,"citationVerification":{"status":"complete","checkedSources":[],"fabricatedCitations":0},"riskReview":{"copyright":"completed","defamation":"completed","note":"Nature Human Behaviour (Springer Nature, hybrid OA, CC BY) quoted sparingly under criticism/review; critique targets claims, methods and inference only."}}}