{"$schema":"https://policywindow.org/critique/api/schema","critique_id":"CRIT-000025","slug":"local-us-officials-views-ai-governance","url":"https://policywindow.org/critique/c/local-us-officials-views-ai-governance","doi":null,"status":"published","critique_type":"editorially_approved_ai_native_critique","publication_date":"2026-06-28","current_version":"1.0","target_paper":{"title":"Local US officials' views on the impacts and governance of AI: Evidence from 2022 and 2023 survey waves","authors":["Sophia Hatz","Noemi Dreksler","Kevin Wei","Baobao Zhang"],"journal":"PLOS One","doi":"10.1371/journal.pone.0332919","url":"https://doi.org/10.1371/journal.pone.0332919","publicationDate":"2025","paperType":"empirical","accessBasis":"open_access","fullTextUsed":true,"fictional":false,"doi_url":"https://doi.org/10.1371/journal.pone.0332919"},"source_journal":{"tier":"exception","rankingSources":["off-monitored: peer-reviewed gold-OA journal (PLOS ONE) not in the monitored determination; disclosed off-list"],"rankingNote":"Off-monitored: PLOS ONE is a peer-reviewed, gold open-access journal not in the journal's monitored top-tier determination; disclosed off-list. Critiqued at full text."},"selection_provenance":{"id":"local-us-officials-views-ai-governance","venue":"PLOS One","inMonitoredSet":false,"determinedTier":null,"recordedTier":"exception","effectiveTier":"exception","kind":"off_list","disclosed":true,"offListPeerReviewed":true},"selection":{"aiAgiCentralityScore":3,"societalRelevanceScore":4,"aiAgiCategories":["human_AI_interaction"],"selectionReason":"Scale-the-full-text-cohort batch (white-space domain): full-text critique span-grounded to the gold-OA full text via the source store."},"scores":{"aiAgiContribution":3,"evidentiarySupport":3,"methodologicalRisk":3,"overclaiming":3,"reproducibilityOrAuditability":3,"societalImpactRelevance":4,"severity":"moderate","confidence":"high"},"severity_cap_for_access_basis":"high","plain_language_summary":"This is a competent, transparent two-wave survey (1028 completes; 524 in 2022, 504 in 2023) of US local elected officials' views on AI impacts and regulation, fielded by CivicPulse, using a planned-missing design with MICE imputation, survey weights, and multiplicity correction. Its descriptive findings (majorities expecting surveillance, misinformation, and data-security risks; 64% supporting regulation) are well supported. The problems are mostly interpretive overreach. The most consequential is that the headline narrative, that Republicans shifted to majority support between 2022 and 2023, rests on an unweighted descriptive jump (43% to 68%) computed across two independent samples of different people, not a tested differential change. Because the two waves are separate cross-sections (not a panel) and the abstract attributes the change to ChatGPT, the study cannot separate real attitude change from cohort and composition differences plus simultaneous national events. A second real gap: no response rate or contact denominator is reported, so nonresponse bias cannot be judged even though the authors invoke selection effects, and the 'somewhat representative' claim glosses over disclosed but unquantified skews toward larger, more Democratic, more educated districts. The authors disclose most issues candidly in a strong Limitations section, which lowers severity. (Two flaws in the draft critique cited sentences not present in the provided text and were re-anchored to verifiable abstract spans; a fourth, the I-dont-know coding issue, was dropped because it is author-disclosed and relied on numbers not in the provided sections.)","claims":[{"id":"C1","text":"The partisan-convergence story is foregrounded as a headline contribution, yet the only evidence carrying it is an unweighted, uncorrected descriptive cross-tab (43% to 68% among R","type":"methodological","evidenceOffered":"the latter experienced a notable shift towards majority support between 2022 and 2023","support":"moderate","overclaiming":"moderate","assessment":"The partisan-convergence story is foregrounded as a headline contribution, yet the only evidence carrying it is an unweighted, uncorrected descriptive cross-tab (43% to 68% among Republicans) drawn from two independent samples of different people across waves. A descriptive proportion difference between two cross-sections is not a tested differential-change effect, and the abstract escalates it to a 'notable shift' framed as a substantive over-time finding. The draft additionally asserts the year-by-party interaction is 'not statistically significant under the authors own corrected analysis,' but no such interaction result appears anywhere in the provided Methods/Results/Limitations/Abstract, so that specific claim cannot be verified from the text and the critique is held only to what the groundable spans support.","mainWeakness":"The partisan-convergence story is foregrounded as a headline contribution, yet the only evidence carrying it is an unweighted, uncorrected descriptive cross-tab (43% to 68% among Republicans) drawn fr","confidence":"high"},{"id":"C2","text":"The design is two independent cross-sections of different respondents (Methods: 'two independent waves'; 524 in 2022 and 504 in 2023), not a panel, yet the abstract frames the 2022","type":"causal","evidenceOffered":"the survey captures attitudinal changes within the six months following the public release of ChatGPT","support":"strong","overclaiming":"moderate","assessment":"The design is two independent cross-sections of different respondents (Methods: 'two independent waves'; 524 in 2022 and 504 in 2023), not a panel, yet the abstract frames the 2022-to-2023 difference as ChatGPT-induced attitudinal change. With no within-person measurement and many co-occurring 2023 developments plus differing sample composition across waves, the difference cannot be causally attributed to ChatGPT nor separated from cohort/composition effects. The temporal-window phrasing ('within the six months following the public release of ChatGPT') imports a causal reading the design cannot identify.","mainWeakness":"The design is two independent cross-sections of different respondents (Methods: 'two independent waves'; 524 in 2022 and 504 in 2023), not a panel, yet the abstract frames the 2022-to-2023 difference ","confidence":"high"},{"id":"C3","text":"No response rate, contact count, or sampling-frame denominator is reported: Methods gives only completed responses (1028; 524 and 504 by wave) and the existence of a CivicPulse lis","type":"methodological","evidenceOffered":"Sample medians are slightly skewed toward larger districts, are more Democratic, and are more educated than population median; generally, however, sample medians remain relatively close to population medians, suggesting that the samples are somewhat representative.","support":"moderate","overclaiming":"minor","assessment":"No response rate, contact count, or sampling-frame denominator is reported: Methods gives only completed responses (1028; 524 and 504 by wave) and the existence of a CivicPulse list, but never states how many officials were sampled or invited. This makes nonresponse bias impossible to gauge, which directly undercuts the authors own appeal to selection effects, and the representativeness conclusion is hedged as 'somewhat representative' despite self-reported skews toward larger, more Democratic, and more educated districts that are left unquantified.","mainWeakness":"No response rate, contact count, or sampling-frame denominator is reported: Methods gives only completed responses (1028; 524 and 504 by wave) and the existence of a CivicPulse list, but never states ","confidence":"high"}],"sections":[{"id":"what","title":"What the paper does","body":"This is a competent, transparent two-wave survey (1028 completes; 524 in 2022, 504 in 2023) of US local elected officials' views on AI impacts and regulation, fielded by CivicPulse, using a planned-missing design with MICE imputation, survey weights, and multiplicity correction. Its descriptive findings (majorities expecting surveillance, misinformation, and data-security risks; 64% supporting regulation) are well supported. The problems are mostly interpretive overreach. The most consequential is that the headline narrative, that Republicans shifted to majority support between 2022 and 2023, "},{"id":"flaw1","title":"Statistical Inference","body":"The partisan-convergence story is foregrounded as a headline contribution, yet the only evidence carrying it is an unweighted, uncorrected descriptive cross-tab (43% to 68% among Republicans) drawn from two independent samples of different people across waves. A descriptive proportion difference between two cross-sections is not a tested differential-change effect, and the abstract escalates it to a 'notable shift' framed as a substantive over-time finding. The draft additionally asserts the year-by-party interaction is 'not statistically significant under the authors own corrected analysis,' but no such interaction result appears anywhere in the provided Methods/Results/Limitations/Abstract, so that specific claim cannot be verified from the text and the critique is held only to what the groundable spans support."},{"id":"flaw2","title":"Identification","body":"The design is two independent cross-sections of different respondents (Methods: 'two independent waves'; 524 in 2022 and 504 in 2023), not a panel, yet the abstract frames the 2022-to-2023 difference as ChatGPT-induced attitudinal change. With no within-person measurement and many co-occurring 2023 developments plus differing sample composition across waves, the difference cannot be causally attributed to ChatGPT nor separated from cohort/composition effects. The temporal-window phrasing ('within the six months following the public release of ChatGPT') imports a causal reading the design cannot identify."},{"id":"flaw3","title":"Sample Data","body":"No response rate, contact count, or sampling-frame denominator is reported: Methods gives only completed responses (1028; 524 and 504 by wave) and the existence of a CivicPulse list, but never states how many officials were sampled or invited. This makes nonresponse bias impossible to gauge, which directly undercuts the authors own appeal to selection effects, and the representativeness conclusion is hedged as 'somewhat representative' despite self-reported skews toward larger, more Democratic, and more educated districts that are left unquantified."},{"id":"strengths","title":"What the paper does well","body":"This is a transparent descriptive survey, and on the dimensions that matter most for a descriptive contribution it is solid: a planned-missing design handled with MICE (120 imputations, 200 iterations, predictive mean matching), survey weights folded into the imputation model, and Benjamini-Hochberg correction guarding against false positives. The core descriptive findings, majorities anticipating surveillance (83%), misinformation (69%), and reduced data security (64%), and 64% supporting government regulation, are simple proportions that need no causal identification and are well supported. The authors do not hide the weaknesses: the Limitations section explicitly flags selection effects, the IDK/Likert coding problem, missingness up to 69%, the power cost of multiplicity correction, and subgroup imprecision, and the partisan language in the abstract is hedged as a 'shift' rather than asserted as a ChatGPT-caused effect, so much of the overreach lives in framing emphasis rather than in unqualified causal assertion."}],"strongest_critique":"The paper's most-promoted contribution, a Republican shift toward majority support for AI regulation between 2022 and 2023, is carried entirely by an unweighted descriptive cross-tab (43% to 68%) computed across two independent samples of different people, not by a tested differential-change effect. Because there is no panel (Methods: 'two independent waves'; separate 2022 and 2023 respondents), the over-time difference confounds genuine attitude updating with sample composition and a dense cluster of simultaneous 2023 developments, so neither the ChatGPT attribution nor the convergence claim is identified. Leading the abstract with this temporal-causal story ('captures attitudinal changes within the six months following the public release of ChatGPT' and a 'notable shift towards majority support') overstates what two cross-sections can bear.","strongest_fair_defence":"This is a transparent descriptive survey, and on the dimensions that matter most for a descriptive contribution it is solid: a planned-missing design handled with MICE (120 imputations, 200 iterations, predictive mean matching), survey weights folded into the imputation model, and Benjamini-Hochberg correction guarding against false positives. The core descriptive findings, majorities anticipating surveillance (83%), misinformation (69%), and reduced data security (64%), and 64% supporting government regulation, are simple proportions that need no causal identification and are well supported. The authors do not hide the weaknesses: the Limitations section explicitly flags selection effects, the IDK/Likert coding problem, missingness up to 69%, the power cost of multiplicity correction, and subgroup imprecision, and the partisan language in the abstract is hedged as a 'shift' rather than asserted as a ChatGPT-caused effect, so much of the overreach lives in framing emphasis rather than in unqualified causal assertion.","final_judgment":"A methodologically careful, transparency-forward descriptive survey whose value lies in mapping local US officials' AI attitudes, undermined chiefly by interpretive overreach: the headline partisan-convergence-after-ChatGPT narrative is foregrounded in the abstract despite resting on an unweighted descriptive cross-tab and an independent-cross-section design that cannot identify change or its cause. The descriptive results (risk anticipations, 64% regulation support, specific-policy majorities) are trustworthy; the temporal, causal, and partisan-shift claims should be read as suggestive at best. Severity is moderate because the authors disclose most design weaknesses candidly in a strong Limitations section and the under-supported claims are largely confined to abstract framing rather than the proportions themselves, but the mismatch between what the abstract emphasizes and what two cross-sections support is real and would mislead a casual reader. Note on the draft under review: two of its four proposed flaws cited verbatim spans (the 'interaction between year and party is not statistically significant' sentence and the 'design was not a longitudinal panel' sentence) that do not appear in the provided Methods/Results/Limitations/Abstract; those spans were not groundable, so the affected critiques were re-anchored to verifiable abstract spans and the unverifiable non-significance assertion was removed. The measurement/IDK flaw was dropped as author-disclosed and dependent on ungroundable specifics (26% IDK, '21 additional significant coefficients'), leaving three defensible, span-exact flaws.","review_process":{"aiAgentsUsed":["claim_extraction","methods","statistics","adversarial","author_defence","plain_language","meta_review"],"reviewRounds":2,"humanEditor":{"name":"","role":"","approvalDate":"2026-06-28","declaredConflict":"none"},"expertCertification":{"used":false}},"author_response":{"notified":false,"status":"not_yet_invited","editorialActionAfterResponse":"Authors may reply at any time; this critique addresses claims, methods and inference only, never the authors."},"versions":[{"version":"1.0","date":"2026-06-28","note":"Initial publication (scale-the-full-text-cohort batch).","changeType":"initial"}],"transparency":{"modelCardUrl":"/critique/model-card","publicAuditSummary":"Full-text critique of a gold-OA paper; every span verified an exact substring of the full text (source store), independently re-checked; DOI resolves (title+author+year matched). Convergence gate (refute+defender+neutral) survives-majority. Targets claims/methods/inference only.","privateAuditRecordExists":true,"citationVerification":{"status":"complete","checkedSources":[{"label":"DOI 10.1371/journal.pone.0332919 (Crossref: title+author+year matched)","url":"https://doi.org/10.1371/journal.pone.0332919","verified":true},{"label":"Full text used for span verification","url":"https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0332919","verified":true}],"fabricatedCitations":0},"riskReview":{"copyright":"completed","defamation":"completed","note":"Gold OA paper quoted sparingly under criticism/review; targets claims/methods/inference only."}}}