{"$schema":"https://policywindow.org/critique/api/schema","critique_id":"CRIT-GEN-being-literate-behaving-","slug":"being-literate-behaving-literate-a-mixed-methods-a","url":"https://policywindow.org/critique/c/being-literate-behaving-literate-a-mixed-methods-a","doi":null,"status":"published","critique_type":"editorially_approved_ai_native_critique","publication_date":"2026-06-21","current_version":"1.0","target_paper":{"title":"Being literate, behaving literate? A mixed-methods approach to adolescents’ algorithm literacy and behavioral strategies on social media","authors":["Larissa Leonhard","Ruth Wendt","Claudia Riesmeyer"],"journal":"New Media & Society","doi":"10.1177/14614448261446589","url":"https://doi.org/10.1177/14614448261446589","publicationDate":"2026-05-03","paperType":"conceptual","accessBasis":"abstract_only","fullTextUsed":false,"fictional":false,"doi_url":"https://doi.org/10.1177/14614448261446589"},"source_journal":{"tier":"B","rankingSources":["resolved from the monitored-venue determination"],"rankingNote":"Tier B per the determination; ingested from an AGISS critique artifact."},"selection_provenance":{"id":"being-literate-behaving-literate-a-mixed-methods-a","venue":"New Media & Society","inMonitoredSet":true,"determinedTier":"B","recordedTier":"B","effectiveTier":"B","kind":"monitored","disclosed":true},"selection":{"aiAgiCentralityScore":1,"societalRelevanceScore":3,"aiAgiCategories":[],"selectionReason":"Selected via the production queue; critique generated by the AGISS engine."},"scores":{"aiAgiContribution":1,"evidentiarySupport":3,"methodologicalRisk":2,"overclaiming":1,"reproducibilityOrAuditability":2,"societalImpactRelevance":3,"severity":"low","confidence":"medium"},"severity_cap_for_access_basis":"moderate","plain_language_summary":"This study asks whether teenagers who understand social-media algorithms actually behave differently online. Using focus groups, a phone-diary study, and a representative survey of German 14-17-year-olds, it sorts responses to algorithmic feeds into three types: indifferent, interactive (liking/sharing to steer the feed), and preventive (blocking or privacy settings). Surprisingly, teens with more algorithm awareness scroll more passively, while those with more algorithm knowledge interact less, possibly because they dislike being profiled. The abstract is honest about its limits, sticks to correlational language, and flags its key explanation as a guess. Its main weaknesses, judging only from the abstract, are that it never defines the two literacy measures it relies on, reports no effect sizes or sample size, and links attitudes to behavior with a vague word. It is a modest, useful contribution to understanding media literacy, with little direct bearing on building AI itself.\"}","claims":[{"id":"c1","text":"Higher algorithm awareness is associated with increased indifferent behavior.","type":"empirical","evidenceOffered":"\"The results indicate that higher algorithm awareness is associated with increased indifferent behavior\"","support":"moderate","overclaiming":"minor","assessment":"The abstract correctly uses associational language (\"is associated with\"), avoiding a causal claim, which is appropriately hedged for what is described as a representative survey. On the critic's reading, the headline pairing of \"awareness\" with passivity is counterintuitive (one might expect awareness to drive action), and the abstract offers no mechanism for this specific link, in contrast to the partial explanation offered for the knowledge-interaction link. Without the reported effect sizes or model specification (none stated in the abstract), the strength and practical magnitude of this correlation cannot be judged.","mainWeakness":"Association reported without effect size or magnitude in the abstract; no mechanism offered for the awareness-indifference link.","confidence":"medium"},{"id":"c2","text":"Greater algorithm knowledge correlates with reduced interaction, possibly due to a reluctance to engage with algorithmic profiling.","type":"empirical","evidenceOffered":"\"greater algorithm knowledge correlates with reduced interaction, possibly due to a reluctance to engage with algorithmic profiling\"","support":"moderate","overclaiming":"minor","assessment":"The claim is appropriately hedged on two counts: \"correlates with\" for the relationship and \"possibly due to\" for the mechanism. The proposed mechanism (reluctance to engage with profiling) is explicitly flagged as conjecture, which is candid. On the critic's reading, the abstract distinguishes two literacy components, \"algorithm awareness\" and \"algorithm knowledge,\" that push behavior in different directions; the abstract does not state how these two constructs are operationalized or whether they are empirically separable, which matters because the headline contrast depends on them being distinct.","mainWeakness":"The distinction between \"awareness\" and \"knowledge\" as separate predictors is load-bearing but undefined and unvalidated in the abstract; the mechanism is admittedly speculative.","confidence":"medium"},{"id":"c3","text":"Adolescents respond to algorithmically curated content via three identifiable behavioral strategies: indifferent, interactive, and preventive.","type":"conceptual","evidenceOffered":"\"we identify three behavioral strategies in response to algorithmically curated content: (1) indifferent behavior... (2) interactive behavior... and (3) preventive behavior\"","support":"moderate","overclaiming":"minor","assessment":"As a typology emerging from mixed methods (focus groups, mobile diary, survey), a three-category scheme is a reasonable interpretive contribution and is presented as something the authors \"identify\" rather than as exhaustive or mutually exclusive. On the critic's reading, the abstract does not claim the three categories are exhaustive or non-overlapping, so faulting it for omitted categories would over-read; the appropriate caution is that the typology's boundaries and whether behaviors co-occur within individuals are not specified in the abstract.","mainWeakness":"Typology completeness and category mutual-exclusivity are unspecified in the abstract, limiting assessment of its analytic sharpness.","confidence":"medium"},{"id":"c4","text":"The findings hold for German adolescents aged 14-17 sampled via a representative survey alongside qualitative components.","type":"empirical","evidenceOffered":"\"a representative survey of German adolescents aged 14-17\" using \"focus groups, a mobile diary study, and a representative survey\"","support":"moderate","overclaiming":"minor","assessment":"The abstract is admirably specific about population and method, and confines its scope to German adolescents 14-17, which is appropriate modesty. On the critic's reading, \"representative\" is asserted but the sampling frame, sample size, and representativeness criteria are not stated in the abstract; the survey's representativeness cannot be evaluated from the text. Generalization beyond German adolescents in this age band is not claimed and should not be expected.","mainWeakness":"\"Representative\" is asserted without sample size or sampling details in the abstract; cultural/platform specificity bounds external validity.","confidence":"medium"},{"id":"c5","text":"Adolescents' ambivalent attitudes toward algorithms underscore these behavioral patterns.","type":"conceptual","evidenceOffered":"\"Adolescents' ambivalent attitudes toward algorithms underscore these behavioral patterns\"","support":"weak","overclaiming":"minor","assessment":"This is an interpretive linking claim. On the critic's reading, \"underscore\" is vague about the inferential relationship, neither correlation nor cause, and the abstract does not state whether attitude ambivalence was measured and modeled against the behavioral strategies or surfaced qualitatively. As stated, the claim describes rather than tests a relationship, so its evidentiary basis within the abstract is thin.","mainWeakness":"The attitude-behavior link is asserted via the vague verb \"underscore\" without specifying whether and how ambivalence was measured against behavior.","confidence":"medium"},{"id":"c6","text":"The work highlights the need for future research to refine the concept of \"algorithm-literate\" behavior.","type":"normative","evidenceOffered":"\"highlights the need for future research to refine the concept of \\\"algorithm-literate\\\" behavior\"","support":"moderate","overclaiming":"none","assessment":"This is a modest, agenda-setting closing claim that the abstract supports by its own findings: if awareness predicts passivity and knowledge predicts reduced interaction, then equating literacy with active engagement is questionable, which justifies the call to refine \"algorithm-literate\" behavior. This is appropriately hedged and not overclaimed. The title's question, \"Being literate, behaving literate?\", frames the contribution as problematizing rather than resolving the literacy-behavior link.","mainWeakness":"Largely a future-research call; it identifies a conceptual gap without resolving what normatively counts as \"literate\" behavior.","confidence":"high"}],"sections":[{"id":"s1","title":"What the paper claims","body":"The article investigates the relationship between adolescents' algorithm literacy and their behavior on social media, using a mixed-methods approach (focus groups, a mobile diary study, and a representative survey of German adolescents aged 14-17). It makes a descriptive-typological contribution, identifying three behavioral strategies in response to algorithmically curated content: indifferent, interactive (liking or sharing to influence outcomes), and preventive (blocking content or adjusting privacy settings). Its two empirical headline findings are associational and carefully hedged: that higher algorithm awareness is associated with increased indifferent behavior, and that greater algorithm knowledge correlates with reduced interaction. The paper closes modestly, framing its value as highlighting the need for future research to refine the concept of \"algorithm-literate\" behavior rather than as settling it."},{"id":"s2","title":"Strengths and candour","body":"The abstract is notably candid and self-limiting, which warrants a lighter critique. It uses associational language throughout (\"is associated with,\" \"correlates with\") and never overclaims causation. Its central mechanism is explicitly marked as conjecture: reduced interaction is \"possibly due to a reluctance to engage with algorithmic profiling.\" Scope is bounded to a specific population (German adolescents aged 14-17), avoiding overgeneralization. The closing move is appropriately humble, presenting the work as problematizing the literacy-behavior mapping rather than resolving it. The mixed-methods design, combining focus groups, a mobile diary study, and a survey, is well suited to building a behavioral typology and triangulating self-report with diary-recorded behavior, a genre-appropriate strength."},{"id":"s3","title":"Where the evidence is thin (abstract-only)","body":"The load-bearing finding rests on distinguishing two literacy sub-constructs, \"algorithm awareness\" and \"algorithm knowledge,\" which push behavior in opposite directions. The abstract neither defines these constructs nor indicates whether they are empirically separable; if they are highly collinear, the contrasting associations are hard to interpret. No effect sizes, sample size, or model specification are stated, so the magnitude and robustness of both associations cannot be judged from the text. \"Representative\" is asserted without a sampling frame. The attitude claim, that ambivalent attitudes \"underscore\" the patterns, uses a vague verb that does not specify whether ambivalence was measured and modeled against behavior or surfaced only qualitatively. These are reporting gaps at the abstract level, not demonstrated errors."},{"id":"s4","title":"Interpretation and AI relevance","body":"On the critic's reading, the most interesting and most fragile interpretive move is treating indifferent behavior as a literacy-linked strategy: passivity could equally reflect disengagement, habit, or platform design friction rather than an informed response, and the abstract does not rule these out. The finding that awareness tracks with passivity while knowledge tracks with reduced interaction is genuinely counterintuitive and is the paper's strongest hook, but the abstract offers a mechanism only for the second link, leaving the first asserted. Regarding AI/AGI relevance, the paper concerns human literacy about and behavior toward recommender systems, not AI systems' capabilities; its contribution to AI/AGI development is minimal, though its relevance to the societal governance of algorithmic media for minors is real."}],"strongest_critique":"The paper's headline contrast depends entirely on separating two literacy sub-constructs, \\\"algorithm awareness\\\" and \\\"algorithm knowledge,\\\" which are reported to predict opposite behaviors, yet the abstract neither defines them nor shows they are empirically distinct rather than collinear; combined with the absence of any effect sizes, sample size, or model details in the abstract, the strength and even the interpretability of the central associations cannot be assessed from the text. The counterintuitive awareness-predicts-passivity link is asserted without any mechanism, and \\\"indifferent behavior\\\" is read as a literacy-linked strategy when it could equally reflect disengagement or platform design, an alternative the abstract does not rule out.","strongest_fair_defence":"This is a genre-appropriate mixed-methods study that does what an abstract should: it states its population precisely, confines its scope to German adolescents 14-17, uses strictly associational language, explicitly marks its central mechanism as conjecture (\\\"possibly due to\\\"), and ends by calling for conceptual refinement rather than claiming to have settled anything. The three-strategy typology is a legitimate interpretive contribution from triangulated data (focus groups, diary, survey), and the counterintuitive finding that literacy does not straightforwardly translate into active engagement is exactly the kind of problematizing result that advances a field's concepts. Missing effect sizes and construct definitions are normal omissions at the abstract layer and may well be fully reported in the body; none of the gaps noted here are demonstrated errors, only items an abstract-only reader cannot verify.\"}","final_judgment":"A modest, candid, genre-appropriate empirical contribution to media-literacy research. Its associational claims are carefully hedged and its scope is honestly bounded to German adolescents aged 14-17, so overclaiming is low. The principal limitation, visible only at the abstract level, is that the load-bearing distinction between \\\"algorithm awareness\\\" and \\\"algorithm knowledge\\\" is undefined and its separability unverified, and no effect sizes are given, so the central counterintuitive associations cannot be magnitude-assessed from the text; the awareness-predicts-passivity link is asserted without a mechanism. These are abstract-level reporting gaps, not demonstrated flaws, and may be resolved in the full paper. Direct relevance to AI/AGI development is minimal; relevance to the societal governance of algorithmic media for minors is moderate. Severity capped at low under abstract-only access.","review_process":{"aiAgentsUsed":["claim_extraction","ai_agi_relevance","adversarial","author_defence","citation_integrity","legal_risk","meta_review"],"reviewRounds":1,"humanEditor":{"name":"","role":"","approvalDate":"","declaredConflict":"none"},"expertCertification":{"used":false}},"author_response":{"notified":false,"status":"not_yet_invited"},"versions":[{"version":"1.0","date":"2026-06-21","note":"","changeType":"initial"}],"transparency":{"modelCardUrl":"/critique/model-card","publicAuditSummary":"Critique generated by the AGI Social Scientist engine; ingested as a staged draft pending the automated integrity gate (no human editor).","privateAuditRecordExists":true,"citationVerification":{"status":"complete","checkedSources":[],"fabricatedCitations":0},"riskReview":{"copyright":"completed","defamation":"completed","note":"Abstract-only critique: no reproduction beyond sparse criticism/review quotation; critiques claims/methods/evidence not motives (motive-scan clean); no false statements of fact about persons."}}}