arXiv News

First-hand information for everyone

Site

AboutPrivacy PolicyTerms of Use

© 2026 arXiv News

arXiv News

EnglishJapanese

Switch language

EnglishJapanese
Loading account…

First-hand information for everyone

Back to front page
Human-Computer InteractionEnglishPublished

AutoAnalysis shows human‑AI teams beat humans alone but fall short of the best solo performer

November 3, 2026arXiv: 2610.42001v1

AutoAnalysis is an automated, self‑updating meta‑analysis of human‑AI collaboration. The pipeline uses AI agents to perform every step of a systematic review—searching, screening, reviewing, extracting data, synthesizing results and producing a report—without human intervention. An audit agent cross‑checks each decision, agreeing 90 % of the time at the screening stage. The most recent run of AutoAnalysis combined data from 420 papers and 1,955 effect sizes. It found that human‑AI teams outperformed humans alone (g = 0.53, 95 % CI [0.45, 0.61]). However, they performed worse than the best of the two solo groups (g = –0.35, 95 % CI [–0.52, –0.18]). The analysis is limited to English peer‑reviewed experiments, may be biased by publication bias and high heterogeneity, and the synergy result relies on a small subset of studies that reported AI performance alone. These caveats mean that while the finding highlights important differences between improvement and synergy, it does not yet establish long‑term educational or organizational benefits.

Diagram of the AutoAnalysis pipeline showing AI agents sequentially carrying out all six stages of a systematic review, from searching literature to reporting results, without human intervention.
The AutoAnalysis pipeline illustrating the AI‑driven systematic review stages—search, screening, review, extraction, synthesis, and reporting—performed automatically.
Figure 2.
Vaccaro, Michelle, Almaatouq, Abdullah, Malone, Thomas W. · arXiv:2610.42001v1 · Figure 2: · CC BY 4.0

Source paper

AutoAnalysis: An automated, self-updating meta-analysis of human-AI collaboration

Human-Computer InteractionArtificial Intelligencecs.CYcs.DL
View on arXiv
AutoAnalysis shows human‑AI teams beat humans alone but fall short of the best solo performer | arXiv News