すべての人に一次情報を
研究者は自律AI組織の設計において、協力を維持し、信頼できる集団判断を可能にし、人間の正当な目的に責任を持たせる7つの原則を開発した。 まず互恵的貢献を促し、次に権威を説明責任あるものにし、機能分化を導入、認識的多様性を確保、批判と訂正の仕組みを整備し、人間の指示と機関の適応を組み合わせた設計方針である。 次に、研究者はこれらの原則を検証する実験的研究プログラムを提案した。 具体的には、異なる制度規則の下で同一集団のAIエージェントをマッチさせて比較し、集団の能力や整合性を測定する手法である。 例としてMoltiJournalと呼ばれるAPI‑ファーストの機械可読誌を導入し、バージョン管理された憲法と公開イベントログを用いて原則のうち5項目を実装した。 (Figure 1) は、この実験設計を示しており、同じ機能を持つエージェントでも制度規則が異なると、集団の成果に差が生じることを可視化している。 最後に、制度規則は意図しない副作用をもたらす可能性があるため、継続的な監視と改訂を行う必要があると注意している。
| Institutional principle | General institutional challenge | Application to machine science | Empirical question |
|---|---|---|---|
| 1. Reciprocal provision of collective goods | Participants may benefit from collective resources without contributing to their provision. | Link submission rights to adequate contributions to reviewing and editorial evaluation. | When does enforced reciprocity improve evaluation rather than encourage superficial compliance? |
| 2. Accountable and contestable authority | Authority enables coordination but risks bias, abuse and institutional capture. | Evaluate reviewers and editors, allocate authority based on performance and establish independent appeals. | How can performance-based authority improve decisions without reinforcing bias or concentrating power? |
| 3. Functional differentiation | Combining distinct institutional functions can create conflicting incentives and distorted decisions. | Separate assessments of scientific soundness from judgments of significance and attention allocation. | Does separating these functions improve epistemic reliability without undermining coordination? |
| 4. Epistemic pluralism and independence | Correlated errors and premature consensus undermine the reliability of collective judgments. | Diversify research approaches and reviewers, preserve independent assessments and record model provenance. | Under what conditions do diversity and information sharing improve discovery and error detection? |
| 5. Institutionalized criticism and correction | Collective errors persist when established judgments are insufficiently challenged or revised. | Reward replication and substantive challenges; maintain a revisable scientific record. | How can continuous scrutiny improve error correction without producing excessive noise or strategic challenges? |
| 6. Human direction and delegated autonomy | Collective capabilities may serve objectives that lack legitimate human direction or accountability. | Set human-governed research priorities while allowing agents to explore competing approaches and rewarding validated progress. | How can human-defined goals direct collective research without undermining autonomy or open-ended discovery? |
| 7. Institutional learning and adaptation | Formal rules may have unintended effects or give rise to problematic emergent practices. | Experimentally compare institutional rules, monitor emergent behaviour and revise rules under human oversight. | How do formal rules and emergent practices jointly shape collective capability and alignment? |