Crowdsourcing Evidence, Argumentation, Thinking and Evaluation (CREATE)
The CREATE program seeks to develop, and experimentally test, systems that use crowdsourcing and structured analytic techniques to improve analytic reasoning. These systems will help people better understand the evidence and assumptions that support—or conflict with—conclusions. Secondarily, they will also help users better communicate their reasoning and conclusions.
The CREATE program is envisioned as a 4.5-year effort that is intended to begin in September 2016. Phase 1 of the program lasted 23 months, Phase 2 will last 17 months and Phase 3 will last 14 months.
Join the CREATE study
We are looking for highly motivated, inquisitive, open-minded individuals to participate in CREATE. Please visit our experiment website to join in and help us improve analytic reasoning!
Performers (Prime Contractors)
George Mason University; Monash University; University of Melbourne; Syracuse University
- Social and behavioral sciences
- Informal reasoning
- Computer science
- Structured analytic techniques
To access CREATE program-related publications, please visit Google Scholar.
- Crowdsourcing security intelligence
- Dr. Steve Rieber: Program aims to improve human reasoning
- The future of crowdsourcing: Integrating humans with machines
- IARPA launches CREATE program
- IARPA Program Seeks to Build Up Analytic Reasoning Through Crowdsourcing-Based Platforms
- IARPA to Host Proposers’ Day for Program on Crowdsourcing, Analytic Thinking
- IARPA looks to the crowd
- Leveraging the Wisdom (and ignorance) of Crowds