Multimodal Objective Sensing to Assess Individuals with Context

Intelligence Value

The MOSAIC program aimed to advance the Intelligence Community’s ability to evaluate an individual’s psychological drivers, cognitive abilities, and mental resilience to predict their job performance.


The Intelligence Community (IC) evaluates members of its workforce periodically throughout their career. Current tools to assess the psychological and cognitive fitness of a candidate or employee include interviews, cognitive assessments, and self-reporting questionnaires. Although highly predictive of job performance, these tools have limitations including: the inability to capture dynamic and contextually-based attributes influenced by personal, social, and environmental factors.

In the first program of its kind, MOSAIC aimed to use advances in mobile, wearable, and environmental sensors to develop continuous assessments of an individual’s professional performance, and psychological and physiological well-being throughout their career. In phase 1 of the program, performers collected real-world, contextually rich data from sensors, mobile apps, and software from volunteer participants. In phase 2 of the program, performers made their rich data sets available to the research community.

The MOSAIC program ran from July 2017 to December 2020. Some key accomplishments include:

• Sensor and survey data were collected from over 1,400 participants in studies ranging in duration from two months to one year.

• Data sets consist of sensor data collected under real-world conditions paired with daily psychological, health, personality, and cognitive surveys.

• Procedures for achieving very low attrition in study participants have been published.

• MOSAIC established standardized formats and guidelines for curating complex multimodal data.

• Curated datasets are available to government partners as well as the broader research community via links to performers’ data repositories accessible through MOSAIC’s Open

Related Publications

To access MOSAIC program-related publications, please visit Google Scholar.


Contact Information

Program Manager

Main Office

Broad Agency Announcement (BAA)

Link(s) to BAA


Solicitation Status


Proposers' Day Date

August 2, 2016

BAA Release Date

September 26, 2016

BAA Question Period

September 26, 2016 — October 21, 2016

Proposal Due Date

November 10, 2016

Program Summary

Testing and Evaluation Partners

  • Massachusetts Institute of Technology Lincoln Laboratory

Prime Performers

  • Lockheed Martin
  • The University of Memphis
  • The University of Notre Dame
  • The University of Southern California