IARPA is seeking information on established techniques, metrics and capabilities related to the evaluation of generated text and the evaluation of human-interpretable explanations for neural language model behavior.
The purposes of this RFI are the following:
• Identification of novel human or automatic techniques, metrics and capabilities for evaluating the sense and soundness of machine modified text
• Identification of novel methods to derive human-interpretable explanations from NLM text classifiers
• Identification of novel techniques for measuring the quality of local explanations derived from NLMs
For more information and submission instructions, please visit: Sam.gov
Published Date: Nov 22, 2021
Response Date: Dec 10, 2021
