Identifying Trojans in AI


With the rise of adversarial AI, government researchers are looking for ways to automatically inspect artificial intelligence and machine learning systems to see if they've been tampered with. [...] The Army Research Office and the Intelligence Advanced Research Projects Activity are investigating techniques to spot and stop these Trojans in AI systems. Given the impossibility of cleaning and securing the entire training data pipeline, the broad agency announcement for the TrojAI program is looking to develop software to automatically inspect AI and predict if it has a Trojan. [...] Initial concept papers are due May 31, and the highest ranked applicants will be invited to submit a full proposal. Read the full BAA here.