IARPA: Disbelief to Doubt

In Part 1 of the premiere episode of the Intelligence Advanced Research Projects Activity's (IARPA) new podcast series, we sit down with former Director Catherine Marsh to discuss IARPA's origin story and the world events that led to her joining government service and set her on a path to leading what the New York Times has heralded as "one of the government's most creative agencies."

Timestamp	Caption
00:00:00	Disbelief To Doubt Podcast Episode 1 Part 1: Leap of Faith Guest: Dr. Catherine Marsh Dimitrios Donavos: IARPA sponsors research that tackles the intelligence community's most difficult challenges and pushes the boundaries of science. We start with ideas that often seem impossible and work to transform them from a state of disbelief to a state of just enough healthy skepticism or doubt that by bringing together the best and brightest minds, we can redefine what's possible. This podcast will explore the history and accomplishments of IARPA through the lens of some of its most impactful programs and the thought leaders behind them. This is IARPA, Disbelief to Doubt. Dimitrios Donavos: In the premiere of the new podcast series from the Intelligence Advanced Research Projects activity, IARPA, we sit down with outgoing director Dr. Catherine Marsh to discuss IARPA's origin story and the world events that led to her joining government service and set her on a path to leading what the New York Times has heralded as one of the government's most creative agencies. Take a listen… Dimitrios Donavos: Hello and welcome to IARPA Disbelief to Doubt. I’m your host, Dimitrios Donavos, and today we welcome Dr. Catherine Marsh, Director of IARPA. Dimitrios Donavos: Dr. Marsh, thank you for joining us today and helping us kick off Disbelief to Doubt. Catherine Marsh: I love it, just absolutely love it. Dimitrios Donavos: We are speaking to you today in your role as the director of IARPA, but you have had a long and distinguished career prior to your tenure here, both in government and industry, including leading the team that put lithium-ion technology on NASA's Mars Exploration Rover's Spirit and Opportunity. You hold bachelor's and doctorate degrees from Brown University in inorganic and analytic chemistry and had to overcome a disadvantaged background and the challenges of being a woman in a traditionally male-dominated scientific field. Take us back to the beginning and walk us through what sparked your desire to pursue a career in science and how you ultimately ended up leading battery development for the Spirit and Opportunity Mars Rovers. Catherine Marsh: Sure, thank you. Welcome the opportunity. It really, it started with landing on the moon. When I was a kid, right? I remember, I was, you know, in 1969, when we landed on the moon, I was there in the side room of our house with my mom and my dad and my brothers. And we watched Neil Armstrong walk on the moon. And- That was a miracle to me as a little kid. And my parents were so excited as we were watching this. And yet it's like, how is it we did that, right? And it to me was just so magical that we could do something like that. And my dad was an engineer, and my mom actually was a scientist, but women weren't allowed to be scientists back in the 50s. And so, she became a schoolteacher. And that's not a bad thing. But they always encouraged us to be curious and to ask questions. And that really was the start is back then. And then, you know, as I was growing up and my parents were both having to work to be able to make ends meet, I had to cook dinner, right. And so to learn how to cook, you have to figure out how things work in the kitchen right? And it's not always so obvious. I burnt a lot of things, but I also learned to be a really good baker, and baking and chemistry go hand in hand. So when I went to school, I just had the good fortune of being really curious, which lent itself to studying the sciences, at least in the public schools that I went through. And when I was in high school, I really, really, really wanted to go to Brown University, and I said to everybody that that's where I'm going to go from the time I was 13 years old. And they had a seven-year medical program that I wanted to get into. And when I was 17, I applied to college, and I was accepted into the school, but not into the program I wanted to get into. And when I was studying in your freshman year, I was studying, you know, chemistry and bio and biology was this great big huge class and everybody was, you know, kind of backstabbing because they all wanted to get into medical school and I was just really thriving in chemistry and I decided that that's where I was going to pursue my education and when I finished college, I was the only woman in my graduating class in chemistry. But that's okay, you just make it happen. And then it was in the early 80s and I said, there were really no jobs. And I ended up going to grad school and majoring in inorganic and analytical chemistry. So I actually studied, how do you make cold water bleaches work? And then you're like, how does that translate into batteries? It doesn't, okay. But rates of reactions are rates of reactions and how do you make things work with different kinds of catalysts and make them work well. And so I did some of that fundamental early work to make cold water bleaches work much more effectively. And then when I finished, I had the good fortune of getting hired by the Naval Undersea Systems Command at the time in Newport, Rhode Island to work in the lab and to be a chemist in the lab. And I was somebody... took a chance on me as a curious young scientist and Jim Modin was his name and he was my mentor until he passed away a number of years ago and he just took me under his wing. I didn't know electrochemistry other than the class I had taken in college and I was taught how to think critically when I was in college and grad school and applying that to the problem that we had at the time, which is how do you make, quite frankly, torpedoes, work quietly at depths and at speeds that were necessary and doing that with next generation technology. So I've always been in that field where we're exploring what comes next, what can you do and how do you get it there. And so that wasn't lithium-ion technology, but it certainly was the development of battery technology for a wide variety of naval applications. And the naval applications are some of the most challenging in the world because of the undersea environment and the excess corrosion that you have to worry about due to dissimilar metals and things like that. People forget how challenging an environment that's working in. So it makes you think about all the fringe cases, all those out of the box, not so traditional ways of having to do things. And when I left the Navy and ultimately ended up working in the private sector at Yardney Technical Products, it was the early days of lithium-ion technology. And we were one of the successful developers of lithium-ion technology. And we were competitively selected by the Air Force to do some development of lithium-ion technology for some Air Force applications. And through that, our team at Yardney Technical Products grew some really great technical expertise that we were then ultimately selected to be part of the development team for the lithium-ion batteries for NASA's Spirit and Opportunity. So we had a number of other successful military and DOD applications that the technology was used on before we were a part of the team that got to do Spirit and Opportunity. So we were really fortunate. Dimitrios Donavos: You mentioned that you were one of the only women to graduate with your degree at the time, at least in your program. How do you feel that challenged you moving forward as you sort of were exploring your career and thinking about where your next step would be, especially after graduate school? Catherine Marsh: It's a, it's an interesting question. I'm not sure I, I understood it to be the disadvantage, a disadvantage because I had such great mentors and people who gave me opportunities and to, and helped me along the way. I never viewed it as I, I was a Singleton. I often went to conferences and I was the only one there. But what it made me do was really be an expert, such that when I was part of the conversation, I wasn't doubted or I wasn't second guessed, but I had to be that much better. And I continue to challenge myself that way, is that if I don't know something, I'm going to explore and study and make sure that I understand those nuances and get smart on it so that when I am part of the conversation, I really am speaking from a technically strong position. And that's how I have continued to, I think, excel. And that way, I'm not getting undergoing any second guessing, because I really have got the answers to the questions that are being posed. I've never and maybe it's because I've had such great mentors, I would not undersell that at all. It's also made me a good mentor to many other people because I know the power of that to help them grow and develop as young professionals. You need somebody who you can brainstorm with and talk through and somebody who's encouraging you to take that next step. When I worked for the Navy...we had this internal Navy program called IRIED, internal research and internal exploratory development, and my mentor wanted me to write proposals to that, and I was funded. And so the positive reward for what you're doing helps you continue to grow and build that confidence in my technical growth and technical development. I never said...I never said to myself, I can't do that because... Dimitrios Donavos: You mentioned Jim Modin as a mentor, and I'm curious, did you have any female mentors that impacted your life professionally, personally, or if there are other mentors that you wanted to reference? Catherine Marsh: I would say that over my career, Stephanie O'Sullivan, I met Stephanie the first day that I EOD'd, entered on duty with the CIA. She happened to be, not the first day, but the first day I was in Power Sources Center. She was in there meeting with George Methley and I got to meet the future Deputy Director of National Intelligence and the person who became the head of the Directorate of Science and Technology at the agency. And so I always, I had her to look up to as somebody who, wow, she had quite, she was, when I came on board to the agency, she was already very senior and only went up from there and it just so happens that the programs that I was working on and with were those that she had an interest in. And so I had the opportunity to actually brief her, well prepared to brief her. You never brief somebody if you're not really well prepared. I think that's important. On the technical progress of my programs over time and got really, really good feedback and interest in what we were doing. So I would say she's been one of the great mentees that I've had. Mentors, excuse me that I've had as a female in my career. Dimitrios Donavos: Speaking of mentoring and challenges, the Mars Rover's exceeded their original 90-day mission life by nearly 15 years and are credited with major scientific discoveries, including evidence of past liquid water on Mars. Not many people can say their technology enabled exploration and scientific discovery on another planet. What was the most challenging thing you had to overcome to help enable that mission? And what did you learn about yourself in the process? Catherine Marsh: So along the way, you know, nothing is ever a straight line, right? And while we were building, you know, you go through a series of experimental designs to get to the point where you are able to successfully deliver product. And while we were, prior to the missions for Spirit and Opportunity we were working on the Mars Lander mission that never went, right. So the technology that was developed for that was resized to go, what we learned on that mission was the enabler to the Spirit and Opportunity. And when we were doing those batteries, it just so happens they're prismatic batteries, so they stack up like a deck of cards. And so, we, when you do experiments, you test but verify. And when you're going to do a space launch, you have to do what we call shake and bake tests. So these are the tests where you put things, put your test articles like you're going to put them in the vehicle and you're going to put them on shaker tables and you're going to put them through the experience of what's going to happen when they go and they're launched, right? And so that kind of thrust and the shake and bake. And so in... We did that for the Mars lander batteries and one of my engineers was carrying that battery, which was shaped like a triangle, back to the lab after we did the tests, we thought quite successfully, and while he was doing that it exploded like a fire-breathing dragon. Fortunately, through the vent valve, which is what it's there for, And he, it was pointed away from him and nobody was hurt. Knock on wood, nobody was hurt. But we were like, what just happened, right? And so that forced us to go back and do a failure analysis. And I was not part of that team. It was others within the company who do that failure analysis. So you've got that objectivity of people working on other design lines to come in and look through the fabrication of the batteries. And what we found is that we had a manufacturing flaw in one of the presses that was cutting out the electrodes, right. And so what was happening is there was a sharp edge. And the sharp edges, when you build the battery, you test to see if they're short. And the sharp edges were being mitigatedin extra separator, which was creating a stack that was too big for where it was within the battery. Bottom line is design matters, safety matters, and paying attention to all the details really matter. And so we fixed the design, we fixed the batteries, we have repeated the shake and bake tests and everything became successful when you built in terms of the prints. But it's really making sure that you're crossing the Ts and dotting the Is and paying attention to the details. And for the spirit and opportunity, we knew that that was what's called a Class A must not fail mission. When you've got a Class A must not fail mission, you have to guarantee that it's gonna be successful. And so that battery was really over designed and the battery case for those are made out of titanium. And most of the titanium was on the floor of the mill of where they made it because it was a solid piece and not pieces that were put together because you're spending, you wanna ensure the integrity of the design. And so all of that translates into working on technology and taking risks, calculated risks, but understanding the risks that you're doing so that when you stand behind something and you say it's gonna work, you know it's gonna work. And so you've done those experiments, you have asked and answered those questions, and the unanticipated questions. I think that's what I learned most about that is we didn't ask all the right questions and we needed to be more rigorous about that. And so that again notched up the level of questions that I need to ask and to be make sure that I have answers to. And that was a learning experience for all of us actually. Dimitrios Donavos: I can only imagine what the process would be like to think through unanticipated questions on a planet that we haven't fully understood or explored. And so I can imagine that was quite a challenge. Catherine Marsh: Well, and imagine, you know, during part of the experiments where they were operating on the planets, minus 54 degrees. That's really cold, people. You know, and we see it right now, actually, very recently around here in the greater Washington, D.C. area. It was really cold last month. If you remember, we had snow for the first time that we've had in a while. And a lot of people who have electric cars were complaining because their batteries weren't charging up correctly and they didn't have the range that they typically have. Now, why is that? It's because it's cold outside. The environment matters. And so the batteries that were successful on the planet Mars have a very special electrolyte in them that the ones that are operating down here don't because it's it's a much colder planet and you have to worry about those details and we had to study and explore different kinds of electrolyte combinations to make that work in those very very cold environments. And so I think that was as I was talking to neighbors and friends during that period when they couldn't get the rate everybody's asking how come my batteries won't work? I was telling them that's not the way they were designed, right? So, yeah. Dimitrios Donavos: Well, I can speak to that because I own an electric vehicle and I also had difficulty in that time period. I didn't think, though, that the best way to approach that was to make sure my designers were thinking about Mars. I recall reading at the time that engineers and scientists working on that program had synchronized their lives around Martian time. Is that something that you did as well? Catherine Marsh: No, I didn't because, but I will say because once, once we delivered the batteries and they went across the country and they got integrated into the vehicles by the NASA teams we were we were separated from it for quite some time before they actually were doing the flight operations and I guess kind of just on a side note. I didn't get to go to the launch because I by that time, I was already working for the agency here, and I wasn't in the day-to-day operations. I would have loved to. I've never been to a launch, you know? Dimitrios Donavos: I can imagine though that you had a sense of pride watching the rovers do their thing for as long as they did, far exceeding expectations. Catherine Marsh: Absolutely. In fact, my daughter got me a piece of artwork that's actually the trek that they took across Mars. And so that's the planet of Mars and the trek that they were taken and it's a signed piece of art from the originator, which I hang proudly in my office at home. Dimitrios Donavos: You just referenced working for the agency, which segues perfectly into my next question, which is how did it happen that you ended up working for the government? What led you to that service? Catherine Marsh: so, during the development of Spirit and Opportunity, remember I mentioned it was a class A must not fail mission. And so NASA tapped into the Power Sources Center at the Central Intelligence Agency, which is a center of excellence in battery technology. And they have been, they're a small but mighty group of really expert technologists. And George Methlie was one of our technical reviewers and he said to me, you know, if you're ever interested in coming to work for the agency, let me know. And so at the end of what we were doing for the Rovers, I said, you know, I think that would be cool, you know, to be able to take this and to give back to the government. Remember, I started working my career at the Navy and now is in the private sector. And I said, I, I don't know. And so I applied to the agency and I was in process and then 9-11 happened. Right. The morning after 9-11 I got my call and to join the CIA. I wasn't going to say no. I couldn't have anyway. And everybody asked me, what are you going to do? And I said, I have no idea. It was a leap of faith to come to work for the agency and I have not one regret. I'm a mid-career hire who came and working at the agency on some of the hardest technical challenges I've ever been faced with. And I can't tell anybody what I do about them in detail. And yet it's really important work and it's really rewarding work that, you know, we may do a development of something that we only use once and never use again. That's really important stuff. And people, it's not something that we can talk about or something that we advertise because we don't want to let the world know that that's what we're able to do. Dimitrios Donavos: Nine eleven was obviously an inflection point for our country, and your history with joining government service is intertwined with IARPA's origin story. As our listeners may or may not know, IARPA was established in the wake of those terrorist attacks on September 11th, 2001. In response to the intelligence failures, both the 100 and 500-day plans issued by the Office of the Director of National Intelligence, called for the creation of IARPA. Can you walk us through the gaps that the 9-11 Commission identified in their report and why they felt they needed to create IARPA to address them? Catherine Marsh: The gaps that they identified, I don't feel confident to specifically address, I'll be honest with you, but what they did say is that they wanted the intelligence community to have what the Department of Defense had had for so long and that ability to understand unwarned access, to have technologies that people don't know that you've got, to give them that new set of tools and to not be stuck in yesterday's technology capabilities. And for leading up to 9/11, there had been a reduction across the government in the technology and where we were going. And a lot of the capabilities that we were using were quite old. And that's just a fact. And we hadn't hired in a long time. And so they did. The intelligence community went out and hired a lot of folks to make sure we understood what happened. And coming in as a scientist and a technologist, I was brought on to help develop next generation capabilities. And IARPA at that same time was stood up to bring to the IC that unwarned those new capabilities, that next generation technology, but not tied to just one mission. We're not... We were put at the office of the Director of National Intelligence because we're here to service the community. We're here to make sure we understand the challenges and gaps, not just at CIA or DIA or FBI or NSA, but across the community and say, what are the most important technical capabilities that we can bring to bear that give multiple agencies and new capability that they didn't have before, right. You know, when you're worried about... worried about doing communications securely, that impacts not just one agency, right? You can imagine how even police officers need to have secure communications, as well as FBI agents and spies and, you know, military officers in the fields. And so when you sit at the Office of the Director of National Intelligence, you're worried about all the agencies and where those gaps and capabilities are. And so we bring together scientists and engineers who, once we know and identify what those gaps are, are going to take those challenges and try to create next generation technology that addresses those challenges. We don't have requirements here. We have challenges. And so having a challenge is actually much more exciting kind of thing to do than to have a requirement. I'm not going out and buying a water bottle. I'm going out and saying I need some sort of a vessel that's going to contain some sort of a liquid. What can you do to do that for me? And so, and then how am I going to put that safely out in an environment that might have to go into space, or it might have to go into a desert, or it might have to go into, you know, frozen territory? How do you address that spectrum of challenges? And so with the startup of IARPA, we were brought on board to, no kidding, do that high risk, high payoff, next generation capability that is really well vetted. If you remember when I was talking to you earlier about the risks and the making sure we understand all the questions. A full 25% of IARPA's budget. So for every $4, one is spent on test and evaluation, goes to doing independent test and evaluation. So all that new technology that we're developing, we make sure that we test it in a wide variety of applications so that when we're transitioning it to our intelligence community partners, that we know that it's gonna work. the way it's supposed to work, and that if there's problems with it, that we have learned from it. And even for those technologies that don't work, we document those lessons learned so nobody else is making investments in technology that has failed. And that we pass that knowledge on too, because that's just as important, right? In the landscape ofpushing to capabilities, making sure people know what things we've looked at that didn't work. We don't want to hide that. We want to transmit that as well because it just means that in accordance with the Heilmeier Catechism, it's not ready for technology today, but that doesn't mean it will never be ready. End Part 1 of 1

00:00:00

Disbelief To Doubt Podcast

Episode 1 Part 1: Leap of Faith

Guest: Dr. Catherine Marsh

Dimitrios Donavos: IARPA sponsors research that tackles the intelligence community's most difficult challenges and pushes the boundaries of science. We start with ideas that often seem impossible and work to transform them from a state of disbelief to a state of just enough healthy skepticism or doubt that by bringing together the best and brightest minds, we can redefine what's possible. This podcast will explore the history and accomplishments of IARPA through the lens of some of its most impactful programs and the thought leaders behind them. This is IARPA, Disbelief to Doubt.

Dimitrios Donavos: In the premiere of the new podcast series from the Intelligence Advanced Research Projects activity, IARPA, we sit down with outgoing director Dr. Catherine Marsh to discuss IARPA's origin story and the world events that led to her joining government service and set her on a path to leading what the New York Times has heralded as one of the government's most creative agencies. Take a listen…

Dimitrios Donavos: Hello and welcome to IARPA Disbelief to Doubt. I’m your host, Dimitrios Donavos, and today we welcome Dr. Catherine Marsh, Director of IARPA.

Dimitrios Donavos: Dr. Marsh, thank you for joining us today and helping us kick off Disbelief to Doubt.

Catherine Marsh: I love it, just absolutely love it.

Dimitrios Donavos: We are speaking to you today in your role as the director of IARPA, but you have had a long and distinguished career prior to your tenure here, both in government and industry, including leading the team that put lithium-ion technology on NASA's Mars Exploration Rover's Spirit and Opportunity. You hold bachelor's and doctorate degrees from Brown University in inorganic and analytic chemistry and had to overcome a disadvantaged background and the challenges of being a woman in a traditionally male-dominated scientific field. Take us back to the beginning and walk us through what sparked your desire to pursue a career in science and how you ultimately ended up leading battery development for the Spirit and Opportunity Mars Rovers.

Catherine Marsh: Sure, thank you. Welcome the opportunity. It really, it started with landing on the moon. When I was a kid, right? I remember, I was, you know, in 1969, when we landed on the moon, I was there in the side room of our house with my mom and my dad and my brothers. And we watched Neil Armstrong walk on the moon. And-

That was a miracle to me as a little kid. And my parents were so excited as we were watching this. And yet it's like, how is it we did that, right? And it to me was just so magical that we could do something like that. And my dad was an engineer, and my mom actually was a scientist, but women weren't allowed to be scientists back in the 50s. And so, she became a schoolteacher.

And that's not a bad thing. But they always encouraged us to be curious and to ask questions. And that really was the start is back then. And then, you know, as I was growing up and my parents were both having to work to be able to make ends meet, I had to cook dinner, right. And so to learn how to cook, you have to figure out how things work in the kitchen right? And it's not always so obvious.

I burnt a lot of things, but I also learned to be a really good baker, and baking and chemistry go hand in hand. So when I went to school, I just had the good fortune of being really curious, which lent itself to studying the sciences, at least in the public schools that I went through. And when I was in high school, I really, really, really wanted to go to Brown University, and I said to everybody that that's where I'm going to go from the time I was 13 years old. And they had a seven-year medical program that I wanted to get into. And when I was 17, I applied to college, and I was accepted into the school, but not into the program I wanted to get into. And when I was studying in your freshman year, I was studying, you know, chemistry and bio and biology was this great big huge class and everybody was, you know, kind of backstabbing because they all wanted to get into medical school and I was just really thriving in chemistry and I decided that that's where I was going to pursue my education and when I finished college, I was the only woman in my graduating class in chemistry.

But that's okay, you just make it happen. And then it was in the early 80s and I said, there were really no jobs. And I ended up going to grad school and majoring in inorganic and analytical chemistry. So I actually studied, how do you make cold water bleaches work? And then you're like, how does that translate into batteries? It doesn't, okay. But rates of reactions are rates of reactions and how do you make things work with different kinds of catalysts and make them work well. And so I did some of that fundamental early work to make cold water bleaches work much more effectively.

And then when I finished, I had the good fortune of getting hired by the Naval Undersea Systems Command at the time in Newport, Rhode Island to work in the lab and to be a chemist in the lab. And I was somebody... took a chance on me as a curious young scientist and Jim Modin was his name and he was my mentor until he passed away a number of years ago and he just took me under his wing. I didn't know electrochemistry other than the class I had taken in college and I was taught how to think critically when I was in college and grad school and applying that to the problem that we had at the time, which is how do you make, quite frankly, torpedoes, work quietly at depths and at speeds that were necessary and doing that with next generation technology.

So I've always been in that field where we're exploring what comes next, what can you do and how do you get it there. And so that wasn't lithium-ion technology, but it certainly was the development of battery technology for a wide variety of naval applications. And the naval applications are some of the most challenging in the world because of the undersea environment and the excess corrosion that you have to worry about due to dissimilar metals and things like that. People forget how challenging an environment that's working in. So it makes you think about all the fringe cases, all those out of the box, not so traditional ways of having to do things.

And when I left the Navy and ultimately ended up working in the private sector at Yardney Technical Products, it was the early days of lithium-ion technology. And we were one of the successful developers of lithium-ion technology. And we were competitively selected by the Air Force to do some development of lithium-ion technology for some Air Force applications. And through that, our team at Yardney Technical Products grew some really great technical expertise that we were then ultimately selected to be part of the development team for the lithium-ion batteries for NASA's Spirit and Opportunity. So we had a number of other successful military and DOD applications that the technology was used on before we were a part of the team that got to do Spirit and Opportunity. So we were really fortunate.

Dimitrios Donavos: You mentioned that you were one of the only women to graduate with your degree at the time, at least in your program. How do you feel that challenged you moving forward as you sort of were exploring your career and thinking about where your next step would be, especially after graduate school?

Catherine Marsh: It's a, it's an interesting question. I'm not sure I, I understood it to be the disadvantage, a disadvantage because I had such great mentors and people who gave me opportunities and to, and helped me along the way. I never viewed it as I, I was a Singleton. I often went to conferences and I was the only one there.

But what it made me do was really be an expert, such that when I was part of the conversation, I wasn't doubted or I wasn't second guessed, but I had to be that much better. And I continue to challenge myself that way, is that if I don't know something, I'm going to explore and study and make sure that I understand those nuances and get smart on it so that when I am part of the conversation, I really am speaking from a technically strong position. And that's how I have continued to, I think, excel. And that way, I'm not getting undergoing any second guessing, because I really have got the answers to the questions that are being posed. I've never and maybe it's because I've had such great mentors, I would not undersell that at all. It's also made me a good mentor to many other people because I know the power of that to help them grow and develop as young professionals. You need somebody who you can brainstorm with and talk through and somebody who's encouraging you to take that next step.

When I worked for the Navy...we had this internal Navy program called IRIED, internal research and internal exploratory development, and my mentor wanted me to write proposals to that, and I was funded. And so the positive reward for what you're doing helps you continue to grow and build that confidence in my technical growth and technical development. I never said...I never said to myself, I can't do that because...

Dimitrios Donavos: You mentioned Jim Modin as a mentor, and I'm curious, did you have any female mentors that impacted your life professionally, personally, or if there are other mentors that you wanted to reference?

Catherine Marsh: I would say that over my career, Stephanie O'Sullivan, I met Stephanie the first day that I EOD'd, entered on duty with the CIA. She happened to be, not the first day, but the first day I was in Power Sources Center. She was in there meeting with George Methley and I got to meet the future Deputy Director of National Intelligence and the person who became the head of the Directorate of Science and Technology at the agency. And so I always, I had her to look up to as somebody who, wow, she had quite, she was, when I came on board to the agency, she was already very senior and only went up from there and it just so happens that the programs that I was working on and with were those that she had an interest in. And so I had the opportunity to actually brief her, well prepared to brief her. You never brief somebody if you're not really well prepared. I think that's important. On the technical progress of my programs over time and got really, really good feedback and interest in what we were doing. So I would say she's been one of the great mentees that I've had. Mentors, excuse me that I've had as a female in my career.

Dimitrios Donavos: Speaking of mentoring and challenges, the Mars Rover's exceeded their original 90-day mission life by nearly 15 years and are credited with major scientific discoveries, including evidence of past liquid water on Mars. Not many people can say their technology enabled exploration and scientific discovery on another planet. What was the most challenging thing you had to overcome to help enable that mission? And what did you learn about yourself in the process?

Catherine Marsh: So along the way, you know, nothing is ever a straight line, right? And while we were building, you know, you go through a series of experimental designs to get to the point where you are able to successfully deliver product. And while we were, prior to the missions for Spirit and Opportunity we were working on the Mars Lander mission that never went, right.

So the technology that was developed for that was resized to go, what we learned on that mission was the enabler to the Spirit and Opportunity. And when we were doing those batteries, it just so happens they're prismatic batteries, so they stack up like a deck of cards. And so, we, when you do experiments, you test but verify. And when you're going to do a space launch, you have to do what we call shake and bake tests. So these are the tests where you put things, put your test articles like you're going to put them in the vehicle and you're going to put them on shaker tables and you're going to put them through the experience of what's going to happen when they go and they're launched, right? And so that kind of thrust and the shake and bake. And so in...

We did that for the Mars lander batteries and one of my engineers was carrying that battery, which was shaped like a triangle, back to the lab after we did the tests, we thought quite successfully, and while he was doing that it exploded like a fire-breathing dragon. Fortunately, through the vent valve, which is what it's there for,

And he, it was pointed away from him and nobody was hurt. Knock on wood, nobody was hurt. But we were like, what just happened, right? And so that forced us to go back and do a failure analysis. And I was not part of that team. It was others within the company who do that failure analysis. So you've got that objectivity of people working on other design lines to come in and look through the fabrication of the batteries. And what we found is that we had a manufacturing flaw in one of the presses that was cutting out the electrodes, right. And so what was happening is there was a sharp edge. And the sharp edges, when you build the battery, you test to see if they're short.

And the sharp edges were being mitigatedin extra separator, which was creating a stack that was too big for where it was within the battery. Bottom line is design matters, safety matters, and paying attention to all the details really matter. And so we fixed the design, we fixed the batteries, we have repeated the shake and bake tests and everything became successful when you built in terms of the prints. But it's really making sure that you're crossing the Ts and dotting the Is and paying attention to the details. And for the spirit and opportunity, we knew that that was what's called a Class A must not fail mission. When you've got a Class A must not fail mission, you have to guarantee that it's gonna be successful.

And so that battery was really over designed and the battery case for those are made out of titanium. And most of the titanium was on the floor of the mill of where they made it because it was a solid piece and not pieces that were put together because you're spending, you wanna ensure the integrity of the design. And so all of that translates into working on technology and taking risks, calculated risks, but understanding the risks that you're doing so that when you stand behind something and you say it's gonna work, you know it's gonna work. And so you've done those experiments, you have asked and answered those questions, and the unanticipated questions. I think that's what I learned most about that is we didn't ask all the right questions and we needed to be more rigorous about that. And so that again notched up the level of questions that I need to ask and to be make sure that I have answers to. And that was a learning experience for all of us actually.

Dimitrios Donavos: I can only imagine what the process would be like to think through unanticipated questions on a planet that we haven't fully understood or explored. And so I can imagine that was quite a challenge.

Catherine Marsh: Well, and imagine, you know, during part of the experiments where they were operating on the planets, minus 54 degrees. That's really cold, people. You know, and we see it right now, actually, very recently around here in the greater Washington, D.C. area.

It was really cold last month. If you remember, we had snow for the first time that we've had in a while. And a lot of people who have electric cars were complaining because their batteries weren't charging up correctly and they didn't have the range that they typically have. Now, why is that? It's because it's cold outside. The environment matters. And so the batteries that were successful on the planet Mars have a very special electrolyte in them that the ones that are operating down here don't because it's it's a much colder planet and you have to worry about those details and we had to study and explore different kinds of electrolyte combinations to make that work in those very very cold environments. And so I think that was as I was talking to neighbors and friends during that period when they couldn't get the rate everybody's asking how come my batteries won't work? I was telling them that's not the way they were designed, right? So, yeah.

Dimitrios Donavos: Well, I can speak to that because I own an electric vehicle and I also had difficulty in that time period. I didn't think, though, that the best way to approach that was to make sure my designers were thinking about Mars. I recall reading at the time that engineers and scientists working on that program had synchronized their lives around Martian time. Is that something that you did as well?

Catherine Marsh: No, I didn't because, but I will say because once, once we delivered the batteries and they went across the country and they got integrated into the vehicles by the NASA teams we were we were separated from it for quite some time before they actually were doing the flight operations and I guess kind of just on a side note. I didn't get to go to the launch because I by that time, I was already working for the agency here, and I wasn't in the day-to-day operations. I would have loved to. I've never been to a launch, you know?

Dimitrios Donavos: I can imagine though that you had a sense of pride watching the rovers do their thing for as long as they did, far exceeding expectations.

Catherine Marsh: Absolutely. In fact, my daughter got me a piece of artwork that's actually the trek that they took across Mars. And so that's the planet of Mars and the trek that they were taken and it's a signed piece of art from the originator, which I hang proudly in my office at home.

Dimitrios Donavos: You just referenced working for the agency, which segues perfectly into my next question, which is how did it happen that you ended up working for the government? What led you to that service?

Catherine Marsh: so, during the development of Spirit and Opportunity, remember I mentioned it was a class A must not fail mission. And so NASA tapped into the Power Sources Center at the Central Intelligence Agency, which is a center of excellence in battery technology. And they have been, they're a small but mighty group of really expert technologists. And George Methlie was one of our technical reviewers and he said to me, you know, if you're ever interested in coming to work for the agency, let me know. And so at the end of what we were doing for the Rovers, I said, you know, I think that would be cool, you know, to be able to take this and to give back to the government. Remember, I started working my career at the Navy and now is in the private sector. And I said, I, I don't know.

And so I applied to the agency and I was in process and then 9-11 happened. Right. The morning after 9-11 I got my call and to join the CIA. I wasn't going to say no. I couldn't have anyway. And everybody asked me, what are you going to do? And I said, I have no idea. It was a leap of faith to come to work for the agency and I have not one regret.

I'm a mid-career hire who came and working at the agency on some of the hardest technical challenges I've ever been faced with. And I can't tell anybody what I do about them in detail. And yet it's really important work and it's really rewarding work that, you know, we may do a development of something that we only use once and never use again. That's really important stuff.

And people, it's not something that we can talk about or something that we advertise because we don't want to let the world know that that's what we're able to do.

Dimitrios Donavos: Nine eleven was obviously an inflection point for our country, and your history with joining government service is intertwined with IARPA's origin story. As our listeners may or may not know, IARPA was established in the wake of those terrorist attacks on September 11th, 2001. In response to the intelligence failures, both the 100 and 500-day plans issued by the Office of the Director of National Intelligence, called for the creation of IARPA. Can you walk us through the gaps that the 9-11 Commission identified in their report and why they felt they needed to create IARPA to address them?

Catherine Marsh: The gaps that they identified, I don't feel confident to specifically address, I'll be honest with you, but what they did say is that they wanted the intelligence community to have what the Department of Defense had had for so long and that ability to understand unwarned access, to have technologies that people don't know that you've got, to give them that new set of tools and to not be stuck in yesterday's technology capabilities. And for leading up to 9/11, there had been a reduction across the government in the technology and where we were going. And a lot of the capabilities that we were using were quite old. And that's just a fact. And we hadn't hired in a long time. And so they did. The intelligence community went out and hired a lot of folks to make sure we understood what happened. And coming in as a scientist and a technologist, I was brought on to help develop next generation capabilities. And IARPA at that same time was stood up to bring to the IC that unwarned those new capabilities, that next generation technology, but not tied to just one mission. We're not...

We were put at the office of the Director of National Intelligence because we're here to service the community. We're here to make sure we understand the challenges and gaps, not just at CIA or DIA or FBI or NSA, but across the community and say, what are the most important technical capabilities that we can bring to bear that give multiple agencies and new capability that they didn't have before, right. You know, when you're worried about... worried about doing communications securely, that impacts not just one agency, right? You can imagine how even police officers need to have secure communications, as well as FBI agents and spies and, you know, military officers in the fields. And so when you sit at the Office of the Director of National Intelligence, you're worried about all the agencies and where those gaps and capabilities are. And so we bring together scientists and engineers who, once we know and identify what those gaps are, are going to take those challenges and try to create next generation technology that addresses those challenges. We don't have requirements here.

We have challenges. And so having a challenge is actually much more exciting kind of thing to do than to have a requirement. I'm not going out and buying a water bottle. I'm going out and saying I need some sort of a vessel that's going to contain some sort of a liquid. What can you do to do that for me? And so, and then how am I going to put that safely out in an environment that might have to go into space, or it might have to go into a desert, or it might have to go into, you know, frozen territory?

How do you address that spectrum of challenges? And so with the startup of IARPA, we were brought on board to, no kidding, do that high risk, high payoff, next generation capability that is really well vetted. If you remember when I was talking to you earlier about the risks and the making sure we understand all the questions.

A full 25% of IARPA's budget. So for every $4, one is spent on test and evaluation, goes to doing independent test and evaluation. So all that new technology that we're developing, we make sure that we test it in a wide variety of applications so that when we're transitioning it to our intelligence community partners, that we know that it's gonna work.

the way it's supposed to work, and that if there's problems with it, that we have learned from it. And even for those technologies that don't work, we document those lessons learned so nobody else is making investments in technology that has failed. And that we pass that knowledge on too, because that's just as important, right? In the landscape ofpushing to capabilities, making sure people know what things we've looked at that didn't work. We don't want to hide that. We want to transmit that as well because it just means that in accordance with the Heilmeier Catechism, it's not ready for technology today, but that doesn't mean it will never be ready.

End Part 1 of 1

M. C. Smart et al., "Performance characteristics of Yardney lithium-ion cells for the Mars 2001 Lander application," Collection of Technical Papers. 35th Intersociety Energy Conversion Engineering Conference and Exhibit (IECEC) (Cat. No.00CH37022), Las Vegas, NV, USA, 2000, pp. 629-637 vol.1, doi: 10.1109/IECEC.2000.870847

R. Gitzendanner, T. Kelly, C. Marsh, and P. Russell, "Prismatic 20 Ampere Hour Lithium-ion Batteries for Aerospace Applications," SAE Technical Paper 981249, 1998, doi: 10.4271/981249.

J. C. Flynn and C. Marsh, "Development and experimental results of continuous coating technology for lithium-ion electrodes," Thirteenth Annual Battery Conference on Applications and Advances. Proceedings of the Conference, Long Beach, CA, USA, 1998, pp. 81-84, doi: 10.1109/BCAA.1998.653845

J. C. Flynn and C. Marsh, "Development of continuous coating technology for lithium-ion electrodes," IECEC-97 Proceedings of the Thirty-Second Intersociety Energy Conversion Engineering Conference (Cat. No.97CH6203), Honolulu, HI, USA, 1997, pp. 46-51 vol.1, doi: 10.1109/IECEC.1997.659157.

Mars Spirit and Opportunity

ODNI 100/500 Day Plans

IARPA Quantum Programs (ELQ, CSQ QCS, MQCO LogiQ, QEO)

IARPA Facial Recognition (Janus, BRIAR)

IARPA HLT (HIATUS, BENGAL, Babel, MATERIAL, BETTER)

IARPA Programs Quantum Supremacy

IARPA Funded Research Nobel Prize 2012

In Part 2 of our premiere episode of the Intelligence Advanced Research Projects Activity's (IARPA) new podcast series, we continue our conversation with former Director Catherine Marsh to discuss IARPA's process for funding high-risk/high reward research, what differentiates IARPA's mission from that of DARPA's, how Program Managers are empowered to make a dent in the universe, and much more.

Timestamp	Caption
00:00:00	Disbelief To Doubt Podcast Episode 1 Part 2: Force Multipliers Guest: Dr. Catherine Marsh Dimitrios Donavos IARPA sponsors research that tackles the intelligence community's most difficult challenges and pushes the boundaries of science. We start with ideas that often seem impossible and work to transform them from a state of disbelief to a state of just enough healthy skepticism or doubt that by bringing together the best and brightest minds, we can redefine what's possible. This podcast will explore the history and accomplishments of IARPA through the lens of some of its most impactful programs and the thought leaders behind them. This is IARPA, Disbelief to Doubt. Welcome back to IARPA Disbelief to Doubt. In part two of our two -part series speaking with outgoing director Catherine Marsh, we discuss IARPA's process for funding high -risk, high -reward research, what differentiates IARPA's mission from that of DARPA, how program managers are empowered to make a dent in the universe, and much more. Take a listen. Dimitrios Donavos IARPA often gets compared to DARPA which for our listeners who may not know, was established in 1958 to avoid technological surprise in response to the Russian launch of Sputnik, the first artificial earth satellite. You've already touched on this, but can you describe how IARPA's mission is similar but also different from DARPA's? Catherine Marsh So, DARPA is targeted at defense. And so, they are really going after the warfighter and enabling the warfighter with tools and capabilities. Whereas our mission is the intelligence community. And the intelligence community, for those of you who don't know, is very tiny compared to the Department of Defense. We're a lot of different missions, okay, but we're really a very small part of the overall community. And we have a very separate mission, complementary to some parts of the Department of Defense, okay, but... Catherine Marsh many parts the Department of Defense has no part of. So they're war fighters. We're hoping to prevent you from ever having to go to the war, right? So in the intelligence community, we actually all have only one mission, and that is to put actionable intelligence on policymakers' desks. And so when we're doing that, we are hopefully making it such that we prevent that next 9 -11 from happening. We prevent that next war from happening. We prevent those threats from coming into us and we can be preemptive of that. And so, most of what we do is behind the scenes and it's not published. If we're published, that's not usually a good thing for the intelligence community. It doesn't mean we don't have great things to talk about. We could talk about all of our technology in many ways. Certainly at IARPA, we have a very outward mission, outward facing mission, and we can do that. But Department of Defense has got a much bigger mission, and they are also a much larger organization that takes their technology to a much higher level of technology readiness than what we can do at IARPA. At IARPA, we stay at a technology readiness level that is around TRL level four, possibly five. That is, we have taken disbelief to doubt. We have proven with prototype capability. And then we transition into our IC partners who are going to take it the rest of the way into those often-classified use cases and scenarios that keeps it behind closed doors as to how that's ultimately, that technology is ultimately going to be used and deployed. Whereas at DARPA, they're going to take it all the way up to and make those first-generation capabilities. And then they could actually almost go to print, not completely, but so they have a larger... Catherine Marsh capability to do that, and they're serving a much larger part of the threat scenario, the services, if you will. Dimitrios Donavos So, the mission requires IARPA to constantly be looking forward, and that requires developing and executing research that pushes the bounds of science. That means we have to accept a significant risk of failure. Can you talk to us about what makes the problems that IARPA takes on hard and describe how IARPA minimizes risk and approaches failure? Catherine Marsh So, in the intelligence community writ large, we have to knowingly take on risk. I mean, if we're not taking on risk, we're not doing our mission. And in high-risk high-payoff research, what we do is we, as I mentioned, we go out and we do challenges in the sense of we go out with a research challenge in our in the use of the broad agency announcements. So, we try to do full and open competition to the maximum extent possible. And so, when we go out with the problem set, we are not going out with an idea that we're going to do X. We're going out with what are the greatest ideas to achieve a next generation antenna. If we want to be 10 times greater than the Chu limit, or if we want 50 % more energy density in next generation battery technology, how are we going to get there? We're not going out with a preconceived idea. That's the challenge. Come and give us your great proposals against that. And the way we minimize the risk is twofold. First, we all have metrics. Everything has to have a metric. A metric is the data that we are looking for that says, this is not an emotional decision. This is, I need energy density that's going to achieve X watt hours per kilogram or watt hours per liter. And if I can't meet X, then guys, that technical approach isn't going to work. And so with those metrics, we evaluate the technical ideas and we always fund Catherine Marsh more than one technical idea against that problem that we're going to try to solve. And every six months, sometimes a year, we measure the progress against those metrics by those independent tested evaluation labs, as well as the performers. You can submit your own results, of course, but we do that independent testing. And we will continue with those various technical approaches that are meeting those metrics. But if they're not meeting those metrics, we terminate that technical approach. And so we buy down risk by looking at those various technical approaches that give us the highest probability of success in that area. One of the things that we have been doing for the past several years is because the pace of technology evolution is so fast, if we have multiple technical approaches that are continuing to meet the metrics, we're continuing all of them through the end of the program. The reason to do that is that then we can transition multiple capabilities to our partners across the IC, and then they have options for what they can do because unfortunately, many places in the world, they don't like us in the US. And if they find... our tradecraft or they find a capability that we have, the bad guys share it with one another. And so, if we've got multiple solutions and we find one, they haven't found those other ones that still have the capabilities. So we're able to fill the queue up with solutions, hopefully, not always. Sometimes we really do down select to just one. And quite honestly, sometimes the programs fail completely. You know, one of the recent programs that we were doing, MIST, which was a really innovative way of thinking about storage of information because the intelligence community collects so much information that how do you store it without, you know, billions of acres of computers is if we could use DNA to store information, think about that. Catherine Marsh how tiny we could make that and how we could do very interesting next generation communications. But the reality is, even though we tried, at the end of 42 months, which should have been 12, nobody met the metrics. And they were way far off. And when we looked across the landscape, and we will go back to Heilmeier III, what's changed or why do you think you can be successful at this time? The technology isn't there yet and the landscape hasn't changed enough. It's something we'll continue to stay smart about. And so by taking different technical approaches, you are still taking on risk. Absolutely. But you're buying down that risk with a variety of potential approaches. Dimitrios Donavos Dr. Marsh, as you know, science is dealing with the reproducibility crisis right now. And one of the things that really differentiates IARPA's approach is this requirement for transparency that happens through this independent test and evaluation process. You've touched on this, but I just want to make sure that we reiterate and foot stomp. Test and evaluation takes up a significant portion of a program budget. Talk about the scale of that relative to the size of the budget for a program. Catherine Marsh So 25%. So for of our budget is independent T &E. And we do that, you know, it's rare that we'll just have one test and evaluation partner on a program. We often have two or three because we want to make sure that we can test all the different, one, technical areas, but also with, no kidding, this nation's experts in that field, right? And so we're using the national labs, we're using the federally funded research and development corporations. We're using the government laboratories that have that very specialized technical expertise. And we're using the university affiliated research centers to do that testing on our behalf. And they help set up the testing. They have the experts in the field. And they're the ones who give us the hard truth about what the results really are. Catherine Marsh They also then allow us to be part of the testing if we want to, to monitor, sit in, watch, so that the program managers are often intimately involved with the independent testing evaluation to see what the results are that are coming off near real time, because that program manager is a technical expert in the field. For example, next week we're going to be doing some testing on the the SCISRS program, which is looking at RF emanations, and the people who are the program managers are experts in that area. And so they're going to want to see what it is the testing is telling us about those emanations and what that might mean for the use cases and things that we have to worry about. Dimitrios Donavos Science and the scientific community doesn't always incentivize publishing results where we have failure. And so, we oftentimes sort of sweep it under the rug, but it can be extremely informative because there are lessons learned. What are some lessons learned from a failure you experienced in your career? Catherine Marsh When things don't work the way that you want them to, and we all have lots of things that don't work the way we want to, it's kind of go back to the drawing board. What did I, not from a blame perspective. What question didn't I ask up front that I should have asked, right? What are these results telling me? And so I was working on the development of a new battery technology. It happened to have been a battery called, it was a lithium seawater battery. So, imagine taking lithium, which reacts with water, okay, put lithium water, it catches on fire. And I'm here, I'm trying to make a battery out of it, right? And so, we had all these different, because you think out of the box and you're trying to do something different, we had all these different polymer technical approaches that we were looking at. And, you know, none of them worked, right? And so, I'm like, why didn't they work? Right? Because if you think about polymer, and you think about ladies pantyhose, you know, they stretch and they compress. Catherine Marsh But there's little holes in them. And so, we could never make it, if you want to make a battery work, you've got to have electrolyte transfer. We could never make that situation work because we always had a pore that was open and so there was always a corrosion reaction going on. And the corrosion reaction was more dominant than the electrochemical reaction. So, we did get electrochemical reactions that worked. But ultimately in the development of that systems, those systems, we hit a wall. And when we hit the wall, we're like, why did we hit this wall? And we had this aha moment of the polymers were never made to be able to do that. And so, at the same time, we were, you know, I like to stay technically sharp and we were working on monitoring progress on other approaches for new separators, if you will, for batteries and there was this one that was a conductive glass that was being developed by a small company out in California. And I said, you know what, why don't we see if we can make this work? And sure enough, we, for a very small amount of money, we funded this company and if they could, they made it work, right? And so instead of a lithium seawater battery that was based on a polymer technology, we ended up working on technology that was a conductive class, that we made it meet the metrics that we were going after to continue. And so, I guess part of it is, I don't like to give up, right? So never give up is behind some of that, but it was based on learning and people publishing. And when you hit that wall, not saying, not burying those results and... because most of that work was on a classified effort, you know, they're not published out in open literature, although all of those people who were investigators did publish the work that they were doing, but not for our particular applications, but internally at the agency, we documented all of that in the appropriate way so that the customer for that work ultimately Catherine Marsh had those results and had that knowledge base so that they didn't continue to invest incorrectly in something that wasn't going to yield the kinds of results that they need. Dimitrios Donavos You brought up an interesting point about publishing in the open research community. The majority of the work that IARPA funds is actually published in the open research community and our work is for the most part unclassified. But that brings up a very important question. How do we protect the outcomes of our research from ending up in the hands of our adversaries? Catherine Marsh Great question. One of the most important things we do for the development of our technology is the use of our research and technology protection protocols. That is a methodology that was developed at IARPA right at the very beginning. And that is a, it seems simplistic, but it's not. When you work in the classified world, we have a tendency to over classify. And so,how do we prove to our IC customers before we go out and we do this outward facing research that we're taking their problems seriously? And so, we developed this methodology that says, we're going to ask this series of questions of what are you trying to do? Why do you need to protect it? Who do you need to protect it from? Why do you need to protect it from them? So that we could define crisp lines in the road where a program goes from unclassified to for official use only, to secret, to top secret, to compartmented information. And we review that the security profile or protocol for every program every six months to make sure that the landscape hasn't changed and that we are paying attention to the changes that may have an impact on our programs. The perfect example of how the landscape has changed is in quantum computing. Fifteen years ago, everybody was very concerned appropriately about qubits. And so, the classification and the protocols and the technologies that we're evaluating are very much focused on qubit methodologies. And yet, over time, Catherine Marsh in the recent past, photons and photonics have now emerged as a change to that landscape that now we need to pay attention to and we weren't paying attention to it because we didn't think that was a threat then. And so, if you're not doing this constant review of the landscape of what's happening, you can miss something like that and then you could have that unworn surprise again. And so that's why the use of our research and technology protection protocols, which we gladly share across the community and to the public sector who needs to know about it, to help educate researchers who aren't inclined to think that way, why you might want to add some protection in there and why you might want to think about where this technology is ultimately going to be used if you happen to be doing something that may be a use case of the intelligence community or the Department of Defense because they too have to protect how technology is going to be. Dimitrios Donavos I want to move on to discuss the engines of innovation at IARPA and that is the program managers. And we talk about program managers at IARPA as being force multipliers for any future program managers who might be listening, can you unpack what that phrase means to you and describe how the role of PM empowers them to transform not only science, but potentially national security and society? Catherine Marsh I gotta say, if I were a younger person at a different point in my career, I would love to be an IARPA or DARPA program manager, okay? Because it is that opportunity to come in with that great idea, okay? Because program managers have to have a great idea that they're really passionate about that's going to change the way things are done in the community and come in with that great idea, pitch it, get it across the goal line. And if they do that, then they're gonna have an opportunity to come in and run that program and to be that guiding light Catherine Marsh of that next generation capability. You know, if you think about some of our programs, you know, we're working on the development of our program called SMART ePANTS, right? And SMART ePANTS is developing next generation clothing capability. Why would you need that? Well, we go places where we might want to see things, hear things, and geolocate where they are. And... We don't always think about all the dual use cases of it. When we were talking about, because we do things very publicly on our programs, when we were talking about that program, we actually had a parent of a child with learning disabilities contact us and share with us how critically important such a development would be for their child. Because... Their child would then be always protected from those cases where they're in a situation where they don't know and they may be in the harm's way of somebody. We were so touched by that use case of not even being on our radar that somebody would share with us. And so that was something that gave me goosebumps when I heard about it. And, you know the next generation battery technology, if we're able to increase the energy density of the materials, the fundamental materials that we're doing for the intelligence community, that carries over to how much range you're going to get in your electric vehicle. It carries over into the electric grid. It carries it over into, you know, one of our upcoming programs is going to be on solar panels. And so, there's dual use capabilities that if we didn't have these specialized cases in the intelligence community that make it so worth our while to make that investment, and we're not moving the needle with small programs, this is, I can't talk about the specifics of our budget. Catherine Marsh But this is investment that moves the needle substantially on the technology. And then that dual use capability means that the greater public sector benefits as a result of it. Dimitrios Donavos You touched on a point I was about to make that PMs come to IARPA really to make a dent in the universe. And it's that ability to work on these very challenging problems and moving the needle. And that leads into my next question. Part of IARPA's approach to solving difficult problems is building multidisciplinary communities that often didn't exist before. IARPA has a history of launching programs that have lasting impact, not just from the perspective of improving national security capabilities, but in terms of advancing science in areas from quantum computing, which you touched on, to human language technology, to even super forecasting. How have IARPA programs moved the needle in the open scientific community in ways our listeners might be surprised to learn about? Catherine Marsh Wow, what a great question. There's thousands and thousands of publications attributable to IARPA research across the world and many more thousands who reference our work in their work to go forward. But we also have Nobel Prize winners as a result of the quantum research that has its foundations here. We have Bell Prize winners. We are the foundations for next generation facial recognition capability. When you go onto Google and they're asking you these questions about what's making, you know, recognize all the motorcycles in these things, all of that traces back to technology developed at IARPA for a totally different application that then gets used in the private sector. And you know, all of this diversity is a result of the fact that all of us, me included, we're only here for three to five years. We don't have a lifetime to make a difference. We've got to come in with that idea, that passion, and that drive to make it happen and make it happen now. We can't afford to... Catherine Marsh drag things out and only do incremental advances, if you don't have something that's gonna be game changing, you're not gonna get across the line. And we've gotta take that risk. And there's others that will continue with that. But when you only have three to five years to get something done, you're off and you're running from day one. And if you're passionate about it, you're spending five of the busiest years of your life doing this while you are eating, drinking, sleeping, and thinking about it. And you are generally not just doing one program, but you're doing two or three programs over the life of your time here at IARPA. And when you think about that human language translation, everybody says, I've got Google Translate. Well, yeah, that's okay if you're going to France, okay? But I just want to let you know that the intelligence community were not worried about going to France, okay, or Germany or Italy, all those wonderful places that are in this world, were really worried about going to those places where the bad guys are, where we don't understand Pashto or, you know, Tagali or some of the other low-resource languages. We have to have and enable those kinds of tools for our partners and to be able to do that, to understand the analysis, to be able to understand the threat landscape and all of that. And we didn't have those tools until we had someplace like IARPA that created that and have really made significant changes that have made wonderful impacts for our partners in the community. Dimitrios Donavos So you referenced term limits and your term is coming up soon. Thinking back to the first time you actually were at IARPA in your role as deputy director from 2013 to 2015, how would you say IARPA has evolved as an organization since that time and how have you evolved as a leader? Catherine Marsh Good question. When I was here before, it was the end of our...coming to the end of the first generation of technologies that we had invested in. And some of those were extremely well received, absolutely, particularly our human language translation tools and capabilities. But yet others that where we had made really what we thought were significant advances, they actually ended up getting put on the shelf. And I was part of...a very interesting conversation with one of our IC partners where we went down and we did a demonstration for them and they said, wow, that's really cool technology, but you know, we can't use it because if we really need to do what this technology has the ability to do, we've got to go in and worry about chain of custody and other things that are relative and important. And I was in that meeting and that was an aha for me in saying that we were not close enough in our early days to our IC partners to really understand and get the buy-in before we even started a program to what we needed to be to make sure that our technology was really going to be carried across the line and not be put on the shelf. And so, one of the big changes that we've made since then across that is the involvement of our IC partners right from the beginning of program inception. In fact, on my watch, if you don't have IC partners sitting at the table at your new start pitch, okay, who say, yay Verily, we really want this, this is really important to us, and hopefully you've got more than one IC partner but at least one IC partner, then your program's gonna get a thumbs down because we can't afford to do things that are gonna be put on the shelf. And yes, some things are next generation, but even that program that I was telling you about, MIST, that was a failure, that didn't, wasn't successful, we had IC partners who were right there saying, if you can make this work, this is really a game changer for us. Catherine Marsh And so it was a smart investment because we knew if we could do it that we had somebody who was going to pick it up. I think that's the biggest success story in the huge changes that we've made because they become part of our government advisory panels that work throughout the programs and then pull through the technologies at the end. And I would say that that has enabled the success rate of close to 75 % of our programs have some level of transition to our IC partners. Even if it's a program that fails, if we've done data collection, labeling, data labeling, then, and we're able to transition those data sets, at least that is something that saves another IC partner funding and they can use it on their applications. So, we look across that for many incremental ways of being able to transition not only the end product but things along the way. So we've got that buy-in and that familiarization to help get over the not invented here syndrome which we all suffer from. Well, I don't know anything about that and so now I've got to relearn how to do all this. If they've been working alongside you from the beginning and watching the progress and even coming to our test and evaluation events and being part of that, we've got much better pull through at the end. And I think that's the biggest evolution and the success that has enabled with that. Dimitrios Donavos I mean, it's natural, I think, for people to feel skeptical. And part of that process is enabling people to feel like they're part of that development and they have skin in the game. And so I think that has been a really incredibly important development at IARPA. And in my tenure here, I have witnessed that happen. As you reflect back on your term, and as we think about the speed with which innovation is accelerating, the intelligence community will likely face a landscape of technological challenges that will look different from the challenges of just a few years ago. Dimitrios Donavos Looking over the horizon, what advice would you offer your successor for leading IARPA through its next chapter? Catherine Marsh Make sure you understand where our partners are now and where they really see those gaps in capabilities that are causing them to stay up at night. Right? What can't they do? You know, where do they really see those big, big threats and why? Making sure that we are doing that. And I would say that while we have on many programs and more today than we had in the past, doing tested evaluation that mimics, and it's classified so we don't tell the details of what we're doing outside, but making sure we're doing the test and evaluation that carries the most credibility for our partners that helps them with that pull through. So, understand the gaps, make sure you've got the tie in, looking down at what's that big threat coming at us? Can we make computers so smart that we just heard a talk this morning where somebody said we're going to make our computers so smart that we won't need to educate people with PhDs. And I said to the program manager, I don't think that's such a great idea, you know? But, you know, what is that threat of the artificial intelligence and machine learning and, you know, the chat GPTs and beyond that have bringing tools and capabilities the IC cannot put its head in the sand. How do we enable those next generation capabilities to be on the high side and to be safe on the high side and to understand the threats that that impose and then to knowingly take on the risks because we've done the hard work at IRPA in a safe way that enables those capabilities to be more readily adopted. And it's not an easy... Catherine Marsh road to hoe because you're always going after gaps and not everybody wants to tell you about them but part of my warm transition with my successor is going to be to make sure that he knows all of the correct people in the different agencies and can readily get access to that information and stay current on that because where do they see the threat coming on board? Even something as ubiquitous as climate change has a threat to the intelligence community. Even though that's climate change in the intelligence community, we are constantly monitoring that and being smart about it. And I think that and hiring great people who really are passionate that... that makes all the difference. And the program managers are the best part of the day, right? When you get to spend 20 minutes, somebody pops into your office just to share what, hey, this great result. Hey, let me show you this cool thing. That's what keeps me going, right? You know, all the headaches of things that we have to deal with them as we have to. But the next generation technology, when they're bringing that to you and they're showing it to you, is just, that's the really exciting part that will keep you enthusiastic and knowing that you're doing the right thing and that nobody else is. Dimitrios Donavos I can completely relate to that feeling having been at IARPA for nearly a decade. I can say that one of my favorite times is when we have the program management reviews and for our listeners, each program every six months goes through a review cycle where leadership will hear the newest developments on the program. And that's when we get to hear all of the exciting technologies and capabilities that are being developed. As we sort of wrap up here, Dr. Marsh, I want to ask you one final question. And that is, what is one thing you can share with our audience that people might be surprised to know about you? Catherine Marsh I guess my grandparents came through Ellis Island. So we are first generation. My mother is first generation. Both of my parents who grew up in the 50s, they went to college. My dad was a sailor. He was a Korean conflict vet. He died at 66 years old. So, the closer I get to that age, the more blessed I am that I have good health. And, you know, I look at that. I would say that I, looking back on life, I have been blessed with all the things that I've had the opportunity to do that I never knew that I would get to do. Right? I didn't plan a path, you know, I come from the wrong side of the tracks. I didn't grow up wealthy. I mean, to get to go to an Ivy League school when, when we were on food stamps when I was in junior high is a blessing, right? And then to be able to look back at all that I've accomplished, because when you're 21, 22, and you're like, life's ahead of you, you have this blank slate, and everybody wants to have a plan. And I never really had a plan. I let the passion for what I was doing lead me, and it didn't, didn't take me down the wrong track. And I had somebody who once said to me, if you love what you're doing, you're never going to work a day in your life. And I never feel like I've worked a day in my life. And I've also never forgotten to say thank you. Thank you to, I didn't get here on my own. Everybody who I work with, I say thank you to all the time. They have helped me be successful and I hope that I have helped them in some way. And I say this all the time and I'm known for it, but our assets go home at night. We've got to take care of your people. They're the most important part of what we do and all the technology that we're developed and that we continue to develop is as a result of the great people. And so we've got to make the investments in making sure. Catherine Marsh that they have the things they need to do the job the way they want to do it and make sure that they're empowered to do it. And I have had people help with that along my career. And I hope that I'm giving that back to others as they can be successful along their paths in their lives. Dimitrios Donavos Dr. Marsh, that was a very powerful and compelling answer to a question I'm sure you did not have a plan for when I asked you. Well, I just want to close with a more formal thank you. Thank you for joining us today. Thank you for a compelling and insightful interview, and we appreciate your time very much. Catherine Marsh I really enjoyed this, and I'm so thankful that you're going to do Disbelief to Doubt because that truly is what we're about in changing the landscape of what we can do for our nation. Dimitrios Donavos Thank you for joining us. For more information about IARPA and this podcast series, visit us at I-A-R-P-A.gov. You can also join the conversation by following us on LinkedIn and on Twitter at IARPA News. End Part 2 of 2

00:00:00

Disbelief To Doubt Podcast

Episode 1 Part 2: Force Multipliers

Guest: Dr. Catherine Marsh

Dimitrios Donavos

IARPA sponsors research that tackles the intelligence community's most difficult challenges and pushes the boundaries of science. We start with ideas that often seem impossible and work to transform them from a state of disbelief to a state of just enough healthy skepticism or doubt that by bringing together the best and brightest minds, we can redefine what's possible. This podcast will explore the history and accomplishments of IARPA through the lens of some of its most impactful programs and the thought leaders behind them. This is IARPA, Disbelief to Doubt.

Welcome back to IARPA Disbelief to Doubt. In part two of our two -part series speaking with outgoing director Catherine Marsh, we discuss IARPA's process for funding high -risk, high -reward research, what differentiates IARPA's mission from that of DARPA, how program managers are empowered to make a dent in the universe, and much more. Take a listen.

Dimitrios Donavos

IARPA often gets compared to DARPA which for our listeners who may not know, was established in 1958 to avoid technological surprise in response to the Russian launch of Sputnik, the first artificial earth satellite. You've already touched on this, but can you describe how IARPA's mission is similar but also different from DARPA's?

Catherine Marsh

So, DARPA is targeted at defense. And so, they are really going after the warfighter and enabling the warfighter with tools and capabilities. Whereas our mission is the intelligence community. And the intelligence community, for those of you who don't know, is very tiny compared to the Department of Defense. We're a lot of different missions, okay, but we're really a very small part of the overall community. And we have a very separate mission, complementary to some parts of the Department of Defense, okay, but...

Catherine Marsh

many parts the Department of Defense has no part of. So they're war fighters. We're hoping to prevent you from ever having to go to the war, right? So in the intelligence community, we actually all have only one mission, and that is to put actionable intelligence on policymakers' desks. And so when we're doing that, we are hopefully making it such that we prevent that next 9 -11 from happening. We prevent that next war from happening. We prevent those threats from coming into us and we can be preemptive of that. And so, most of what we do is behind the scenes and it's not published. If we're published, that's not usually a good thing for the intelligence community.

It doesn't mean we don't have great things to talk about. We could talk about all of our technology in many ways. Certainly at IARPA, we have a very outward mission, outward facing mission, and we can do that. But Department of Defense has got a much bigger mission, and they are also a much larger organization that takes their technology to a much higher level of technology readiness than what we can do at IARPA.

At IARPA, we stay at a technology readiness level that is around TRL level four, possibly five. That is, we have taken disbelief to doubt. We have proven with prototype capability. And then we transition into our IC partners who are going to take it the rest of the way into those often-classified use cases and scenarios that keeps it behind closed doors as to how that's ultimately, that technology is ultimately going to be used and deployed. Whereas at DARPA, they're going to take it all the way up to and make those first-generation capabilities. And then they could actually almost go to print, not completely, but so they have a larger...

Catherine Marsh

capability to do that, and they're serving a much larger part of the threat scenario, the services, if you will.

Dimitrios Donavos

So, the mission requires IARPA to constantly be looking forward, and that requires developing and executing research that pushes the bounds of science. That means we have to accept a significant risk of failure. Can you talk to us about what makes the problems that IARPA takes on hard and describe how IARPA minimizes risk and approaches failure?

Catherine Marsh

So, in the intelligence community writ large, we have to knowingly take on risk. I mean, if we're not taking on risk, we're not doing our mission. And in high-risk high-payoff research, what we do is we, as I mentioned, we go out and we do challenges in the sense of we go out with a research challenge in our in the use of the broad agency announcements. So, we try to do full and open competition to the maximum extent possible. And so, when we go out with the problem set, we are not going out with an idea that we're going to do X. We're going out with what are the greatest ideas to achieve a next generation antenna.

If we want to be 10 times greater than the Chu limit, or if we want 50 % more energy density in next generation battery technology, how are we going to get there? We're not going out with a preconceived idea. That's the challenge. Come and give us your great proposals against that. And the way we minimize the risk is twofold. First, we all have metrics. Everything has to have a metric.

A metric is the data that we are looking for that says, this is not an emotional decision. This is, I need energy density that's going to achieve X watt hours per kilogram or watt hours per liter. And if I can't meet X, then guys, that technical approach isn't going to work. And so with those metrics, we evaluate the technical ideas and we always fund

Catherine Marsh

more than one technical idea against that problem that we're going to try to solve. And every six months, sometimes a year, we measure the progress against those metrics by those independent tested evaluation labs, as well as the performers. You can submit your own results, of course, but we do that independent testing. And we will continue with those various technical approaches that are meeting those metrics.

But if they're not meeting those metrics, we terminate that technical approach. And so we buy down risk by looking at those various technical approaches that give us the highest probability of success in that area. One of the things that we have been doing for the past several years is because the pace of technology evolution is so fast, if we have multiple technical approaches that are continuing to meet the metrics, we're continuing all of them through the end of the program. The reason to do that is that then we can transition multiple capabilities to our partners across the IC, and then they have options for what they can do because unfortunately, many places in the world, they don't like us in the US. And if they find...

our tradecraft or they find a capability that we have, the bad guys share it with one another. And so, if we've got multiple solutions and we find one, they haven't found those other ones that still have the capabilities. So we're able to fill the queue up with solutions, hopefully, not always. Sometimes we really do down select to just one. And quite honestly, sometimes the programs fail completely.

You know, one of the recent programs that we were doing, MIST, which was a really innovative way of thinking about storage of information because the intelligence community collects so much information that how do you store it without, you know, billions of acres of computers is if we could use DNA to store information, think about that.

Catherine Marsh

how tiny we could make that and how we could do very interesting next generation communications. But the reality is, even though we tried, at the end of 42 months, which should have been 12, nobody met the metrics. And they were way far off. And when we looked across the landscape, and we will go back to Heilmeier III, what's changed or why do you think you can be successful at this time?

The technology isn't there yet and the landscape hasn't changed enough. It's something we'll continue to stay smart about. And so by taking different technical approaches, you are still taking on risk. Absolutely. But you're buying down that risk with a variety of potential approaches.

Dimitrios Donavos

Dr. Marsh, as you know, science is dealing with the reproducibility crisis right now. And one of the things that really differentiates IARPA's approach is this requirement for transparency that happens through this independent test and evaluation process. You've touched on this, but I just want to make sure that we reiterate and foot stomp. Test and evaluation takes up a significant portion of a program budget. Talk about the scale of that relative to the size of the budget for a program.

Catherine Marsh

So 25%. So for of our budget is independent T &E. And we do that, you know, it's rare that we'll just have one test and evaluation partner on a program. We often have two or three because we want to make sure that we can test all the different, one, technical areas, but also with, no kidding, this nation's experts in that field, right? And so we're using the national labs, we're using the federally funded research and development corporations. We're using the government laboratories that have that very specialized technical expertise. And we're using the university affiliated research centers to do that testing on our behalf. And they help set up the testing. They have the experts in the field. And they're the ones who give us the hard truth about what the results really are.

Catherine Marsh

They also then allow us to be part of the testing if we want to, to monitor, sit in, watch, so that the program managers are often intimately involved with the independent testing evaluation to see what the results are that are coming off near real time, because that program manager is a technical expert in the field. For example, next week we're going to be doing some testing on the the SCISRS program, which is looking at RF emanations, and the people who are the program managers are experts in that area. And so they're going to want to see what it is the testing is telling us about those emanations and what that might mean for the use cases and things that we have to worry about.

Dimitrios Donavos

Science and the scientific community doesn't always incentivize publishing results where we have failure. And so, we oftentimes sort of sweep it under the rug, but it can be extremely informative because there are lessons learned. What are some lessons learned from a failure you experienced in your career?

Catherine Marsh

When things don't work the way that you want them to, and we all have lots of things that don't work the way we want to, it's kind of go back to the drawing board. What did I, not from a blame perspective. What question didn't I ask up front that I should have asked, right? What are these results telling me? And so I was working on the development of a new battery technology. It happened to have been a battery called, it was a lithium seawater battery. So, imagine taking lithium, which reacts with water, okay, put lithium water, it catches on fire. And I'm here, I'm trying to make a battery out of it, right? And so, we had all these different, because you think out of the box and you're trying to do something different, we had all these different polymer technical approaches that we were looking at. And, you know, none of them worked, right? And so, I'm like, why didn't they work? Right? Because if you think about polymer, and you think about ladies pantyhose, you know, they stretch and they compress.

Catherine Marsh

But there's little holes in them. And so, we could never make it, if you want to make a battery work, you've got to have electrolyte transfer. We could never make that situation work because we always had a pore that was open and so there was always a corrosion reaction going on. And the corrosion reaction was more dominant than the electrochemical reaction. So, we did get electrochemical reactions that worked. But ultimately in the development of that systems, those systems, we hit a wall. And when we hit the wall, we're like, why did we hit this wall? And we had this aha moment of the polymers were never made to be able to do that. And so, at the same time, we were, you know, I like to stay technically sharp and we were working on monitoring progress on other approaches for new separators, if you will, for batteries and there was this one that was a conductive glass that was being developed by a small company out in California.

And I said, you know what, why don't we see if we can make this work? And sure enough, we, for a very small amount of money, we funded this company and if they could, they made it work, right? And so instead of a lithium seawater battery that was based on a polymer technology, we ended up working on technology that was a conductive class, that we made it meet the metrics that we were going after to continue. And so, I guess part of it is, I don't like to give up, right? So never give up is behind some of that, but it was based on learning and people publishing. And when you hit that wall, not saying, not burying those results and...

because most of that work was on a classified effort, you know, they're not published out in open literature, although all of those people who were investigators did publish the work that they were doing, but not for our particular applications, but internally at the agency, we documented all of that in the appropriate way so that the customer for that work ultimately

Catherine Marsh

had those results and had that knowledge base so that they didn't continue to invest incorrectly in something that wasn't going to yield the kinds of results that they need.

Dimitrios Donavos

You brought up an interesting point about publishing in the open research community. The majority of the work that IARPA funds is actually published in the open research community and our work is for the most part unclassified. But that brings up a very important question. How do we protect the outcomes of our research from ending up in the hands of our adversaries?

Catherine Marsh

Great question.

One of the most important things we do for the development of our technology is the use of our research and technology protection protocols. That is a methodology that was developed at IARPA right at the very beginning. And that is a, it seems simplistic, but it's not. When you work in the classified world, we have a tendency to over classify. And so,how do we prove to our IC customers before we go out and we do this outward facing research that we're taking their problems seriously? And so, we developed this methodology that says, we're going to ask this series of questions of what are you trying to do? Why do you need to protect it? Who do you need to protect it from? Why do you need to protect it from them?

So that we could define crisp lines in the road where a program goes from unclassified to for official use only, to secret, to top secret, to compartmented information. And we review that the security profile or protocol for every program every six months to make sure that the landscape hasn't changed and that we are paying attention to the changes that may have an impact on our programs. The perfect example of how the landscape has changed is in quantum computing. Fifteen years ago, everybody was very concerned appropriately about qubits. And so, the classification and the protocols and the technologies that we're evaluating are very much focused on qubit methodologies. And yet, over time,

Catherine Marsh

in the recent past, photons and photonics have now emerged as a change to that landscape that now we need to pay attention to and we weren't paying attention to it because we didn't think that was a threat then. And so, if you're not doing this constant review of the landscape of what's happening, you can miss something like that and then you could have that unworn surprise again. And so that's why the use of our research and technology protection protocols, which we gladly share across the community and to the public sector who needs to know about it, to help educate researchers who aren't inclined to think that way, why you might want to add some protection in there and why you might want to think about where this technology is ultimately going to be used if you happen to be doing something that may be a use case of the intelligence community or the Department of Defense because they too have to protect how technology is going to be.

Dimitrios Donavos

I want to move on to discuss the engines of innovation at IARPA and that is the program managers. And we talk about program managers at IARPA as being force multipliers for any future program managers who might be listening, can you unpack what that phrase means to you and describe how the role of PM empowers them to transform not only science, but potentially national security and society?

Catherine Marsh

I gotta say, if I were a younger person at a different point in my career, I would love to be an IARPA or DARPA program manager, okay? Because it is that opportunity to come in with that great idea, okay? Because program managers have to have a great idea that they're really passionate about that's going to change the way things are done in the community and come in with that great idea, pitch it, get it across the goal line. And if they do that, then they're gonna have an opportunity to come in and run that program and to be that guiding light

Catherine Marsh

of that next generation capability. You know, if you think about some of our programs, you know, we're working on the development of our program called SMART ePANTS, right? And SMART ePANTS is developing next generation clothing capability. Why would you need that? Well, we go places where we might want to see things, hear things, and geolocate where they are. And...

We don't always think about all the dual use cases of it. When we were talking about, because we do things very publicly on our programs, when we were talking about that program, we actually had a parent of a child with learning disabilities contact us and share with us how critically important such a development would be for their child. Because...

Their child would then be always protected from those cases where they're in a situation where they don't know and they may be in the harm's way of somebody. We were so touched by that use case of not even being on our radar that somebody would share with us. And so that was something that gave me goosebumps when I heard about it. And, you know the next generation battery technology, if we're able to increase the energy density of the materials, the fundamental materials that we're doing for the intelligence community, that carries over to how much range you're going to get in your electric vehicle. It carries over into the electric grid. It carries it over into, you know, one of our upcoming programs is going to be on solar panels. And so, there's dual use capabilities that if we didn't have these specialized cases in the intelligence community that make it so worth our while to make that investment, and we're not moving the needle with small programs, this is, I can't talk about the specifics of our budget.

Catherine Marsh

But this is investment that moves the needle substantially on the technology. And then that dual use capability means that the greater public sector benefits as a result of it.

Dimitrios Donavos

You touched on a point I was about to make that PMs come to IARPA really to make a dent in the universe. And it's that ability to work on these very challenging problems and moving the needle. And that leads into my next question.

Part of IARPA's approach to solving difficult problems is building multidisciplinary communities that often didn't exist before. IARPA has a history of launching programs that have lasting impact, not just from the perspective of improving national security capabilities, but in terms of advancing science in areas from quantum computing, which you touched on, to human language technology, to even super forecasting.

How have IARPA programs moved the needle in the open scientific community in ways our listeners might be surprised to learn about?

Catherine Marsh

Wow, what a great question. There's thousands and thousands of publications attributable to IARPA research across the world and many more thousands who reference our work in their work to go forward. But we also have Nobel Prize winners as a result of the quantum research that has its foundations here. We have Bell Prize winners. We are the foundations for next generation facial recognition capability. When you go onto Google and they're asking you these questions about what's making, you know, recognize all the motorcycles in these things, all of that traces back to technology developed at IARPA for a totally different application that then gets used in the private sector. And you know, all of this diversity is a result of the fact that all of us, me included, we're only here for three to five years. We don't have a lifetime to make a difference. We've got to come in with that idea, that passion, and that drive to make it happen and make it happen now. We can't afford to...

Catherine Marsh

drag things out and only do incremental advances, if you don't have something that's gonna be game changing, you're not gonna get across the line. And we've gotta take that risk. And there's others that will continue with that. But when you only have three to five years to get something done, you're off and you're running from day one. And if you're passionate about it, you're spending five of the busiest years of your life doing this while you are eating, drinking, sleeping, and thinking about it. And you are generally not just doing one program, but you're doing two or three programs over the life of your time here at IARPA.

And when you think about that human language translation, everybody says, I've got Google Translate. Well, yeah, that's okay if you're going to France, okay? But I just want to let you know that the intelligence community were not worried about going to France, okay, or Germany or Italy, all those wonderful places that are in this world, were really worried about going to those places where the bad guys are, where we don't understand Pashto or, you know, Tagali or some of the other low-resource languages. We have to have and enable those kinds of tools for our partners and to be able to do that, to understand the analysis, to be able to understand the threat landscape and all of that. And we didn't have those tools until we had someplace like IARPA that created that and have really made significant changes that have made wonderful impacts for our partners in the community.

Dimitrios Donavos

So you referenced term limits and your term is coming up soon. Thinking back to the first time you actually were at IARPA in your role as deputy director from 2013 to 2015, how would you say IARPA has evolved as an organization since that time and how have you evolved as a leader?

Catherine Marsh

Good question. When I was here before, it was the end of our...coming to the end of the first generation of technologies that we had invested in. And some of those were extremely well received, absolutely, particularly our human language translation tools and capabilities. But yet others that where we had made really what we thought were significant advances, they actually ended up getting put on the shelf. And I was part of...a very interesting conversation with one of our IC partners where we went down and we did a demonstration for them and they said, wow, that's really cool technology, but you know, we can't use it because if we really need to do what this technology has the ability to do, we've got to go in and worry about chain of custody and other things that are relative and important. And I was in that meeting and that was an aha for me in saying that we were not close enough in our early days to our IC partners to really understand and get the buy-in before we even started a program to what we needed to be to make sure that our technology was really going to be carried across the line and not be put on the shelf.

And so, one of the big changes that we've made since then across that is the involvement of our IC partners right from the beginning of program inception. In fact, on my watch, if you don't have IC partners sitting at the table at your new start pitch, okay, who say, yay Verily, we really want this, this is really important to us, and hopefully you've got more than one IC partner but at least one IC partner, then your program's gonna get a thumbs down because we can't afford to do things that are gonna be put on the shelf. And yes, some things are next generation, but even that program that I was telling you about, MIST, that was a failure, that didn't, wasn't successful, we had IC partners who were right there saying, if you can make this work, this is really a game changer for us.

Catherine Marsh

And so it was a smart investment because we knew if we could do it that we had somebody who was going to pick it up. I think that's the biggest success story in the huge changes that we've made because they become part of our government advisory panels that work throughout the programs and then pull through the technologies at the end. And I would say that that has enabled the success rate of close to 75 % of our programs have some level of transition to our IC partners. Even if it's a program that fails, if we've done data collection, labeling, data labeling, then, and we're able to transition those data sets, at least that is something that saves another IC partner funding and they can use it on their applications.

So, we look across that for many incremental ways of being able to transition not only the end product but things along the way. So we've got that buy-in and that familiarization to help get over the not invented here syndrome which we all suffer from. Well, I don't know anything about that and so now I've got to relearn how to do all this. If they've been working alongside you from the beginning and watching the progress and even coming to our test and evaluation events and being part of that, we've got much better pull through at the end. And I think that's the biggest evolution and the success that has enabled with that.

Dimitrios Donavos

I mean, it's natural, I think, for people to feel skeptical. And part of that process is enabling people to feel like they're part of that development and they have skin in the game. And so I think that has been a really incredibly important development at IARPA. And in my tenure here, I have witnessed that happen. As you reflect back on your term, and as we think about the speed with which innovation is accelerating, the intelligence community will likely face a landscape of technological challenges that will look different from the challenges of just a few years ago.

Dimitrios Donavos

Looking over the horizon, what advice would you offer your successor for leading IARPA through its next chapter?

Catherine Marsh

Make sure you understand where our partners are now and where they really see those gaps in capabilities that are causing them to stay up at night. Right? What can't they do? You know, where do they really see those big, big threats and why? Making sure that we are doing that. And I would say that while we have on many programs and more today than we had in the past, doing tested evaluation that mimics, and it's classified so we don't tell the details of what we're doing outside, but making sure we're doing the test and evaluation that carries the most credibility for our partners that helps them with that pull through. So, understand the gaps, make sure you've got the tie in, looking down at what's that big threat coming at us? Can we make computers so smart that we just heard a talk this morning where somebody said we're going to make our computers so smart that we won't need to educate people with PhDs. And I said to the program manager, I don't think that's such a great idea, you know?

But, you know, what is that threat of the artificial intelligence and machine learning and, you know, the chat GPTs and beyond that have bringing tools and capabilities the IC cannot put its head in the sand. How do we enable those next generation capabilities to be on the high side and to be safe on the high side and to understand the threats that that impose and then to knowingly take on the risks because we've done the hard work at IRPA in a safe way that enables those capabilities to be more readily adopted. And it's not an easy...

Catherine Marsh

road to hoe because you're always going after gaps and not everybody wants to tell you about them but part of my warm transition with my successor is going to be to make sure that he knows all of the correct people in the different agencies and can readily get access to that information and stay current on that because where do they see the threat coming on board? Even something as ubiquitous as climate change has a threat to the intelligence community. Even though that's climate change in the intelligence community, we are constantly monitoring that and being smart about it. And I think that and hiring great people who really are passionate that...

that makes all the difference. And the program managers are the best part of the day, right? When you get to spend 20 minutes, somebody pops into your office just to share what, hey, this great result. Hey, let me show you this cool thing. That's what keeps me going, right? You know, all the headaches of things that we have to deal with them as we have to.

But the next generation technology, when they're bringing that to you and they're showing it to you, is just, that's the really exciting part that will keep you enthusiastic and knowing that you're doing the right thing and that nobody else is.

Dimitrios Donavos

I can completely relate to that feeling having been at IARPA for nearly a decade. I can say that one of my favorite times is when we have the program management reviews and for our listeners, each program every six months goes through a review cycle where leadership will hear the newest developments on the program. And that's when we get to hear all of the exciting technologies and capabilities that are being developed. As we sort of wrap up here, Dr. Marsh, I want to ask you one final question. And that is, what is one thing you can share with our audience that people might be surprised to know about you?

Catherine Marsh

I guess my grandparents came through Ellis Island. So we are first generation. My mother is first generation. Both of my parents who grew up in the 50s, they went to college. My dad was a sailor. He was a Korean conflict vet. He died at 66 years old. So, the closer I get to that age, the more blessed I am that I have good health. And, you know, I look at that. I would say that I, looking back on life, I have been blessed with all the things that I've had the opportunity to do that I never knew that I would get to do. Right? I didn't plan a path, you know, I come from the wrong side of the tracks. I didn't grow up wealthy. I mean, to get to go to an Ivy League school when, when we were on food stamps when I was in junior high is a blessing, right?

And then to be able to look back at all that I've accomplished, because when you're 21, 22, and you're like, life's ahead of you, you have this blank slate, and everybody wants to have a plan. And I never really had a plan. I let the passion for what I was doing lead me, and it didn't, didn't take me down the wrong track. And I had somebody who once said to me, if you love what you're doing, you're never going to work a day in your life. And I never feel like I've worked a day in my life. And I've also never forgotten to say thank you. Thank you to, I didn't get here on my own. Everybody who I work with, I say thank you to all the time.

They have helped me be successful and I hope that I have helped them in some way. And I say this all the time and I'm known for it, but our assets go home at night. We've got to take care of your people. They're the most important part of what we do and all the technology that we're developed and that we continue to develop is as a result of the great people. And so we've got to make the investments in making sure.

Catherine Marsh

that they have the things they need to do the job the way they want to do it and make sure that they're empowered to do it. And I have had people help with that along my career. And I hope that I'm giving that back to others as they can be successful along their paths in their lives.

Dimitrios Donavos

Dr. Marsh, that was a very powerful and compelling answer to a question I'm sure you did not have a plan for when I asked you. Well, I just want to close with a more formal thank you. Thank you for joining us today. Thank you for a compelling and insightful interview, and we appreciate your time very much.

Catherine Marsh

I really enjoyed this, and I'm so thankful that you're going to do Disbelief to Doubt because that truly is what we're about in changing the landscape of what we can do for our nation.

Dimitrios Donavos

Thank you for joining us. For more information about IARPA and this podcast series, visit us at I-A-R-P-A.gov. You can also join the conversation by following us on LinkedIn and on Twitter at IARPA News.

End Part 2 of 2

M. C. Smart et al., "Performance characteristics of Yardney lithium-ion cells for the Mars 2001 Lander application," Collection of Technical Papers. 35th Intersociety Energy Conversion Engineering Conference and Exhibit (IECEC) (Cat. No.00CH37022), Las Vegas, NV, USA, 2000, pp. 629-637 vol.1, doi: 10.1109/IECEC.2000.870847

R. Gitzendanner, T. Kelly, C. Marsh, and P. Russell, "Prismatic 20 Ampere Hour Lithium-ion Batteries for Aerospace Applications," SAE Technical Paper 981249, 1998, doi: 10.4271/981249.

J. C. Flynn and C. Marsh, "Development and experimental results of continuous coating technology for lithium-ion electrodes," Thirteenth Annual Battery Conference on Applications and Advances. Proceedings of the Conference, Long Beach, CA, USA, 1998, pp. 81-84, doi: 10.1109/BCAA.1998.653845

J. C. Flynn and C. Marsh, "Development of continuous coating technology for lithium-ion electrodes," IECEC-97 Proceedings of the Thirty-Second Intersociety Energy Conversion Engineering Conference (Cat. No.97CH6203), Honolulu, HI, USA, 1997, pp. 46-51 vol.1, doi: 10.1109/IECEC.1997.659157.

Mars Spirit and Opportunity

ODNI 100/500 Day Plans

IARPA Quantum Programs (ELQ, CSQ QCS, MQCO LogiQ, QEO)

IARPA Facial Recognition (Janus, BRIAR)

IARPA HLT (HIATUS, BENGAL, Babel, MATERIAL, BETTER)

IARPA Programs Quantum Supremacy

IARPA Funded Research Nobel Prize 2012

Get a sneak peek of Disbelief to Doubt Episode 1! In this episode, you'll learn IARPA's origin story and hear about former Director Dr. Catherine Marsh's "leap of faith" into government service. Full episode coming soon!

Timestamp	Caption
00:00:02	Catherine Marsh - And then 9 -11 happened. The morning after 9 -11, I got my call to join the CIA. I wasn't going to say no. I couldn't have anyway. And everybody asked me, what are you going to do? And I said, I have no idea. It was a leap of faith to come to work for the agency, and I have.
00:00:25	Dimitrios Donavos - Join us for the premiere episode of IARPA's new podcast, Disbelief to Doubt, where we speak with former director Dr. Catherine Marsh about taking a leap of faith to join the CIA, working on Class A must -not -fail missions, and much more. Coming soon to A Podcast Player Near You.

Welcome to IARPA: Disbelief to Doubt the new podcast from the Intelligence Advanced Research Projects Activity (IARPA). Disbelief to Doubt will explore our 15+ year history of pushing the boundaries of science and being at the forefront of innovation all in service to our nation.

Coming Soon!

Timestamp	Caption
00:00:10	Dimitrios Donavos - Science and technology are rapidly transforming not only how we work and how we live, but how our nation conducts the business of intelligence. Launched in 2006 by the Office of the Director of National Intelligence, the Intelligence Advanced Research Project activity, IARPA, invests in high -risk, high -payoff research to tackle some of the intelligence community's most difficult challenges. Since its founding, IARPA has been at the forefront of innovation sponsoring research that has the potential to push the boundaries of science. This approach often means starting with an idea that seems impossible, then moving from this state of disbelief to a state of just enough skepticism or doubt that bringing together some of the best and brightest minds might allow us to redefine what's possible. This podcast series will explore the history and accomplishments of IARPA through the lens of some of its most impactful programs and the thought leaders behind them. We'll use artificial intelligence to navigate to the moon and back on an unmanned autonomous vehicle, delve into the structure of the mouse brain to reverse engineer machine learning algorithms, unpack the science of predicting the future, and much more. This is IARPA, Disbelief to Doubt.

00:00:10

Dimitrios Donavos - Science and technology are rapidly transforming not only how we work and how we live, but how our nation conducts the business of intelligence. Launched in 2006 by the Office of the Director of National Intelligence, the Intelligence Advanced Research Project activity, IARPA, invests in high -risk, high -payoff research to tackle some of the intelligence community's most difficult challenges. Since its founding, IARPA has been at the forefront of innovation sponsoring research that has the potential to push the boundaries of science. This approach often means starting with an idea that seems impossible, then moving from this state of disbelief to a state of just enough skepticism or doubt that bringing together some of the best and brightest minds might allow us to redefine what's possible. This podcast series will explore the history and accomplishments of IARPA through the lens of some of its most impactful programs and the thought leaders behind them.

We'll use artificial intelligence to navigate to the moon and back on an unmanned autonomous vehicle, delve into the structure of the mouse brain to reverse engineer machine learning algorithms, unpack the science of predicting the future, and much more. This is IARPA, Disbelief to Doubt.

Coming soon

Leap of Faith (Episode 1 Part 1)

Force Multipliers (Episode 1 Part 2)

Leap of Faith (Episode 1 Teaser)

Disbelief to Doubt Podcast Trailer

IARPA: Disbelief to Doubt

Leap of Faith (Episode 1 Part 1)

Force Multipliers (Episode 1 Part 2)

Leap of Faith (Episode 1 Teaser)

Disbelief to Doubt Podcast Trailer

IARPA: Disbelief to Doubt

Loading...