{"id":118018,"date":"2019-03-06T11:11:10","date_gmt":"2019-03-06T15:11:10","guid":{"rendered":"https:\/\/stateofthenation2012.com\/?p=118018"},"modified":"2019-03-06T11:23:38","modified_gmt":"2019-03-06T15:23:38","slug":"just-how-much-has-the-cia-collaborated-with-amazon-to-change-american-intelligence-gathering","status":"publish","type":"post","link":"https:\/\/stateofthenation2012.com\/?p=118018","title":{"rendered":"Just how much has the CIA collaborated with AMAZON to change American intelligence gathering?"},"content":{"rendered":"<h1>HOW THE CIA PARTNERED WITH AMAZON AND CHANGED INTELLIGENCE<\/h1>\n<p><!--more--><a href=\"https:\/\/stateofthenation2012.com\/wp-content\/uploads\/2019\/03\/defense-large.jpg\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/stateofthenation2012.com\/wp-content\/uploads\/2019\/03\/defense-large.jpg\" alt=\"\" width=\"710\" height=\"325\" class=\"aligncenter size-full wp-image-118025\" srcset=\"https:\/\/stateofthenation2012.com\/wp-content\/uploads\/2019\/03\/defense-large.jpg 710w, https:\/\/stateofthenation2012.com\/wp-content\/uploads\/2019\/03\/defense-large-300x137.jpg 300w\" sizes=\"auto, (max-width: 710px) 100vw, 710px\" \/><\/a><\/p>\n<h3 class=\"d1-article-subhead\"><span class=\"d1-article-subhead-inner-a\"><span class=\"d1-article-subhead-inner-b\"><span class=\"d1-article-subhead-inner-c\">Amazon is building a cloud for the intelligence community that could bridge the sort of gaps that preceded the 9\/11 attacks. <\/span><\/span><\/span><\/h3>\n<p class=\"d1-article-subhead\"><span class=\"d1-article-subhead-inner-a\"><span class=\"d1-article-subhead-inner-b\"><span class=\"d1-article-subhead-inner-c\">By Frank Konkel<\/span><\/span><\/span><\/p>\n<div class=\"text d1-article-content\">\n<p><strong>The intelligence community is about to get\u00a0<\/strong>the equivalent of an adrenaline shot to the chest. This summer, a $600 million computing cloud developed by Amazon Web Services for the Central Intelligence Agency over the past year will begin servicing all 17 agencies that make up the intelligence community. If the technology plays out as officials envision, it will usher in a new era of cooperation and coordination, allowing agencies to share information and services much more easily and avoid the kind of intelligence gaps that preceded the Sept. 11, 2001, terrorist\u00a0attacks.<\/p>\n<p>For the first time, agencies within the\u00a0<span class=\"caps\">IC<\/span>\u00a0will be able to order a variety of on-demand computing and analytic services from the\u00a0<span class=\"caps\">CIA<\/span>\u00a0and National Security Agency. What\u2019s more, they\u2019ll only pay for what they\u00a0use.<\/p>\n<p>The vision was first outlined in the\u00a0<span class=\"caps\">IC<\/span>\u00a0Information Technology Enterprise plan championed by Director of National Intelligence James Clapper and\u00a0<span class=\"caps\">IC<\/span>\u00a0Chief Information Officer Al Tarasiuk almost three years ago. Cloud computing is one of the core components of the strategy to help the\u00a0<span class=\"caps\">IC<\/span>\u00a0discover, access and share critical information in an era of seemingly infinite\u00a0data.<\/p>\n<p>For the risk-averse intelligence community, the decision to go with a commercial cloud vendor is a radical departure from business as\u00a0usual.<\/p>\n<p><a href=\"https:\/\/www.facebook.com\/DefenseOne\">(Find us on\u00a0Facebook)<\/a><\/p>\n<p>In 2011, while private companies were consolidating data centers in favor of the cloud and some civilian agencies began flirting with cloud variants like email as a service, a sometimes contentious debate among the intelligence community\u2019s leadership took\u00a0place.<\/p>\n<p>As one former intelligence official with knowledge of the Amazon deal told\u00a0<em>Government Executive,<\/em>\u00a0\u201cIt took a lot of wrangling, but it was easy to see the vision if you laid it all\u00a0out.\u201d<\/p>\n<p>The critical question was would the\u00a0<span class=\"caps\">IC<\/span>, led by the\u00a0<span class=\"caps\">CIA<\/span>, attempt to do cloud computing from within, or would it buy\u00a0innovation?<\/p>\n<p>Money was a factor, according to the intelligence official, but not the leading one.\u00a0 The government was spending more money on information technology within the\u00a0<span class=\"caps\">IC<\/span>\u00a0than ever before.\u00a0<span class=\"caps\">IT<\/span>\u00a0spending reached $8 billion in 2013, according to budget documents leaked by former\u00a0<span class=\"caps\">NSA<\/span>\u00a0contractor Edward Snowden. The\u00a0<span class=\"caps\">CIA<\/span>\u00a0and other agencies feasibly could have spent billions of dollars standing up their own cloud infrastructure without raising many eyebrows in Congress, but the decision to purchase a single commercial solution came down primarily to two\u00a0factors.<\/p>\n<p>\u201cWhat we were really looking at was time to mission and innovation,\u201d the former intelligence official said. \u201cThe goal was, \u2018Can we act like a large enterprise in the corporate world and buy the thing that we don\u2019t have, can we catch up to the commercial cycle? Anybody can build a data center, but could we purchase something\u00a0more?<\/p>\n<p>\u201cWe decided we needed to buy innovation,\u201d the former intelligence official\u00a0said.<\/p>\n<h2 class=\"wysiwyg\">A Groundbreaking\u00a0Deal<\/h2>\n<p>The\u00a0<span class=\"caps\">CIA<\/span>\u2019s first request for proposals from industry in mid-2012 was met with bid protests to the Government Accountability Office from Microsoft and\u00a0<span class=\"caps\">AT<\/span>&amp;T, two early contenders for the contract. Those protests focused on the narrow specifications called for by the\u00a0<span class=\"caps\">RFP<\/span>.\u00a0<span class=\"caps\">GAO<\/span>\u00a0did not issue a decision in either protest because the\u00a0<span class=\"caps\">CIA<\/span>\u00a0reworked its request to address the companies\u2019\u00a0complaint.<\/p>\n<p>In early 2013, after weighing bids from Amazon Web Services,\u00a0<span class=\"caps\">IBM<\/span>\u00a0and an unnamed third vendor, the\u00a0<span class=\"caps\">CIA<\/span>\u00a0awarded a contract to\u00a0<span class=\"caps\">AWS<\/span>\u00a0worth up to $600 million over a period of up to 10 years. The deal, handled in secret, was first reported by\u00a0<em><span class=\"caps\">FCW<\/span>\u00a0<\/em>in March 2013, sending ripples through the tech\u00a0industry.<\/p>\n<p>A month after the deal became public,\u00a0<span class=\"caps\">IBM<\/span>\u00a0filed a bid protest with\u00a0<span class=\"caps\">GAO<\/span>\u00a0that the watchdog eventually upheld in June, forcing the\u00a0<span class=\"caps\">CIA<\/span>to reopen bids to both companies for the contract. A legal struggle between Amazon and Big Blue ensued, and\u00a0<span class=\"caps\">AWS<\/span>\u00a0filed a lawsuit against the federal government in July 2013, claiming the\u00a0<span class=\"caps\">GAO<\/span>sustainment was a \u201cflawed\u201d\u00a0decision.<\/p>\n<p>In October,\u00a0<span class=\"caps\">U.S.<\/span>\u00a0Court of Federal Claims Judge Thomas Wheeler sided with Amazon and overturned\u00a0<span class=\"caps\">GAO<\/span>\u2019s decision to force the\u00a0<span class=\"caps\">CIA<\/span>\u00a0to rebid the contract. Big Blue went home,\u00a0<span class=\"caps\">AWS<\/span>\u00a0claimed victory under the deal\u2019s original financial specs, and nearly 18 months after the procurement was first released, the\u00a0<span class=\"caps\">CIA<\/span>\u00a0and Amazon went to\u00a0work.<\/p>\n<p>It is difficult to underestimate the cloud contract\u2019s importance. In a recent public appearance,\u00a0<span class=\"caps\">CIA<\/span>\u00a0Chief Information Officer Douglas Wolfe called it \u201cone of the most important technology procurements in recent history,\u201d with ramifications far outside the realm of\u00a0technology.<\/p>\n<p>\u201cIt\u2019s going to take a few months to bring this online in a robust way, but it\u2019s coming,\u201d Wolfe said.\u00a0 \u201cAnd I think it\u2019s going to make a big difference for national\u00a0security.\u201d<\/p>\n<h2 class=\"wysiwyg\">Securing New\u00a0Capabilities<\/h2>\n<p>The Amazon-built cloud will operate behind the\u00a0<span class=\"caps\">IC<\/span>\u2019s firewall, or more simply: It\u2019s a public cloud built on private\u00a0premises.<\/p>\n<p>Intelligence agencies will be able to host applications or order a variety of on-demand services like storage, computing and analytics. True to the National Institute of Standards and Technology definition of cloud computing, the\u00a0<span class=\"caps\">IC<\/span>\u00a0cloud scales up or down to meet the\u00a0need.<\/p>\n<p>In that regard, customers will pay only for services they actually use, which is expected to generate massive savings for the\u00a0<span class=\"caps\">IC<\/span>.<\/p>\n<p>\u201cWe see this as a tremendous opportunity to sharpen our focus and to be very efficient,\u201d Wolfe told an audience at\u00a0<span class=\"caps\">AWS<\/span>\u2019 annual nonprofit and government symposium in Washington. \u201cWe hope to get speed and scale out of the cloud, and a tremendous amount of efficiency in terms of folks traditionally using\u00a0<span class=\"caps\">IT<\/span>\u00a0now using it in a cost-recovery\u00a0way.\u201d<\/p>\n<p>Many agencies within the\u00a0<span class=\"caps\">IC<\/span>\u00a0already have identified applications to move to the cloud. In a recent report, National Reconnaissance Office Chief Information Officer Donna Hansen said her agency had picked five applications, including its enterprise resource planning software, to migrate to the\u00a0<span class=\"caps\">IC<\/span>\u00a0cloud.<\/p>\n<p>As with public clouds, the\u00a0<span class=\"caps\">IC<\/span>\u00a0cloud will maximize automation and require standardized information, which will be shared through application programming interfaces, known as APIs. Amazon engineers will oversee the hardware because\u00a0<span class=\"caps\">AWS<\/span>\u00a0owns the hardware and is responsible for maintaining it just as they do in the company\u2019s public data\u00a0centers.<\/p>\n<p>Whenever Amazon introduces a new innovation or improvement in cloud services, the\u00a0<span class=\"caps\">IC<\/span>\u00a0cloud will evolve. Company officials say\u00a0<span class=\"caps\">AWS<\/span>\u00a0made more than 200 such incremental improvements last year, ensuring a sort of built-in innovation to the\u00a0<span class=\"caps\">IC<\/span>\u00a0cloud that will help the intelligence community keep pace with commercial advances. Wolfe said\u00a0<span class=\"caps\">AWS<\/span>\u2019 capacity to bring commercial innovation from places like Silicon Valley to the\u00a0<span class=\"caps\">IC<\/span>\u00a0is one of the contract\u2019s greatest benefits. Whenever\u00a0<span class=\"caps\">AWS<\/span>\u00a0introduces new products, the\u00a0<span class=\"caps\">CIA<\/span>\u00a0will be able to implement them.<\/p>\n<p>\u201cThe biggest thing we were trying to do\u2014the visionary folks a couple years ago\u2014was answer the question, \u2018How do we keep up?\u2019\u201d Wolfe said. \u201cThe mission we have is important. The pace and complexity is really not [diminishing], in fact, it may be increasing. We feel it is very important to deliver the best\u00a0<span class=\"caps\">IT<\/span>\u00a0and best products and services we can to our customers in the\u00a0<span class=\"caps\">IC<\/span>.\u201d<\/p>\n<p>What of the data, though? Intelligence agencies are drowning in it, collecting and analyzing an amalgamation of information from sensors, satellites, surveillance efforts, open data repositories and human intelligence, among other sources. Is that data really secure in the\u00a0cloud?<\/p>\n<p>The\u00a0<span class=\"caps\">CIA<\/span>\u00a0is convinced it\u00a0is.<\/p>\n<p>The\u00a0<span class=\"caps\">IC<\/span>\u00a0cloud \u201cwill be accredited and compliant with\u00a0<span class=\"caps\">IC<\/span>\u00a0standards,\u201d says a senior\u00a0<span class=\"caps\">CIA<\/span>\u00a0official familiar with the\u00a0<span class=\"caps\">IC<\/span>\u00a0cloud. It will, for example, be able to handle Sensitive Compartmented Information, a type of classified information. \u201cSecurity in the\u00a0<span class=\"caps\">IC<\/span>\u00a0cloud will be as safe as or safer than security on our current data centers,\u201d the senior\u00a0<span class=\"caps\">CIA<\/span>\u00a0official\u00a0says.<\/p>\n<p>Because the\u00a0<span class=\"caps\">IC<\/span>\u00a0cloud will serve multiple tenants\u2014the 17 agencies that comprise the\u00a0<span class=\"caps\">IC<\/span>\u2014administrators will be able to restrict access to information based on the identity of the individual seeking it. The idea is to foster collaboration without compromising security. Visually, the\u00a0<span class=\"caps\">IC<\/span>\u00a0cloud can be thought of as a workspace hanging off the\u00a0<span class=\"caps\">IC<\/span>\u2019s shared network\u2014a place where data can be loaded for a variety of tasks like computing or sharing. The\u00a0<span class=\"caps\">IC<\/span>\u00a0cloud gives agencies additional means to share information in an environment where automated security isn\u2019t a barrier to the sharing itself. This could prove vital in situations reminiscent of 9\/11, in which national security is an immediate concern.<\/p>\n<p>Cloud vendors, including Amazon, have argued that cloud infrastructures can be more secure than traditional data centers because there are fewer points of entry, but the leaks by Snowden illustrate the potential threat from inside an organization. Snowden was able to access and download classified information intelligence officials said he shouldn\u2019t have been able to\u00a0access.<\/p>\n<p>To access information within the\u00a0<span class=\"caps\">IC<\/span>\u00a0cloud, analysts must have the proper permissions. In addition, the standardized environment and automation means all activity within the cloud is logged and can be analyzed in near\u00a0real-time.<\/p>\n<p>Some government officials view cloud computing as inherently less secure than computing on locally controlled servers, but the\u00a0<span class=\"caps\">CIA<\/span>\u2019s acceptance of commercially developed cloud technology \u201chas been a wake-up call\u201d to those who balk at it, according to John Pirc, a former\u00a0<span class=\"caps\">CIA<\/span>\u00a0cybersecurity researcher who is now chief technology officer at\u00a0<span class=\"caps\">NSS<\/span>\u00a0Labs, a security research\u00a0firm.<\/p>\n<p>\u201cYou hear so many people on the fence about cloud, and then to see the\u00a0<span class=\"caps\">CIA<\/span>\u00a0gobble it up and do something so highly disruptive, it\u2019s kind of cool,\u201d says Pirc. \u201cTo me, this removes the clouded judgment that cloud isn\u2019t secure. Their moving forward with this should send a message to the rest of the industry that cloud is something you shouldn\u2019t be afraid\u00a0of.\u201d<\/p>\n<p>Pirc is no stranger to disruptive technologies. At the\u00a0<span class=\"caps\">CIA<\/span>\u2019s research labs in the early 2000s, he recalls virtualization\u2014a technology that allows multiple operating systems to run simultaneously on the same servers, allowing for far more efficient computing\u2014before it became an integral component of many\u00a0<span class=\"caps\">IT<\/span>enterprises.\u00a0 Intelligence agencies use commercial off-the-shelf technology all the time, but to Pirc, the importance of the cloud capabilities the\u00a0<span class=\"caps\">CIA<\/span>\u00a0gets through leveraging Amazon Web Services\u2019 horsepower is best exemplified in computing intelligence data. Scalable computing is critical for fostering shared services and enhanced collaboration between disparate intelligence agencies.<\/p>\n<p>\u201cWhat it allows them to do is spin up servers and add more [computing power] fast, and when you\u2019re computing intelligence data, the more compute power you have, the faster you can react,\u201d Pirc says. \u201cIn the private sector, compute is all about money and profit, but from my viewpoint when I worked for the agency, you\u2019re working with extremely time-sensitive information. Being able to have that compute power, something that might have taken a couple of hours might instead take a few seconds. Profits aren\u2019t lost when you make mistakes in the intelligence community\u2014people die when you make\u00a0mistakes.\u201d<\/p>\n<p>A test scenario described by\u00a0<span class=\"caps\">GAO<\/span>\u00a0in its June 2013 bid protest opinion suggests the\u00a0<span class=\"caps\">CIA<\/span>\u00a0sought to compare how the solutions presented by\u00a0<span class=\"caps\">IBM<\/span>\u00a0and Amazon Web Services could crunch massive data sets, commonly referred to as big\u00a0data.<\/p>\n<p>Solutions had to provide a \u201chosting environment for applications which process vast amounts of information in parallel on large clusters (thousands of nodes) of commodity hardware\u201d using a platform called MapReduce. Through MapReduce, clusters were provisioned for computation and segmentation. Test runs assumed clusters were large enough to process 100 terabytes of raw input data.\u00a0<span class=\"caps\">AWS<\/span>\u2019 solution received superior marks from\u00a0<span class=\"caps\">CIA<\/span>procurement officials, according to\u00a0<span class=\"caps\">GAO<\/span>\u00a0documentation, and was one of the chief reasons the agency selected\u00a0Amazon.<\/p>\n<h2 class=\"wysiwyg\">Limited\u00a0Details<\/h2>\n<p>The\u00a0<span class=\"caps\">CIA<\/span>\u00a0declined to comment when\u00a0<em>Government Executive<\/em>\u00a0asked about the extent of the\u00a0<span class=\"caps\">IC<\/span>\u00a0cloud\u2019s capabilities or that of the National Security Agency\u2019s cloud. Amazon also declined to describe the\u00a0<span class=\"caps\">IC<\/span>\u00a0cloud\u2019s technical\u00a0capabilities.<\/p>\n<p>It is a good bet, though, that the\u00a0<span class=\"caps\">AWS<\/span>-built cloud for the\u00a0<span class=\"caps\">IC<\/span>\u00a0will have capabilities at least equal to existing capabilities Amazon has already implemented across\u00a0government.<\/p>\n<p>For example, the company provides the cloud bandwidth for the Securities and Exchange Commission\u2019s collection of more than 1 billion trade records and more than a terabyte of new data per day through its Market Information Data Analytics System. This example may be prescient given that now-public surveillance efforts indicate the\u00a0<span class=\"caps\">IC<\/span>\u00a0collects billions and perhaps trillions of pieces of metadata, phone and Internet records, and other various bits of information on an annual basis. The potential exists for the\u00a0<span class=\"caps\">CIA<\/span>\u00a0to become one of\u00a0<span class=\"caps\">AWS<\/span>\u2019 largest customers.<\/p>\n<p>Within the intelligence community, examples abound where the cloud\u2019s capabilities could significantly boost the\u00a0mission.<\/p>\n<p>As the geospatial hub of the community, the National Geospatial-Intelligence Agency ingests, analyzes, metatags and reports all geo-intelligence and multisource content in its flagship program called Map of the World. Geospatial data\u2019s importance to the\u00a0<span class=\"caps\">IC<\/span>has increased in recent years, as evidenced by\u00a0<span class=\"caps\">NGA<\/span>\u2019s nearly $5 billion budget and its staff nearly doubling in size since 2004. For intensive applications like ingesting or analyzing geospatial data, scalable computing could have a significant impact on mission performance. The cloud also could improve the way the agency shares its large data\u00a0sets.<\/p>\n<p>What the\u00a0<span class=\"caps\">IC<\/span>\u00a0has done with cloud is not easily replicable, according to American Council for Technology President Rick Holgate, but it is worth paying attention\u00a0to.<\/p>\n<p>\u201cThe\u00a0<span class=\"caps\">IC<\/span>\u00a0has a model other agencies should look to and aspire to in terms of transforming the way they think about delivering services across a large enterprise,\u201d Holgate says. \u201cThey are looking to common platforms and service delivery models across an entire enterprise, and not just gaining cost efficiencies, but to provide foundational capabilities to really allow it to\u00a0operate.\u201d<\/p>\n<p>Whether or not the\u00a0<span class=\"caps\">IC<\/span>\u00a0cloud serves as an example for the rest of government, the\u00a0<span class=\"caps\">CIA<\/span>\u2019s quest to buy innovation will loom large for years to\u00a0come.<\/p>\n<p>___<br \/>\n<a href=\"https:\/\/www.defenseone.com\/technology\/2014\/07\/how-cia-partnered-amazon-and-changed-intelligence\/88555\/\">https:\/\/www.defenseone.com\/technology\/2014\/07\/how-cia-partnered-amazon-and-changed-intelligence\/88555\/<\/a><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>HOW THE CIA PARTNERED WITH AMAZON AND CHANGED INTELLIGENCE<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-118018","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/stateofthenation2012.com\/index.php?rest_route=\/wp\/v2\/posts\/118018","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/stateofthenation2012.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/stateofthenation2012.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/stateofthenation2012.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/stateofthenation2012.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=118018"}],"version-history":[{"count":0,"href":"https:\/\/stateofthenation2012.com\/index.php?rest_route=\/wp\/v2\/posts\/118018\/revisions"}],"wp:attachment":[{"href":"https:\/\/stateofthenation2012.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=118018"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/stateofthenation2012.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=118018"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/stateofthenation2012.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=118018"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}