development contractor. The optimal structure to foster a collaborative environment features physical co-location of the acquisition support team, which consists of the program staff, contractor, and supporting specialists, testers, quality assurance, and configuration managers. Ideally these participants are co-located in the same physical space. While Agile practices depend upon highly skilled and disciplined there a clear, early commitment from user representatives and the broader user base?  Are users co-located with, or within close proximity to the program office and/or contractor?  How frequently

DEPLOYMENT PIPELINE i. CD pipelines represent a new attack surface. If not properly secured, credentials could be compromised or malicious code & changes injected. 1. Harden CI/CD servers and ensure they calls from certain types of test code) 4. Ensure every CI process is in an isolated container 5. Make the version control credentials of the CI system read-only 3. Ch. 23 – Protecting the Deployment

due to integrating late in the lifecycle. Downward spiral of pain b. HP LaserJet Firmware –i. Before CI: 2 releases per year. 5% of effort supporting new features, 20% on detailed planning, 25% on porting branches, 10% integrating, 15% manual testing. ii. Implemented Trunk-based development & CI iii. After CI: 40% effort on new features, 40% decrease in development costs, 140% increase in programs under dependency improvements often provide high-payoffs d. ADOPT TRUNK-BASED DEVELOPMENT PRACTICES i. CI and Trunk-based development (TBD) are countermeasures to large batch size ii. TBD enables: 1. Frequent

open and be prepared to accommodate a range of scenarios as the future unfolds.  Jez Humble and his co-authors suggest that instead of using detailed planning to manage risk, we instead use experiments describing, making them almost inevitable.  Respect for skill: Your new IT workforce will respect co-workers who have impressive technical skills, and will have little respect for people who don’t. Skill

Zabel http://www.ndia.org/events/2018/6/6/agile-in-government/proceedings Agile and EVMS They Can Co-exist! ( per John McGregor Deputy Director for Earned Value Management, PARCA, Office of the Assistant

monitoring 1. Create telemetry in application & environments (to include production, pre-production, and CD pipeline) iii. Ian Malpass, Etsy – “If Engineering at Etsy has a religion, it’s the Church of Graphs identify opportunity costs. d. INTEGRATE A/B TESTING INTO OUR RELEASE i. A/B testing requires fast CD to support ii. Use feature toggles to control experiments, cohort creation, etc. iii. Use telemetry

Requirements Definition Packages (RDPs) to capture a subset of the IS ICD scope and/or Capability Drop (CD) documents for smaller items such as applications o Replace comprehensive Preliminary Design Reviews