Cloud-based IoT Acceptance Test Methodologies for Air Force Systems Integration

OUSD (R&E) MODERNIZATION PRIORITY: Cybersecurity; Network Command, Control and Communications; Autonomy; Artificial Intelligence/Machine Learning; 5G TECHNOLOGY AREA(S): Sensors; Information Systems OBJECTIVE: Develop an automated Internet-of-Things Testing as a Service (IoT-TaaS) approach for assuring the resiliency and readiness of Air Force systems with embedded IoT technology. DESCRIPTION: The addition of IoT devices and systems to USAF networks and weapon systems poses a risk to readiness and mission operations. Additionally, IoT technology evolution is inconsistent and lacks assurance that upgrades and software configuration changes are adequately vetted for resiliency. Existing IoT testing capabilities do not address the nuances associated with embedding IoT into weapon system development programs. For example, it does not focus on all life cycle phases. The DoD Cybersecurity T&E Guidebook lacks a focus on IoT device integration. PHASE I: Define and develop an initial architecture concept for a cloud-based IoT-TaaS capability. Include a high level capabilities design/description for a prototype that would be built in Phase 2. PHASE II: Based on the results of Phase 1, develop a detailed framework and architecture design for a cloud-based IoT-TaaS capability. Develop and demonstrate a prototype cloud-based IoT acceptance test tool. Demonstrate the capability against a set of test scenarios. PHASE III DUAL USE APPLICATIONS: Utilize the cloud-based IoT-TaaS capability developed in Phase 2 beyond the DoD. The true success of IoT capabilities is dependent on communication/interoperability with multiple sectors. REFERENCES: https://www.cisa.gov/sites/default/files/publications/20_0204_cisa_sed_internet_of_things_acquisition_guidance_final_508_1.pdf; https://iotuk.org.uk/wp-content/uploads/2017/01/IOT-Taxonomy-Report.pdf; https://zero-outage.com/the-standard/security/security-taxonomy-for-iot/taxonomy-for-the-internet-of-things-iot/ section-1; https://www.dau.edu/cop/test/DAU%20Sponsored%20Documents/Cybersecurity-Test-and-Evaluation-Guidebook-Version2-change-1.pdf; https://www.dau.edu/cop/test/DAU%20Sponsored%20Documents/Cybersecurity-Test-and-Evaluation-Guidebook-Version2-change-1.pdf; https://www.researchgate.net/publication/325063325_An_Acceptance_Testing_Approach_for_Internet_of_Things_Systems https://www2.deloitte.com/content/dam/Deloitte/in/Documents/risk/in-risk-iot-security-testing-noexp.pdf; https://www.qualitestgroup.com/white-papers/iot-testing-the-big-challenge/; https://www.guru99.com/iot-testing-challenges-tools.html IoT-TaaS: Towards a Prospective IoT Testing Framework - https://ieeexplore.ieee.org/document/8281514; Model-Based Testing for IoT Systems : Methods and tools - https://tel.archives-ouvertes.fr/tel-02078372/document https://www.infosys.com/it-services/validation-solutions/documents/testing-iot-applications.pdf; KEYWORDS: IoT; methodology; Digital Twin; best practices; modeling; cyber resilience; data integrity