USAF - Big Data Platform Orchestration Capabilities - MRAS

The United States Air Force (USAF), in collaboration with the General Services Administration (GSA), is conducting market research to explore potential solutions for a Big Data Platform (BDP) Orchestration. This initiative aims to identify and evaluate products that can support the Rapid Analytic Deployment and Management Framework (RADMF). The overarching goal is to enhance the USAF's capability to manage and analyze large volumes of data efficiently while ensuring compliance with Department of Defense (DoD) security requirements.

The primary focus of this research is to identify and catalog available products in the market, evaluate their features, functionality, pricing, and assess their integration compatibility with existing DevSecOps platforms. Additionally, the research aims to estimate government resource requirements for transitioning to a new solution without disrupting current operations. A significant aspect of this effort includes ensuring that any proposed solution can seamlessly integrate into existing security networks such as NIPRNet, SIPRNet, and JWICS while providing robust orchestration and automation tools.

Key objectives for potential solutions include automated cloud provisioning capable of deploying clusters exceeding 15 petabytes, rapid deployment through CI/CD pipelines, scalability for data ingestion and processing, secure data aggregation capabilities, and network data management for threat hunting. The desired system should provide end-to-end provisioning capabilities across multiple domains, support infrastructure changes dynamically through configuration management databases, and offer workflow design customization with mission-critical overrides.

Potential solutions must also feature web-based remote management consoles with role-based access control integrated into an Enterprise Directory. Auto-scaling functions are essential to maintain optimal service levels across computers or virtual machines using predefined templates. This comprehensive approach ensures that the USAF can efficiently manage its big data needs while maintaining operational integrity and security standards.