FA864924P0217

Small Technology Transfer Research Program (STTR) Phase I

Advanced Data Platform for JADC2, a Competitive Advantage in High End Conflict

In the rapidly evolving landscape of data management, the need for comprehensive solutions that address diverse data challenges is paramount. Our advanced big data platform stands at the forefront of this innovation, offering a suite of integrated components tailored to meet the multifaceted demands of modern enterprises. The platform's first component, the Archive, provides scalable, fast, and safe storage designed specifically for the capture of event-like data. With a focus on ensuring a high degree of confidence in data integrity, the Archive serves as a robust foundation for data capture. Furthermore, the data archived in this component is pivotal in constructing the subsequent layers of the platform, namely the Data Lakes and Data Stores. The second component is the Data Lake. This component is characterized by its efficient and organized storage mechanisms. Within the Data Lake, schema management tools ensure structured and consistent data storage. Additionally, the platform supports both declarative data transformation for streamlined data reshaping and transformation via user-defined software, offering flexibility in data processing. A notable feature is the key/value data retrieval mechanism, which ensures rapid and precise data access. Moreover, while the Data Lake seamlessly integrates with our Archive, it also offers interfaces for external data sources, allowing enterprises to build upon their existing data repositories. The third component, the Data Store, enables dynamic data retrieval. Leveraging indexed search-based storage, the Data Store is tailored to retrieve arbitrary data sets based on diverse criteria. Advanced indexing algorithms underpin this component, supporting near real-time data availability post-ingestion. Furthermore, the Data Store is optimized for high-speed query performance, ensuring minimal latency in data retrieval. Sophisticated query capabilities, aggregation functions, and custom metrics further enhance the versatility of this component. The last component of the big data platform is the Session Store, designed specifically for high-concurrency scenarios. This component is ideal for data that undergoes frequent modifications, ensuring rapid data updates without conflict. The Session Store is not only optimized for swift data access but also facilitates shared access at the application layer, making it ideal for collaborative applications and shared datasets. Our advanced big data platform is a holistic solution that seamlessly integrates four pivotal data management components. Through its advanced technical features and integrations, the platform ensures optimal data storage, processing, and retrieval, solidifying its position as an indispensable tool for modern enterprises.

The goal of phase I is to establish the technical merit, feasibility, and commercial potential of proposed R&D efforts and determine the quality of performance of the small business awardee organization. STTRs are completed in conjunction with a research institution.

IQM Research Institute

AFX23E-TPCSO1

FX23E-TPCSO1-0520

X23.E

Meghan Scott