Artificial Intelligence Quantified (AIQ)

Background
The goal of AIQ is to assess and understand capabilities without access to internals, a goal which will be expedited by having access to the internals of open-sourced models, given the architectural similarity to proprietary models. The program places a strong emphasis on creating and leveraging open-source development, along with advocating the use of liberal open-source licensing (e.g., Apache, MIT). This strategy includes the establishment of open-source repositories (e.g., GitHub), which are accessible for review by team, other performers, and the wider research community. Such an approach is pivotal in promoting a culture of open innovation and shared knowledge. By facilitating this openness, the program aims to spur rapid innovation and continuous improvement.

Work Details
The AIQ program involves multiple phases with evaluations and demonstrations on selected problems. Proposers are required to submit a detailed schedule of logically sequenced tasks and subtasks that constitute a constructive plan for achieving the proposed technical objectives while appropriately managing risk. Schedules will be synchronized across performers, as required, and monitored and reviewed throughout the AIQ program’s period of performance. The program also includes PI meetings, site visits, monthly teleconference meetings, and travel planning. There are multiple points of essential collaboration among TAs, and all performers are expected to collaborate effectively.

Period of Performance
For budgeting purposes, use January 15, 2025, as a start date for both TAs. The program involves two phases with PI meetings held approximately six (6) months and twelve (12) months after the kick-off meeting in Phase 1. In Phase 2, there will be two PI meetings and a final evaluation meeting.

Place of Performance
For travel planning and costing, assume seven (7) trips during the two phases per the program schedule shown (Fig. 3), alternating between Washington, DC and San Diego, CA, with each trip requiring 3-days and 2-nights.