Self-Improving AI Monitoring Act
A BILL
To amend the National Institute of Standards and Technology Act to authorize certain assessments by the Director of the Institute and impose requirements on certain memorandums of understanding relating to artificial intelligence, and for other purposes.
Sec. 2 Assessments and memorandums of understanding with respect to certain standards for artificial intelligence
“(6) assess, based on the information, if any, disclosed pursuant to subsection (h)(1) and other information, trends regarding the capabilities of artificial intelligence systems, including such a capability to autonomously facilitate or conduct research on or development of an artificial intelligence system, that might contribute to scientific research and development breakthroughs.”
“(h) Requirements for memorandums of understanding—In carrying out subsection (b), the Director may not enter into with the developer of a frontier artificial intelligence system (as determined by the Director) a memorandum of understanding to conduct pre-deployment evaluation of such frontier artificial intelligence system unless the following requirements are satisfied:
“(1) Such memorandum includes a requirement for such developer, in carrying out such evaluation, to disclose to the Director upon request of the Director information relating to the extent to which an artificial intelligence system was utilized to facilitate or conduct research on or development of such frontier artificial intelligence system, such as any of the following information:
“(A) A metric maintained by such developer in the ordinary course of business relating to such utilization.
“(B) An estimate of the extent to which an artificial intelligence system was so utilized without human review.
“(C) A description of the methodology utilized to develop such estimate.
“(2) Such evaluation includes an evaluation of the capabilities, if any, of such frontier artificial intelligence system to autonomously facilitate or conduct research on or development of an artificial intelligence system.”