<STYLE><!--U {color: Green}S {color: RED} I {color: DARKBLUE; background-color:yellow} P.brk {page-break-before:always}--></STYLE> <BASEFONT SIZE=3> <PRE WIDTH="99"> <FONT SIZE=5><B> STATE OF NEW YORK</B></FONT> ________________________________________________________________________ 6540--A 2025-2026 Regular Sessions <FONT SIZE=5><B> IN ASSEMBLY</B></FONT> March 5, 2025 ___________ Introduced by M. of A. BORES -- read once and referred to the Committee on Science and Technology -- committee discharged, bill amended, ordered reprinted as amended and recommitted to said committee AN ACT to amend the general business law, in relation to requiring generative artificial intelligence providers to include provenance data on synthetic content produced or modified by a generative artifi- cial intelligence system that the generative artificial intelligence provider makes available; and providing for the repeal of such provisions upon the expiration thereof <B><U>The People of the State of New York, represented in Senate and Assem-</U></B> <B><U>bly, do enact as follows:</U></B> 1 Section 1. This act shall be known and may be cited as the "stop deep- 2 fakes act". 3 § 2. The general business law is amended by adding a new article 45-A 4 to read as follows: 5 <B><U>ARTICLE 45-A</U></B> 6 <B><U>STOP DEEPFAKES ACT</U></B> 7 <B><U>Section 1510. Definitions.</U></B> 8 <B><U>1511. Generative artificial intelligence.</U></B> 9 <B><U>1512. Content provenance preservation.</U></B> 10 <B><U>1513. Provenance data requirements.</U></B> 11 <B><U>1514. Enforcement by attorney general.</U></B> 12 <B><U>§ 1510. Definitions. For the purposes of this article:</U></B> 13 <B><U>1. "Provenance data" means data that records the origin or history of</U></B> 14 <B><U>digital content and is communicated as a content credential pursuant to</U></B> 15 <B><U>the Technical Specification for Content Credentials published by the</U></B> 16 <B><U>Coalition for Content Provenance and Authenticity, and which discloses:</U></B> 17 <B><U>(a) information about the origin or creation of the content; (b) any</U></B> 18 <B><U>subsequent editing or modification to the content or its metadata; and</U></B> 19 <B><U>(c) any use of generative artificial intelligence in generating or modi-</U></B> 20 <B><U>fying the content. "Provenance data" does not include personal informa-</U></B> EXPLANATION--Matter in <B><U>italics</U></B> (underscored) is new; matter in brackets [<B><S> </S></B>] is old law to be omitted. LBD07930-05-5 </PRE><P CLASS="brk"><PRE WIDTH="99"> A. 6540--A 2 1 <B><U>tion as defined in subdivision five of section two hundred two of the</U></B> 2 <B><U>state technology law, or unique device, system, or service information</U></B> 3 <B><U>that is reasonably capable of being associated with a particular user,</U></B> 4 <B><U>including but not limited to an internet protocol address.</U></B> 5 <B><U>2. "Generative artificial intelligence system" means a class of AI</U></B> 6 <B><U>model that is self-supervised and emulates the structure and character-</U></B> 7 <B><U>istics of input data to generate derived synthetic content, including,</U></B> 8 <B><U>but not limited to, images, videos, audio, text, and other digital</U></B> 9 <B><U>content.</U></B> 10 <B><U>3. "Synthetic content" means audio, images or videos that have been</U></B> 11 <B><U>produced or significantly modified by a generative artificial intelli-</U></B> 12 <B><U>gence system.</U></B> 13 <B><U>4. "State agency" shall have the same meaning as defined in subdivi-</U></B> 14 <B><U>sion six of section two hundred two of the state technology law.</U></B> 15 <B><U>5. "Generative artificial intelligence provider" means an organization</U></B> 16 <B><U>or individual that creates, codes, substantially modifies, or otherwise</U></B> 17 <B><U>produces a generative artificial intelligence system that is made</U></B> 18 <B><U>publicly available for use by a New York resident, regardless of whether</U></B> 19 <B><U>the terms of such use include compensation.</U></B> 20 <B><U>6. "Generative artificial intelligence hosting platform" means an</U></B> 21 <B><U>online repository or other website that makes a generative artificial</U></B> 22 <B><U>intelligence system available for use by a New York resident, regardless</U></B> 23 <B><U>of whether the terms of such use include compensation. Generative arti-</U></B> 24 <B><U>ficial intelligence hosting platform does not include cloud computing</U></B> 25 <B><U>platforms or other services that make generative artificial intelligence</U></B> 26 <B><U>systems available for use by a New York state resident solely at the</U></B> 27 <B><U>direction of others.</U></B> 28 <B><U>7. "Social media platform" shall have the same meaning as in section</U></B> 29 <B><U>eleven hundred of this chapter.</U></B> 30 <B><U>8. "Covered operator" shall mean any person, business, or other legal</U></B> 31 <B><U>entity, that operates or provides a social media platform.</U></B> 32 <B><U>9. "Covered user" shall mean a user of a social media platform in the</U></B> 33 <B><U>state, not acting as an operator, or agent or affiliate of the operator</U></B> 34 <B><U>of such social media platform or any portion thereof.</U></B> 35 <B><U>10. "Artificial intelligence" or "artificial intelligence technology"</U></B> 36 <B><U>means a machine-based system that can, for a given set of human-defined</U></B> 37 <B><U>objectives, make predictions, recommendations, or decisions influencing</U></B> 38 <B><U>real or virtual environments, and that uses machine- and human-based</U></B> 39 <B><U>inputs to perceive real and virtual environments, abstract such percep-</U></B> 40 <B><U>tions into models through analysis in an automated manner, and use model</U></B> 41 <B><U>inference to formulate options for information or action.</U></B> 42 <B><U>11. "AI model" means an information system or a component of an infor-</U></B> 43 <B><U>mation system that implements artificial intelligence technology and</U></B> 44 <B><U>uses computational, statistical, or machine-learning techniques to</U></B> 45 <B><U>produce outputs from a given set of inputs.</U></B> 46 <B><U>§ 1511. Generative artificial intelligence. 1. A generative artificial</U></B> 47 <B><U>intelligence provider shall apply provenance data, either directly or</U></B> 48 <B><U>through the use of third-party technology, to synthetic content produced</U></B> 49 <B><U>or modified by a generative artificial intelligence system that the</U></B> 50 <B><U>generative artificial intelligence provider makes available.</U></B> 51 <B><U>2. The application of provenance data to synthetic content, as</U></B> 52 <B><U>required by this section, shall, at a minimum, identify the digital</U></B> 53 <B><U>content as synthetic and communicate the following provenance data:</U></B> 54 <B><U>(a) that the content was created or edited using artificial intelli-</U></B> 55 <B><U>gence;</U></B> 56 <B><U>(b) the name of the generative artificial intelligence provider;</U></B> </PRE><P CLASS="brk"><PRE WIDTH="99"> A. 6540--A 3 1 <B><U>(c) the time and date the provenance data was applied;</U></B> 2 <B><U>(d) the specific portions of the content that are synthetic;</U></B> 3 <B><U>(e) the type of device, system, or service that was used to generate</U></B> 4 <B><U>the image, audio, or video, to the extent that the device, system, or</U></B> 5 <B><U>service has the technical capability to generate; and</U></B> 6 <B><U>(f) any other additional provenance data specified in regulations</U></B> 7 <B><U>promulgated pursuant to this article by the attorney general.</U></B> 8 <B><U>3. Generative artificial intelligence hosting platforms shall not make</U></B> 9 <B><U>available a generative artificial intelligence system where the hosting</U></B> 10 <B><U>platform knows that the generative artificial intelligence provider for</U></B> 11 <B><U>the generative artificial intelligence system does not apply provenance</U></B> 12 <B><U>data to content created or substantially modified by the artificial</U></B> 13 <B><U>intelligence system in a manner consistent with specifications set forth</U></B> 14 <B><U>above, nor shall a generative artificial intelligence hosting platform</U></B> 15 <B><U>deliberately prevent a generative artificial intelligence provider from</U></B> 16 <B><U>applying provenance data to content created or substantially modified by</U></B> 17 <B><U>a generative artificial intelligence system in a manner consistent with</U></B> 18 <B><U>the specifications set forth above.</U></B> 19 <B><U>4. The provisions of this section shall only apply to generative arti-</U></B> 20 <B><U>ficial intelligence systems that were created or modified after the</U></B> 21 <B><U>effective date of this article.</U></B> 22 <B><U>§ 1512. Content provenance preservation. A social media platform shall</U></B> 23 <B><U>not delete, disassociate, or degrade, in whole or in part, provenance</U></B> 24 <B><U>data from or associated with content uploaded to the social media plat-</U></B> 25 <B><U>form by a covered user, unless and until the content is permanently</U></B> 26 <B><U>deleted or removed from the social media platform or the deletion,</U></B> 27 <B><U>disassociation, or degradation of such content is required by law.</U></B> 28 <B><U>§ 1513. Provenance data requirements. 1. A state agency shall ensure,</U></B> 29 <B><U>to the extent practicable either through direct application or through</U></B> 30 <B><U>the use of third-party technology, that all audio, images and videos</U></B> 31 <B><U>published or distributed electronically by the state agency carry prove-</U></B> 32 <B><U>nance data.</U></B> 33 <B><U>2. The application of provenance data to audio, images and videos, as</U></B> 34 <B><U>required by this article, shall, at a minimum, communicate the following</U></B> 35 <B><U>provenance data:</U></B> 36 <B><U>(a) The type of device, system, or service that was used to generate</U></B> 37 <B><U>the audio, image or video, to the extent the device, system, or service</U></B> 38 <B><U>has the technical capability to generate provenance data at the time the</U></B> 39 <B><U>audio, image or video was generated;</U></B> 40 <B><U>(b) The specific portions of the audio, image or video that are</U></B> 41 <B><U>synthetic content, if any;</U></B> 42 <B><U>(c) Whether the content was created or edited using artificial intel-</U></B> 43 <B><U>ligence;</U></B> 44 <B><U>(d) The name of the generative artificial intelligence provider used</U></B> 45 <B><U>to generate the synthetic content, if any;</U></B> 46 <B><U>(e) The time and date any of the provenance data delineated in this</U></B> 47 <B><U>section was applied; and</U></B> 48 <B><U>(f) Any other additional provenance data specified in regulations</U></B> 49 <B><U>promulgated pursuant to this article.</U></B> 50 <B><U>§ 1514. Enforcement by attorney general. In addition to the other</U></B> 51 <B><U>remedies provided, whenever there shall be a violation of this article,</U></B> 52 <B><U>application may be made by the attorney general in the name of the</U></B> 53 <B><U>people of the state of New York to a court or justice having jurisdic-</U></B> 54 <B><U>tion by a special proceeding to issue an injunction, and upon notice to</U></B> 55 <B><U>the defendant of not less than five days, to enjoin and restrain the</U></B> 56 <B><U>continuance of such violations; and if it shall appear to the satisfac-</U></B> </PRE><P CLASS="brk"><PRE WIDTH="99"> A. 6540--A 4 1 <B><U>tion of the court or justice that the defendant has, in fact, violated</U></B> 2 <B><U>this article, an injunction may be issued by such court or justice,</U></B> 3 <B><U>enjoining and restraining any further violation, without requiring proof</U></B> 4 <B><U>that any person has, in fact, been injured or damaged thereby. In any</U></B> 5 <B><U>such proceeding, the court may make allowances to the attorney general</U></B> 6 <B><U>as provided in paragraph six of subdivision (a) of section eighty-three</U></B> 7 <B><U>hundred three of the civil practice law and rules. Whenever the court</U></B> 8 <B><U>shall determine that a violation of this article has occurred, the court</U></B> 9 <B><U>may impose a civil penalty of not more than twenty-five thousand dollars</U></B> 10 <B><U>for each violation.</U></B> 11 § 3. This act shall take effect on the one hundred eightieth day after 12 it shall have become a law and shall expire and be deemed repealed 13 December 31, 2030. Effective immediately, the addition, amendment 14 and/or repeal of any rule or regulation necessary for the implementation 15 of this act on its effective date are authorized to be made and 16 completed on or before such effective date.