| 1 | | - | Senate Bill No. 896 CHAPTER 928An act to add Chapter 5.9 (commencing with Section 11549.63) to Part 1 of Division 3 of Title 2 of the Government Code, relating to artificial intelligence. [ Approved by Governor September 29, 2024. Filed with Secretary of State September 29, 2024. ] LEGISLATIVE COUNSEL'S DIGESTSB 896, Dodd. Generative Artificial Intelligence Accountability Act.Existing law requires the Secretary of Government Operations to develop a coordinated plan to, among other things, investigate the feasibility of, and obstacles to, developing standards and technologies for state departments to determine digital content provenance. For the purpose of informing that coordinated plan, existing law requires the secretary to evaluate, among other things, the impact of the proliferation of deepfakes, defined to mean audio or visual content that has been generated or manipulated by artificial intelligence that would falsely appear to be authentic or truthful and that features depictions of people appearing to say or do things they did not say or do without their consent, on state government, California-based businesses, and residents of the state.This bill, the Generative Artificial Intelligence Accountability Act, would, among other things, require the Department of Technology, under the guidance of the Government Operations Agency, the Office of Data and Innovation, and the Department of Human Resources, to update the report to the Governor, as required by Executive Order No. N-12-23, as prescribed. The bill would require the Office of Emergency Services to, as appropriate, perform a risk analysis of potential threats posed by the use of generative artificial intelligence to Californias critical infrastructure, including those that could lead to mass casualty events and would require a high-level summary of the analysis be provided annually to the Legislature.This bill would also require a state agency or department that utilizes generative artificial intelligence to directly communicate with a person regarding government services and benefits to ensure that those communications include both (1) a disclaimer that indicates to the person that the communication was generated by generative artificial intelligence and (2) information, as specified, describing how the person may contact a human employee of the state agency or department.Digest Key Vote: MAJORITY Appropriation: NO Fiscal Committee: YES Local Program: NO Bill TextThe people of the State of California do enact as follows:SECTION 1. This act shall be known as the Generative Artificial Intelligence Accountability Act.SEC. 2. Chapter 5.9 (commencing with Section 11549.63) is added to Part 1 of Division 3 of Title 2 of the Government Code, to read: CHAPTER 5.9. Generative Artificial Intelligence Tools11549.63. The Legislature finds and declares all of the following:(a) The Legislature recognizes the tremendous potential of artificial intelligence (AI) to improve the lives of its citizens and the functioning of government. However, the Legislature also recognizes that the use of AI must be guided by principles of fairness, transparency, privacy, and accountability to ensure that the rights and opportunities of all Californians are protected in the age of artificial intelligence.(b) The Legislature further recognizes that generative artificial intelligence (GenAI) enables significant, beneficial uses through its unique capabilities, but GenAI raises novel risks compared to conventional AI across critical areas, including democratic and legal processes, biases and equity, public health and safety, and the economy, and requires measures to address insufficiently guarded governmental systems and unintended or emergent harmful effects from this technology. Additionally, because humans have explicit and implicit biases built into our society, GenAI has the capacity to amplify these biases as it learns from input data. Therefore, it is imperative to consider the implications on Californians of, among other categories, different regions, income, races, ethnicities, gender, ages, religions, abilities, and sexual orientation for all GenAI inputs, outputs, and products for both prioritizing implementations that may promote equity and guarding against bias and other negative impacts.(c) No individual or group should be discriminated against on the basis of race, gender, age, religion, sexual orientation, or any other protected characteristic in the design, development, deployment, or use of AI systems. The unprecedented speed of innovation and deployment of GenAI technologies necessitates proactive guardrails to protect against potential risks or malicious uses, including, but not limited to, bioterrorism, cyberattacks, disinformation, deception, violation of privacy, and discrimination or bias.(d) The Legislature affirms the importance of transparency in the use of GenAI systems. The public has the right to know when they are interacting with GenAI being used by the state and to have an accessible identification of that interaction.(e) The Legislature recognizes that the use of GenAI systems must be consistent with the protection of privacy and civil liberties and must be guided by a commitment to equity and social justice. It is the intent of the Legislature in enacting this legislation that all GenAI systems be designed and deployed in a manner that is consistent with state and federal laws and regulations regarding privacy and civil liberties and minimizes bias and promotes equitable outcomes for all Californians.(f) This act, in addition to the 2022 White House Blueprint for an AI Bill of Rights, executive guidance from the governor, statutory or regulatory requirements, and evolving best practices should guide the decisionmaking of state agencies, departments, and subdivisions in the review, adoption, management, governance, and regulations of automated decisionmaking technologies.(g) Public-private cross-sectional partnerships should be established to train students to meet the GenAI workforce development needs of the state, including providing instruction on AI and related ethical, privacy, and security considerations while advancing research on best practices. Further, there is the need for the state to recruit, retain, and train GenAI professionals in certain state jobs, and agencies should collaborate to facilitate a pipeline and infrastructure to accomplish that goal.(h) State agencies, departments, and boards should utilize their authority to protect consumers, patients, passengers, and students from fraud, discrimination, and threats to privacy and to address other risks that may arise from the use of GenAI, including risks to financial stability. State agencies, departments, and boards should consider rulemaking and emphasize or clarify if existing regulations and guidance apply to GenAI or other automated decisionmaking systems.11549.64. As used in this chapter:(a) Artificial intelligence means an engineered or machine-based system that varies in its level of autonomy and that can, for explicit or implicit objectives, infer from the input it receives how to generate outputs that can influence physical or virtual environments.(b) Generative artificial intelligence or GenAI means an artificial intelligence system that can generate derived synthetic content, including text, images, video, and audio that emulates the structure and characteristics of the systems training data.(c) Person means a natural person.(d) Report means the report to the Governor required by Executive Order No. N-12-23.11549.65. (a) The Department of Technology, under the guidance of the Government Operations Agency, the Office of Data and Innovation, and the Department of Human Resources, shall update the report, as needed, to respond to significant developments and shall, as appropriate, consult with academia, industry experts, and organizations that represent state exclusive employee representatives.(b) (1) The Office of Emergency Services shall, as appropriate, perform a risk analysis of potential threats posed by the use of GenAI to Californias critical infrastructure, including those that could lead to mass casualty events.(2) The analysis required by paragraph (1) shall be provided to the Governor, and, if appropriate, shall include recommendations reflecting changes to artificial intelligence technology, its applications, and risk management, including further private actions, administrative actions, and collaboration with the Legislature to guard against potential threats and vulnerabilities.(3) A high-level summary of the analysis required by paragraph (1) shall be submitted annually to the Legislature.(c) Any state agency or department shall consider procurement and enterprise use opportunities in which GenAI can improve the efficiency, effectiveness, accessibility, and equity of government operations consistent with the Government Operations Agency, the Department of General Services, and the Department of Technologys policies for public sector GenAI procurement.(d) Legal counsel for any state agency or department shall consider any potential impact of GenAI on regulatory issues under the respective agencys or departments authority and recommend necessary updates, if appropriate, as a result of this evolving technology.11549.66. A state agency or department that utilizes GenAI to directly communicate with a person regarding government services and benefits shall ensure that those communications include both of the following:(a) A disclaimer that indicates to the person that the communication was generated by GenAI.(1) For written communications involving physical and digital media, including letters, email, and other occasional messages, the disclaimer shall appear prominently at the start of each communication.(2) For written communications involving continuous online interactions, including interactions with chatbots, the disclaimer shall be prominently displayed throughout the interaction.(3) For audio communications, the disclaimer shall be provided verbally at the start and end of the interaction.(4) For video communications, the disclaimer shall be prominently displayed throughout the interaction.(b) Information, or a link to an internet website containing information, describing how the person may contact a human employee of the state agency or department. |
|---|
| 1 | + | Enrolled August 30, 2024 Passed IN Senate August 28, 2024 Passed IN Assembly August 26, 2024 Amended IN Assembly August 19, 2024 Amended IN Assembly July 03, 2024 Amended IN Assembly June 04, 2024 Amended IN Senate May 16, 2024 Amended IN Senate April 10, 2024 CALIFORNIA LEGISLATURE 20232024 REGULAR SESSION Senate Bill No. 896Introduced by Senator Dodd(Coauthor: Senator Rubio)(Coauthors: Assembly Members Low, Mathis, and Weber)January 03, 2024An act to add Chapter 5.9 (commencing with Section 11549.63) to Part 1 of Division 3 of Title 2 of the Government Code, relating to artificial intelligence.LEGISLATIVE COUNSEL'S DIGESTSB 896, Dodd. Generative Artificial Intelligence Accountability Act.Existing law requires the Secretary of Government Operations to develop a coordinated plan to, among other things, investigate the feasibility of, and obstacles to, developing standards and technologies for state departments to determine digital content provenance. For the purpose of informing that coordinated plan, existing law requires the secretary to evaluate, among other things, the impact of the proliferation of deepfakes, defined to mean audio or visual content that has been generated or manipulated by artificial intelligence that would falsely appear to be authentic or truthful and that features depictions of people appearing to say or do things they did not say or do without their consent, on state government, California-based businesses, and residents of the state.This bill, the Generative Artificial Intelligence Accountability Act, would, among other things, require the Department of Technology, under the guidance of the Government Operations Agency, the Office of Data and Innovation, and the Department of Human Resources, to update the report to the Governor, as required by Executive Order No. N-12-23, as prescribed. The bill would require the Office of Emergency Services to, as appropriate, perform a risk analysis of potential threats posed by the use of generative artificial intelligence to Californias critical infrastructure, including those that could lead to mass casualty events and would require a high-level summary of the analysis be provided annually to the Legislature.This bill would also require a state agency or department that utilizes generative artificial intelligence to directly communicate with a person regarding government services and benefits to ensure that those communications include both (1) a disclaimer that indicates to the person that the communication was generated by generative artificial intelligence and (2) information, as specified, describing how the person may contact a human employee of the state agency or department.Digest Key Vote: MAJORITY Appropriation: NO Fiscal Committee: YES Local Program: NO Bill TextThe people of the State of California do enact as follows:SECTION 1. This act shall be known as the Generative Artificial Intelligence Accountability Act.SEC. 2. Chapter 5.9 (commencing with Section 11549.63) is added to Part 1 of Division 3 of Title 2 of the Government Code, to read: CHAPTER 5.9. Generative Artificial Intelligence Tools11549.63. The Legislature finds and declares all of the following:(a) The Legislature recognizes the tremendous potential of artificial intelligence (AI) to improve the lives of its citizens and the functioning of government. However, the Legislature also recognizes that the use of AI must be guided by principles of fairness, transparency, privacy, and accountability to ensure that the rights and opportunities of all Californians are protected in the age of artificial intelligence.(b) The Legislature further recognizes that generative artificial intelligence (GenAI) enables significant, beneficial uses through its unique capabilities, but GenAI raises novel risks compared to conventional AI across critical areas, including democratic and legal processes, biases and equity, public health and safety, and the economy, and requires measures to address insufficiently guarded governmental systems and unintended or emergent harmful effects from this technology. Additionally, because humans have explicit and implicit biases built into our society, GenAI has the capacity to amplify these biases as it learns from input data. Therefore, it is imperative to consider the implications on Californians of, among other categories, different regions, income, races, ethnicities, gender, ages, religions, abilities, and sexual orientation for all GenAI inputs, outputs, and products for both prioritizing implementations that may promote equity and guarding against bias and other negative impacts.(c) No individual or group should be discriminated against on the basis of race, gender, age, religion, sexual orientation, or any other protected characteristic in the design, development, deployment, or use of AI systems. The unprecedented speed of innovation and deployment of GenAI technologies necessitates proactive guardrails to protect against potential risks or malicious uses, including, but not limited to, bioterrorism, cyberattacks, disinformation, deception, violation of privacy, and discrimination or bias.(d) The Legislature affirms the importance of transparency in the use of GenAI systems. The public has the right to know when they are interacting with GenAI being used by the state and to have an accessible identification of that interaction.(e) The Legislature recognizes that the use of GenAI systems must be consistent with the protection of privacy and civil liberties and must be guided by a commitment to equity and social justice. It is the intent of the Legislature in enacting this legislation that all GenAI systems be designed and deployed in a manner that is consistent with state and federal laws and regulations regarding privacy and civil liberties and minimizes bias and promotes equitable outcomes for all Californians.(f) This act, in addition to the 2022 White House Blueprint for an AI Bill of Rights, executive guidance from the governor, statutory or regulatory requirements, and evolving best practices should guide the decisionmaking of state agencies, departments, and subdivisions in the review, adoption, management, governance, and regulations of automated decisionmaking technologies.(g) Public-private cross-sectional partnerships should be established to train students to meet the GenAI workforce development needs of the state, including providing instruction on AI and related ethical, privacy, and security considerations while advancing research on best practices. Further, there is the need for the state to recruit, retain, and train GenAI professionals in certain state jobs, and agencies should collaborate to facilitate a pipeline and infrastructure to accomplish that goal.(h) State agencies, departments, and boards should utilize their authority to protect consumers, patients, passengers, and students from fraud, discrimination, and threats to privacy and to address other risks that may arise from the use of GenAI, including risks to financial stability. State agencies, departments, and boards should consider rulemaking and emphasize or clarify if existing regulations and guidance apply to GenAI or other automated decisionmaking systems.11549.64. As used in this chapter:(a) Artificial intelligence means an engineered or machine-based system that varies in its level of autonomy and that can, for explicit or implicit objectives, infer from the input it receives how to generate outputs that can influence physical or virtual environments.(b) Generative artificial intelligence or GenAI means an artificial intelligence system that can generate derived synthetic content, including text, images, video, and audio that emulates the structure and characteristics of the systems training data.(c) Person means a natural person.(d) Report means the report to the Governor required by Executive Order No. N-12-23.11549.65. (a) The Department of Technology, under the guidance of the Government Operations Agency, the Office of Data and Innovation, and the Department of Human Resources, shall update the report, as needed, to respond to significant developments and shall, as appropriate, consult with academia, industry experts, and organizations that represent state exclusive employee representatives.(b) (1) The Office of Emergency Services shall, as appropriate, perform a risk analysis of potential threats posed by the use of GenAI to Californias critical infrastructure, including those that could lead to mass casualty events.(2) The analysis required by paragraph (1) shall be provided to the Governor, and, if appropriate, shall include recommendations reflecting changes to artificial intelligence technology, its applications, and risk management, including further private actions, administrative actions, and collaboration with the Legislature to guard against potential threats and vulnerabilities.(3) A high-level summary of the analysis required by paragraph (1) shall be submitted annually to the Legislature.(c) Any state agency or department shall consider procurement and enterprise use opportunities in which GenAI can improve the efficiency, effectiveness, accessibility, and equity of government operations consistent with the Government Operations Agency, the Department of General Services, and the Department of Technologys policies for public sector GenAI procurement.(d) Legal counsel for any state agency or department shall consider any potential impact of GenAI on regulatory issues under the respective agencys or departments authority and recommend necessary updates, if appropriate, as a result of this evolving technology.11549.66. A state agency or department that utilizes GenAI to directly communicate with a person regarding government services and benefits shall ensure that those communications include both of the following:(a) A disclaimer that indicates to the person that the communication was generated by GenAI.(1) For written communications involving physical and digital media, including letters, email, and other occasional messages, the disclaimer shall appear prominently at the start of each communication.(2) For written communications involving continuous online interactions, including interactions with chatbots, the disclaimer shall be prominently displayed throughout the interaction.(3) For audio communications, the disclaimer shall be provided verbally at the start and end of the interaction.(4) For video communications, the disclaimer shall be prominently displayed throughout the interaction.(b) Information, or a link to an internet website containing information, describing how the person may contact a human employee of the state agency or department. |
|---|
| 14 | 28 | | |
|---|
| 15 | 29 | | LEGISLATIVE COUNSEL'S DIGEST |
|---|
| 16 | 30 | | |
|---|
| 17 | 31 | | ## LEGISLATIVE COUNSEL'S DIGEST |
|---|
| 18 | 32 | | |
|---|
| 19 | 33 | | SB 896, Dodd. Generative Artificial Intelligence Accountability Act. |
|---|
| 20 | 34 | | |
|---|
| 21 | 35 | | Existing law requires the Secretary of Government Operations to develop a coordinated plan to, among other things, investigate the feasibility of, and obstacles to, developing standards and technologies for state departments to determine digital content provenance. For the purpose of informing that coordinated plan, existing law requires the secretary to evaluate, among other things, the impact of the proliferation of deepfakes, defined to mean audio or visual content that has been generated or manipulated by artificial intelligence that would falsely appear to be authentic or truthful and that features depictions of people appearing to say or do things they did not say or do without their consent, on state government, California-based businesses, and residents of the state.This bill, the Generative Artificial Intelligence Accountability Act, would, among other things, require the Department of Technology, under the guidance of the Government Operations Agency, the Office of Data and Innovation, and the Department of Human Resources, to update the report to the Governor, as required by Executive Order No. N-12-23, as prescribed. The bill would require the Office of Emergency Services to, as appropriate, perform a risk analysis of potential threats posed by the use of generative artificial intelligence to Californias critical infrastructure, including those that could lead to mass casualty events and would require a high-level summary of the analysis be provided annually to the Legislature.This bill would also require a state agency or department that utilizes generative artificial intelligence to directly communicate with a person regarding government services and benefits to ensure that those communications include both (1) a disclaimer that indicates to the person that the communication was generated by generative artificial intelligence and (2) information, as specified, describing how the person may contact a human employee of the state agency or department. |
|---|
| 22 | 36 | | |
|---|
| 23 | 37 | | Existing law requires the Secretary of Government Operations to develop a coordinated plan to, among other things, investigate the feasibility of, and obstacles to, developing standards and technologies for state departments to determine digital content provenance. For the purpose of informing that coordinated plan, existing law requires the secretary to evaluate, among other things, the impact of the proliferation of deepfakes, defined to mean audio or visual content that has been generated or manipulated by artificial intelligence that would falsely appear to be authentic or truthful and that features depictions of people appearing to say or do things they did not say or do without their consent, on state government, California-based businesses, and residents of the state. |
|---|
| 24 | 38 | | |
|---|
| 25 | 39 | | This bill, the Generative Artificial Intelligence Accountability Act, would, among other things, require the Department of Technology, under the guidance of the Government Operations Agency, the Office of Data and Innovation, and the Department of Human Resources, to update the report to the Governor, as required by Executive Order No. N-12-23, as prescribed. The bill would require the Office of Emergency Services to, as appropriate, perform a risk analysis of potential threats posed by the use of generative artificial intelligence to Californias critical infrastructure, including those that could lead to mass casualty events and would require a high-level summary of the analysis be provided annually to the Legislature. |
|---|
| 26 | 40 | | |
|---|
| 27 | 41 | | This bill would also require a state agency or department that utilizes generative artificial intelligence to directly communicate with a person regarding government services and benefits to ensure that those communications include both (1) a disclaimer that indicates to the person that the communication was generated by generative artificial intelligence and (2) information, as specified, describing how the person may contact a human employee of the state agency or department. |
|---|
| 28 | 42 | | |
|---|
| 29 | 43 | | ## Digest Key |
|---|
| 30 | 44 | | |
|---|
| 31 | 45 | | ## Bill Text |
|---|
| 32 | 46 | | |
|---|
| 33 | 47 | | The people of the State of California do enact as follows:SECTION 1. This act shall be known as the Generative Artificial Intelligence Accountability Act.SEC. 2. Chapter 5.9 (commencing with Section 11549.63) is added to Part 1 of Division 3 of Title 2 of the Government Code, to read: CHAPTER 5.9. Generative Artificial Intelligence Tools11549.63. The Legislature finds and declares all of the following:(a) The Legislature recognizes the tremendous potential of artificial intelligence (AI) to improve the lives of its citizens and the functioning of government. However, the Legislature also recognizes that the use of AI must be guided by principles of fairness, transparency, privacy, and accountability to ensure that the rights and opportunities of all Californians are protected in the age of artificial intelligence.(b) The Legislature further recognizes that generative artificial intelligence (GenAI) enables significant, beneficial uses through its unique capabilities, but GenAI raises novel risks compared to conventional AI across critical areas, including democratic and legal processes, biases and equity, public health and safety, and the economy, and requires measures to address insufficiently guarded governmental systems and unintended or emergent harmful effects from this technology. Additionally, because humans have explicit and implicit biases built into our society, GenAI has the capacity to amplify these biases as it learns from input data. Therefore, it is imperative to consider the implications on Californians of, among other categories, different regions, income, races, ethnicities, gender, ages, religions, abilities, and sexual orientation for all GenAI inputs, outputs, and products for both prioritizing implementations that may promote equity and guarding against bias and other negative impacts.(c) No individual or group should be discriminated against on the basis of race, gender, age, religion, sexual orientation, or any other protected characteristic in the design, development, deployment, or use of AI systems. The unprecedented speed of innovation and deployment of GenAI technologies necessitates proactive guardrails to protect against potential risks or malicious uses, including, but not limited to, bioterrorism, cyberattacks, disinformation, deception, violation of privacy, and discrimination or bias.(d) The Legislature affirms the importance of transparency in the use of GenAI systems. The public has the right to know when they are interacting with GenAI being used by the state and to have an accessible identification of that interaction.(e) The Legislature recognizes that the use of GenAI systems must be consistent with the protection of privacy and civil liberties and must be guided by a commitment to equity and social justice. It is the intent of the Legislature in enacting this legislation that all GenAI systems be designed and deployed in a manner that is consistent with state and federal laws and regulations regarding privacy and civil liberties and minimizes bias and promotes equitable outcomes for all Californians.(f) This act, in addition to the 2022 White House Blueprint for an AI Bill of Rights, executive guidance from the governor, statutory or regulatory requirements, and evolving best practices should guide the decisionmaking of state agencies, departments, and subdivisions in the review, adoption, management, governance, and regulations of automated decisionmaking technologies.(g) Public-private cross-sectional partnerships should be established to train students to meet the GenAI workforce development needs of the state, including providing instruction on AI and related ethical, privacy, and security considerations while advancing research on best practices. Further, there is the need for the state to recruit, retain, and train GenAI professionals in certain state jobs, and agencies should collaborate to facilitate a pipeline and infrastructure to accomplish that goal.(h) State agencies, departments, and boards should utilize their authority to protect consumers, patients, passengers, and students from fraud, discrimination, and threats to privacy and to address other risks that may arise from the use of GenAI, including risks to financial stability. State agencies, departments, and boards should consider rulemaking and emphasize or clarify if existing regulations and guidance apply to GenAI or other automated decisionmaking systems.11549.64. As used in this chapter:(a) Artificial intelligence means an engineered or machine-based system that varies in its level of autonomy and that can, for explicit or implicit objectives, infer from the input it receives how to generate outputs that can influence physical or virtual environments.(b) Generative artificial intelligence or GenAI means an artificial intelligence system that can generate derived synthetic content, including text, images, video, and audio that emulates the structure and characteristics of the systems training data.(c) Person means a natural person.(d) Report means the report to the Governor required by Executive Order No. N-12-23.11549.65. (a) The Department of Technology, under the guidance of the Government Operations Agency, the Office of Data and Innovation, and the Department of Human Resources, shall update the report, as needed, to respond to significant developments and shall, as appropriate, consult with academia, industry experts, and organizations that represent state exclusive employee representatives.(b) (1) The Office of Emergency Services shall, as appropriate, perform a risk analysis of potential threats posed by the use of GenAI to Californias critical infrastructure, including those that could lead to mass casualty events.(2) The analysis required by paragraph (1) shall be provided to the Governor, and, if appropriate, shall include recommendations reflecting changes to artificial intelligence technology, its applications, and risk management, including further private actions, administrative actions, and collaboration with the Legislature to guard against potential threats and vulnerabilities.(3) A high-level summary of the analysis required by paragraph (1) shall be submitted annually to the Legislature.(c) Any state agency or department shall consider procurement and enterprise use opportunities in which GenAI can improve the efficiency, effectiveness, accessibility, and equity of government operations consistent with the Government Operations Agency, the Department of General Services, and the Department of Technologys policies for public sector GenAI procurement.(d) Legal counsel for any state agency or department shall consider any potential impact of GenAI on regulatory issues under the respective agencys or departments authority and recommend necessary updates, if appropriate, as a result of this evolving technology.11549.66. A state agency or department that utilizes GenAI to directly communicate with a person regarding government services and benefits shall ensure that those communications include both of the following:(a) A disclaimer that indicates to the person that the communication was generated by GenAI.(1) For written communications involving physical and digital media, including letters, email, and other occasional messages, the disclaimer shall appear prominently at the start of each communication.(2) For written communications involving continuous online interactions, including interactions with chatbots, the disclaimer shall be prominently displayed throughout the interaction.(3) For audio communications, the disclaimer shall be provided verbally at the start and end of the interaction.(4) For video communications, the disclaimer shall be prominently displayed throughout the interaction.(b) Information, or a link to an internet website containing information, describing how the person may contact a human employee of the state agency or department. |
|---|
| 34 | 48 | | |
|---|
| 35 | 49 | | The people of the State of California do enact as follows: |
|---|
| 36 | 50 | | |
|---|
| 37 | 51 | | ## The people of the State of California do enact as follows: |
|---|
| 38 | 52 | | |
|---|
| 39 | 53 | | SECTION 1. This act shall be known as the Generative Artificial Intelligence Accountability Act. |
|---|
| 40 | 54 | | |
|---|
| 41 | 55 | | SECTION 1. This act shall be known as the Generative Artificial Intelligence Accountability Act. |
|---|
| 42 | 56 | | |
|---|
| 43 | 57 | | SECTION 1. This act shall be known as the Generative Artificial Intelligence Accountability Act. |
|---|
| 44 | 58 | | |
|---|
| 45 | 59 | | ### SECTION 1. |
|---|
| 46 | 60 | | |
|---|
| 47 | 61 | | SEC. 2. Chapter 5.9 (commencing with Section 11549.63) is added to Part 1 of Division 3 of Title 2 of the Government Code, to read: CHAPTER 5.9. Generative Artificial Intelligence Tools11549.63. The Legislature finds and declares all of the following:(a) The Legislature recognizes the tremendous potential of artificial intelligence (AI) to improve the lives of its citizens and the functioning of government. However, the Legislature also recognizes that the use of AI must be guided by principles of fairness, transparency, privacy, and accountability to ensure that the rights and opportunities of all Californians are protected in the age of artificial intelligence.(b) The Legislature further recognizes that generative artificial intelligence (GenAI) enables significant, beneficial uses through its unique capabilities, but GenAI raises novel risks compared to conventional AI across critical areas, including democratic and legal processes, biases and equity, public health and safety, and the economy, and requires measures to address insufficiently guarded governmental systems and unintended or emergent harmful effects from this technology. Additionally, because humans have explicit and implicit biases built into our society, GenAI has the capacity to amplify these biases as it learns from input data. Therefore, it is imperative to consider the implications on Californians of, among other categories, different regions, income, races, ethnicities, gender, ages, religions, abilities, and sexual orientation for all GenAI inputs, outputs, and products for both prioritizing implementations that may promote equity and guarding against bias and other negative impacts.(c) No individual or group should be discriminated against on the basis of race, gender, age, religion, sexual orientation, or any other protected characteristic in the design, development, deployment, or use of AI systems. The unprecedented speed of innovation and deployment of GenAI technologies necessitates proactive guardrails to protect against potential risks or malicious uses, including, but not limited to, bioterrorism, cyberattacks, disinformation, deception, violation of privacy, and discrimination or bias.(d) The Legislature affirms the importance of transparency in the use of GenAI systems. The public has the right to know when they are interacting with GenAI being used by the state and to have an accessible identification of that interaction.(e) The Legislature recognizes that the use of GenAI systems must be consistent with the protection of privacy and civil liberties and must be guided by a commitment to equity and social justice. It is the intent of the Legislature in enacting this legislation that all GenAI systems be designed and deployed in a manner that is consistent with state and federal laws and regulations regarding privacy and civil liberties and minimizes bias and promotes equitable outcomes for all Californians.(f) This act, in addition to the 2022 White House Blueprint for an AI Bill of Rights, executive guidance from the governor, statutory or regulatory requirements, and evolving best practices should guide the decisionmaking of state agencies, departments, and subdivisions in the review, adoption, management, governance, and regulations of automated decisionmaking technologies.(g) Public-private cross-sectional partnerships should be established to train students to meet the GenAI workforce development needs of the state, including providing instruction on AI and related ethical, privacy, and security considerations while advancing research on best practices. Further, there is the need for the state to recruit, retain, and train GenAI professionals in certain state jobs, and agencies should collaborate to facilitate a pipeline and infrastructure to accomplish that goal.(h) State agencies, departments, and boards should utilize their authority to protect consumers, patients, passengers, and students from fraud, discrimination, and threats to privacy and to address other risks that may arise from the use of GenAI, including risks to financial stability. State agencies, departments, and boards should consider rulemaking and emphasize or clarify if existing regulations and guidance apply to GenAI or other automated decisionmaking systems.11549.64. As used in this chapter:(a) Artificial intelligence means an engineered or machine-based system that varies in its level of autonomy and that can, for explicit or implicit objectives, infer from the input it receives how to generate outputs that can influence physical or virtual environments.(b) Generative artificial intelligence or GenAI means an artificial intelligence system that can generate derived synthetic content, including text, images, video, and audio that emulates the structure and characteristics of the systems training data.(c) Person means a natural person.(d) Report means the report to the Governor required by Executive Order No. N-12-23.11549.65. (a) The Department of Technology, under the guidance of the Government Operations Agency, the Office of Data and Innovation, and the Department of Human Resources, shall update the report, as needed, to respond to significant developments and shall, as appropriate, consult with academia, industry experts, and organizations that represent state exclusive employee representatives.(b) (1) The Office of Emergency Services shall, as appropriate, perform a risk analysis of potential threats posed by the use of GenAI to Californias critical infrastructure, including those that could lead to mass casualty events.(2) The analysis required by paragraph (1) shall be provided to the Governor, and, if appropriate, shall include recommendations reflecting changes to artificial intelligence technology, its applications, and risk management, including further private actions, administrative actions, and collaboration with the Legislature to guard against potential threats and vulnerabilities.(3) A high-level summary of the analysis required by paragraph (1) shall be submitted annually to the Legislature.(c) Any state agency or department shall consider procurement and enterprise use opportunities in which GenAI can improve the efficiency, effectiveness, accessibility, and equity of government operations consistent with the Government Operations Agency, the Department of General Services, and the Department of Technologys policies for public sector GenAI procurement.(d) Legal counsel for any state agency or department shall consider any potential impact of GenAI on regulatory issues under the respective agencys or departments authority and recommend necessary updates, if appropriate, as a result of this evolving technology.11549.66. A state agency or department that utilizes GenAI to directly communicate with a person regarding government services and benefits shall ensure that those communications include both of the following:(a) A disclaimer that indicates to the person that the communication was generated by GenAI.(1) For written communications involving physical and digital media, including letters, email, and other occasional messages, the disclaimer shall appear prominently at the start of each communication.(2) For written communications involving continuous online interactions, including interactions with chatbots, the disclaimer shall be prominently displayed throughout the interaction.(3) For audio communications, the disclaimer shall be provided verbally at the start and end of the interaction.(4) For video communications, the disclaimer shall be prominently displayed throughout the interaction.(b) Information, or a link to an internet website containing information, describing how the person may contact a human employee of the state agency or department. |
|---|
| 48 | 62 | | |
|---|
| 49 | 63 | | SEC. 2. Chapter 5.9 (commencing with Section 11549.63) is added to Part 1 of Division 3 of Title 2 of the Government Code, to read: |
|---|
| 50 | 64 | | |
|---|
| 51 | 65 | | ### SEC. 2. |
|---|
| 52 | 66 | | |
|---|
| 53 | 67 | | CHAPTER 5.9. Generative Artificial Intelligence Tools11549.63. The Legislature finds and declares all of the following:(a) The Legislature recognizes the tremendous potential of artificial intelligence (AI) to improve the lives of its citizens and the functioning of government. However, the Legislature also recognizes that the use of AI must be guided by principles of fairness, transparency, privacy, and accountability to ensure that the rights and opportunities of all Californians are protected in the age of artificial intelligence.(b) The Legislature further recognizes that generative artificial intelligence (GenAI) enables significant, beneficial uses through its unique capabilities, but GenAI raises novel risks compared to conventional AI across critical areas, including democratic and legal processes, biases and equity, public health and safety, and the economy, and requires measures to address insufficiently guarded governmental systems and unintended or emergent harmful effects from this technology. Additionally, because humans have explicit and implicit biases built into our society, GenAI has the capacity to amplify these biases as it learns from input data. Therefore, it is imperative to consider the implications on Californians of, among other categories, different regions, income, races, ethnicities, gender, ages, religions, abilities, and sexual orientation for all GenAI inputs, outputs, and products for both prioritizing implementations that may promote equity and guarding against bias and other negative impacts.(c) No individual or group should be discriminated against on the basis of race, gender, age, religion, sexual orientation, or any other protected characteristic in the design, development, deployment, or use of AI systems. The unprecedented speed of innovation and deployment of GenAI technologies necessitates proactive guardrails to protect against potential risks or malicious uses, including, but not limited to, bioterrorism, cyberattacks, disinformation, deception, violation of privacy, and discrimination or bias.(d) The Legislature affirms the importance of transparency in the use of GenAI systems. The public has the right to know when they are interacting with GenAI being used by the state and to have an accessible identification of that interaction.(e) The Legislature recognizes that the use of GenAI systems must be consistent with the protection of privacy and civil liberties and must be guided by a commitment to equity and social justice. It is the intent of the Legislature in enacting this legislation that all GenAI systems be designed and deployed in a manner that is consistent with state and federal laws and regulations regarding privacy and civil liberties and minimizes bias and promotes equitable outcomes for all Californians.(f) This act, in addition to the 2022 White House Blueprint for an AI Bill of Rights, executive guidance from the governor, statutory or regulatory requirements, and evolving best practices should guide the decisionmaking of state agencies, departments, and subdivisions in the review, adoption, management, governance, and regulations of automated decisionmaking technologies.(g) Public-private cross-sectional partnerships should be established to train students to meet the GenAI workforce development needs of the state, including providing instruction on AI and related ethical, privacy, and security considerations while advancing research on best practices. Further, there is the need for the state to recruit, retain, and train GenAI professionals in certain state jobs, and agencies should collaborate to facilitate a pipeline and infrastructure to accomplish that goal.(h) State agencies, departments, and boards should utilize their authority to protect consumers, patients, passengers, and students from fraud, discrimination, and threats to privacy and to address other risks that may arise from the use of GenAI, including risks to financial stability. State agencies, departments, and boards should consider rulemaking and emphasize or clarify if existing regulations and guidance apply to GenAI or other automated decisionmaking systems.11549.64. As used in this chapter:(a) Artificial intelligence means an engineered or machine-based system that varies in its level of autonomy and that can, for explicit or implicit objectives, infer from the input it receives how to generate outputs that can influence physical or virtual environments.(b) Generative artificial intelligence or GenAI means an artificial intelligence system that can generate derived synthetic content, including text, images, video, and audio that emulates the structure and characteristics of the systems training data.(c) Person means a natural person.(d) Report means the report to the Governor required by Executive Order No. N-12-23.11549.65. (a) The Department of Technology, under the guidance of the Government Operations Agency, the Office of Data and Innovation, and the Department of Human Resources, shall update the report, as needed, to respond to significant developments and shall, as appropriate, consult with academia, industry experts, and organizations that represent state exclusive employee representatives.(b) (1) The Office of Emergency Services shall, as appropriate, perform a risk analysis of potential threats posed by the use of GenAI to Californias critical infrastructure, including those that could lead to mass casualty events.(2) The analysis required by paragraph (1) shall be provided to the Governor, and, if appropriate, shall include recommendations reflecting changes to artificial intelligence technology, its applications, and risk management, including further private actions, administrative actions, and collaboration with the Legislature to guard against potential threats and vulnerabilities.(3) A high-level summary of the analysis required by paragraph (1) shall be submitted annually to the Legislature.(c) Any state agency or department shall consider procurement and enterprise use opportunities in which GenAI can improve the efficiency, effectiveness, accessibility, and equity of government operations consistent with the Government Operations Agency, the Department of General Services, and the Department of Technologys policies for public sector GenAI procurement.(d) Legal counsel for any state agency or department shall consider any potential impact of GenAI on regulatory issues under the respective agencys or departments authority and recommend necessary updates, if appropriate, as a result of this evolving technology.11549.66. A state agency or department that utilizes GenAI to directly communicate with a person regarding government services and benefits shall ensure that those communications include both of the following:(a) A disclaimer that indicates to the person that the communication was generated by GenAI.(1) For written communications involving physical and digital media, including letters, email, and other occasional messages, the disclaimer shall appear prominently at the start of each communication.(2) For written communications involving continuous online interactions, including interactions with chatbots, the disclaimer shall be prominently displayed throughout the interaction.(3) For audio communications, the disclaimer shall be provided verbally at the start and end of the interaction.(4) For video communications, the disclaimer shall be prominently displayed throughout the interaction.(b) Information, or a link to an internet website containing information, describing how the person may contact a human employee of the state agency or department. |
|---|
| 54 | 68 | | |
|---|
| 55 | 69 | | CHAPTER 5.9. Generative Artificial Intelligence Tools11549.63. The Legislature finds and declares all of the following:(a) The Legislature recognizes the tremendous potential of artificial intelligence (AI) to improve the lives of its citizens and the functioning of government. However, the Legislature also recognizes that the use of AI must be guided by principles of fairness, transparency, privacy, and accountability to ensure that the rights and opportunities of all Californians are protected in the age of artificial intelligence.(b) The Legislature further recognizes that generative artificial intelligence (GenAI) enables significant, beneficial uses through its unique capabilities, but GenAI raises novel risks compared to conventional AI across critical areas, including democratic and legal processes, biases and equity, public health and safety, and the economy, and requires measures to address insufficiently guarded governmental systems and unintended or emergent harmful effects from this technology. Additionally, because humans have explicit and implicit biases built into our society, GenAI has the capacity to amplify these biases as it learns from input data. Therefore, it is imperative to consider the implications on Californians of, among other categories, different regions, income, races, ethnicities, gender, ages, religions, abilities, and sexual orientation for all GenAI inputs, outputs, and products for both prioritizing implementations that may promote equity and guarding against bias and other negative impacts.(c) No individual or group should be discriminated against on the basis of race, gender, age, religion, sexual orientation, or any other protected characteristic in the design, development, deployment, or use of AI systems. The unprecedented speed of innovation and deployment of GenAI technologies necessitates proactive guardrails to protect against potential risks or malicious uses, including, but not limited to, bioterrorism, cyberattacks, disinformation, deception, violation of privacy, and discrimination or bias.(d) The Legislature affirms the importance of transparency in the use of GenAI systems. The public has the right to know when they are interacting with GenAI being used by the state and to have an accessible identification of that interaction.(e) The Legislature recognizes that the use of GenAI systems must be consistent with the protection of privacy and civil liberties and must be guided by a commitment to equity and social justice. It is the intent of the Legislature in enacting this legislation that all GenAI systems be designed and deployed in a manner that is consistent with state and federal laws and regulations regarding privacy and civil liberties and minimizes bias and promotes equitable outcomes for all Californians.(f) This act, in addition to the 2022 White House Blueprint for an AI Bill of Rights, executive guidance from the governor, statutory or regulatory requirements, and evolving best practices should guide the decisionmaking of state agencies, departments, and subdivisions in the review, adoption, management, governance, and regulations of automated decisionmaking technologies.(g) Public-private cross-sectional partnerships should be established to train students to meet the GenAI workforce development needs of the state, including providing instruction on AI and related ethical, privacy, and security considerations while advancing research on best practices. Further, there is the need for the state to recruit, retain, and train GenAI professionals in certain state jobs, and agencies should collaborate to facilitate a pipeline and infrastructure to accomplish that goal.(h) State agencies, departments, and boards should utilize their authority to protect consumers, patients, passengers, and students from fraud, discrimination, and threats to privacy and to address other risks that may arise from the use of GenAI, including risks to financial stability. State agencies, departments, and boards should consider rulemaking and emphasize or clarify if existing regulations and guidance apply to GenAI or other automated decisionmaking systems.11549.64. As used in this chapter:(a) Artificial intelligence means an engineered or machine-based system that varies in its level of autonomy and that can, for explicit or implicit objectives, infer from the input it receives how to generate outputs that can influence physical or virtual environments.(b) Generative artificial intelligence or GenAI means an artificial intelligence system that can generate derived synthetic content, including text, images, video, and audio that emulates the structure and characteristics of the systems training data.(c) Person means a natural person.(d) Report means the report to the Governor required by Executive Order No. N-12-23.11549.65. (a) The Department of Technology, under the guidance of the Government Operations Agency, the Office of Data and Innovation, and the Department of Human Resources, shall update the report, as needed, to respond to significant developments and shall, as appropriate, consult with academia, industry experts, and organizations that represent state exclusive employee representatives.(b) (1) The Office of Emergency Services shall, as appropriate, perform a risk analysis of potential threats posed by the use of GenAI to Californias critical infrastructure, including those that could lead to mass casualty events.(2) The analysis required by paragraph (1) shall be provided to the Governor, and, if appropriate, shall include recommendations reflecting changes to artificial intelligence technology, its applications, and risk management, including further private actions, administrative actions, and collaboration with the Legislature to guard against potential threats and vulnerabilities.(3) A high-level summary of the analysis required by paragraph (1) shall be submitted annually to the Legislature.(c) Any state agency or department shall consider procurement and enterprise use opportunities in which GenAI can improve the efficiency, effectiveness, accessibility, and equity of government operations consistent with the Government Operations Agency, the Department of General Services, and the Department of Technologys policies for public sector GenAI procurement.(d) Legal counsel for any state agency or department shall consider any potential impact of GenAI on regulatory issues under the respective agencys or departments authority and recommend necessary updates, if appropriate, as a result of this evolving technology.11549.66. A state agency or department that utilizes GenAI to directly communicate with a person regarding government services and benefits shall ensure that those communications include both of the following:(a) A disclaimer that indicates to the person that the communication was generated by GenAI.(1) For written communications involving physical and digital media, including letters, email, and other occasional messages, the disclaimer shall appear prominently at the start of each communication.(2) For written communications involving continuous online interactions, including interactions with chatbots, the disclaimer shall be prominently displayed throughout the interaction.(3) For audio communications, the disclaimer shall be provided verbally at the start and end of the interaction.(4) For video communications, the disclaimer shall be prominently displayed throughout the interaction.(b) Information, or a link to an internet website containing information, describing how the person may contact a human employee of the state agency or department. |
|---|
| 56 | 70 | | |
|---|
| 57 | 71 | | CHAPTER 5.9. Generative Artificial Intelligence Tools |
|---|
| 58 | 72 | | |
|---|
| 59 | 73 | | CHAPTER 5.9. Generative Artificial Intelligence Tools |
|---|
| 60 | 74 | | |
|---|
| 61 | 75 | | 11549.63. The Legislature finds and declares all of the following:(a) The Legislature recognizes the tremendous potential of artificial intelligence (AI) to improve the lives of its citizens and the functioning of government. However, the Legislature also recognizes that the use of AI must be guided by principles of fairness, transparency, privacy, and accountability to ensure that the rights and opportunities of all Californians are protected in the age of artificial intelligence.(b) The Legislature further recognizes that generative artificial intelligence (GenAI) enables significant, beneficial uses through its unique capabilities, but GenAI raises novel risks compared to conventional AI across critical areas, including democratic and legal processes, biases and equity, public health and safety, and the economy, and requires measures to address insufficiently guarded governmental systems and unintended or emergent harmful effects from this technology. Additionally, because humans have explicit and implicit biases built into our society, GenAI has the capacity to amplify these biases as it learns from input data. Therefore, it is imperative to consider the implications on Californians of, among other categories, different regions, income, races, ethnicities, gender, ages, religions, abilities, and sexual orientation for all GenAI inputs, outputs, and products for both prioritizing implementations that may promote equity and guarding against bias and other negative impacts.(c) No individual or group should be discriminated against on the basis of race, gender, age, religion, sexual orientation, or any other protected characteristic in the design, development, deployment, or use of AI systems. The unprecedented speed of innovation and deployment of GenAI technologies necessitates proactive guardrails to protect against potential risks or malicious uses, including, but not limited to, bioterrorism, cyberattacks, disinformation, deception, violation of privacy, and discrimination or bias.(d) The Legislature affirms the importance of transparency in the use of GenAI systems. The public has the right to know when they are interacting with GenAI being used by the state and to have an accessible identification of that interaction.(e) The Legislature recognizes that the use of GenAI systems must be consistent with the protection of privacy and civil liberties and must be guided by a commitment to equity and social justice. It is the intent of the Legislature in enacting this legislation that all GenAI systems be designed and deployed in a manner that is consistent with state and federal laws and regulations regarding privacy and civil liberties and minimizes bias and promotes equitable outcomes for all Californians.(f) This act, in addition to the 2022 White House Blueprint for an AI Bill of Rights, executive guidance from the governor, statutory or regulatory requirements, and evolving best practices should guide the decisionmaking of state agencies, departments, and subdivisions in the review, adoption, management, governance, and regulations of automated decisionmaking technologies.(g) Public-private cross-sectional partnerships should be established to train students to meet the GenAI workforce development needs of the state, including providing instruction on AI and related ethical, privacy, and security considerations while advancing research on best practices. Further, there is the need for the state to recruit, retain, and train GenAI professionals in certain state jobs, and agencies should collaborate to facilitate a pipeline and infrastructure to accomplish that goal.(h) State agencies, departments, and boards should utilize their authority to protect consumers, patients, passengers, and students from fraud, discrimination, and threats to privacy and to address other risks that may arise from the use of GenAI, including risks to financial stability. State agencies, departments, and boards should consider rulemaking and emphasize or clarify if existing regulations and guidance apply to GenAI or other automated decisionmaking systems. |
|---|
| 62 | 76 | | |
|---|
| 63 | 77 | | |
|---|
| 64 | 78 | | |
|---|
| 65 | 79 | | 11549.63. The Legislature finds and declares all of the following: |
|---|
| 66 | 80 | | |
|---|
| 67 | 81 | | (a) The Legislature recognizes the tremendous potential of artificial intelligence (AI) to improve the lives of its citizens and the functioning of government. However, the Legislature also recognizes that the use of AI must be guided by principles of fairness, transparency, privacy, and accountability to ensure that the rights and opportunities of all Californians are protected in the age of artificial intelligence. |
|---|
| 68 | 82 | | |
|---|
| 69 | 83 | | (b) The Legislature further recognizes that generative artificial intelligence (GenAI) enables significant, beneficial uses through its unique capabilities, but GenAI raises novel risks compared to conventional AI across critical areas, including democratic and legal processes, biases and equity, public health and safety, and the economy, and requires measures to address insufficiently guarded governmental systems and unintended or emergent harmful effects from this technology. Additionally, because humans have explicit and implicit biases built into our society, GenAI has the capacity to amplify these biases as it learns from input data. Therefore, it is imperative to consider the implications on Californians of, among other categories, different regions, income, races, ethnicities, gender, ages, religions, abilities, and sexual orientation for all GenAI inputs, outputs, and products for both prioritizing implementations that may promote equity and guarding against bias and other negative impacts. |
|---|
| 70 | 84 | | |
|---|
| 71 | 85 | | (c) No individual or group should be discriminated against on the basis of race, gender, age, religion, sexual orientation, or any other protected characteristic in the design, development, deployment, or use of AI systems. The unprecedented speed of innovation and deployment of GenAI technologies necessitates proactive guardrails to protect against potential risks or malicious uses, including, but not limited to, bioterrorism, cyberattacks, disinformation, deception, violation of privacy, and discrimination or bias. |
|---|
| 72 | 86 | | |
|---|
| 73 | 87 | | (d) The Legislature affirms the importance of transparency in the use of GenAI systems. The public has the right to know when they are interacting with GenAI being used by the state and to have an accessible identification of that interaction. |
|---|
| 74 | 88 | | |
|---|
| 75 | 89 | | (e) The Legislature recognizes that the use of GenAI systems must be consistent with the protection of privacy and civil liberties and must be guided by a commitment to equity and social justice. It is the intent of the Legislature in enacting this legislation that all GenAI systems be designed and deployed in a manner that is consistent with state and federal laws and regulations regarding privacy and civil liberties and minimizes bias and promotes equitable outcomes for all Californians. |
|---|
| 76 | 90 | | |
|---|
| 77 | 91 | | (f) This act, in addition to the 2022 White House Blueprint for an AI Bill of Rights, executive guidance from the governor, statutory or regulatory requirements, and evolving best practices should guide the decisionmaking of state agencies, departments, and subdivisions in the review, adoption, management, governance, and regulations of automated decisionmaking technologies. |
|---|
| 78 | 92 | | |
|---|
| 79 | 93 | | (g) Public-private cross-sectional partnerships should be established to train students to meet the GenAI workforce development needs of the state, including providing instruction on AI and related ethical, privacy, and security considerations while advancing research on best practices. Further, there is the need for the state to recruit, retain, and train GenAI professionals in certain state jobs, and agencies should collaborate to facilitate a pipeline and infrastructure to accomplish that goal. |
|---|
| 80 | 94 | | |
|---|
| 81 | 95 | | (h) State agencies, departments, and boards should utilize their authority to protect consumers, patients, passengers, and students from fraud, discrimination, and threats to privacy and to address other risks that may arise from the use of GenAI, including risks to financial stability. State agencies, departments, and boards should consider rulemaking and emphasize or clarify if existing regulations and guidance apply to GenAI or other automated decisionmaking systems. |
|---|
| 82 | 96 | | |
|---|
| 83 | 97 | | 11549.64. As used in this chapter:(a) Artificial intelligence means an engineered or machine-based system that varies in its level of autonomy and that can, for explicit or implicit objectives, infer from the input it receives how to generate outputs that can influence physical or virtual environments.(b) Generative artificial intelligence or GenAI means an artificial intelligence system that can generate derived synthetic content, including text, images, video, and audio that emulates the structure and characteristics of the systems training data.(c) Person means a natural person.(d) Report means the report to the Governor required by Executive Order No. N-12-23. |
|---|
| 84 | 98 | | |
|---|
| 85 | 99 | | |
|---|
| 86 | 100 | | |
|---|
| 87 | 101 | | 11549.64. As used in this chapter: |
|---|
| 88 | 102 | | |
|---|
| 89 | 103 | | (a) Artificial intelligence means an engineered or machine-based system that varies in its level of autonomy and that can, for explicit or implicit objectives, infer from the input it receives how to generate outputs that can influence physical or virtual environments. |
|---|
| 90 | 104 | | |
|---|
| 91 | 105 | | (b) Generative artificial intelligence or GenAI means an artificial intelligence system that can generate derived synthetic content, including text, images, video, and audio that emulates the structure and characteristics of the systems training data. |
|---|
| 92 | 106 | | |
|---|
| 93 | 107 | | (c) Person means a natural person. |
|---|
| 94 | 108 | | |
|---|
| 95 | 109 | | (d) Report means the report to the Governor required by Executive Order No. N-12-23. |
|---|
| 96 | 110 | | |
|---|
| 97 | 111 | | 11549.65. (a) The Department of Technology, under the guidance of the Government Operations Agency, the Office of Data and Innovation, and the Department of Human Resources, shall update the report, as needed, to respond to significant developments and shall, as appropriate, consult with academia, industry experts, and organizations that represent state exclusive employee representatives.(b) (1) The Office of Emergency Services shall, as appropriate, perform a risk analysis of potential threats posed by the use of GenAI to Californias critical infrastructure, including those that could lead to mass casualty events.(2) The analysis required by paragraph (1) shall be provided to the Governor, and, if appropriate, shall include recommendations reflecting changes to artificial intelligence technology, its applications, and risk management, including further private actions, administrative actions, and collaboration with the Legislature to guard against potential threats and vulnerabilities.(3) A high-level summary of the analysis required by paragraph (1) shall be submitted annually to the Legislature.(c) Any state agency or department shall consider procurement and enterprise use opportunities in which GenAI can improve the efficiency, effectiveness, accessibility, and equity of government operations consistent with the Government Operations Agency, the Department of General Services, and the Department of Technologys policies for public sector GenAI procurement.(d) Legal counsel for any state agency or department shall consider any potential impact of GenAI on regulatory issues under the respective agencys or departments authority and recommend necessary updates, if appropriate, as a result of this evolving technology. |
|---|
| 98 | 112 | | |
|---|
| 99 | 113 | | |
|---|
| 100 | 114 | | |
|---|
| 101 | 115 | | 11549.65. (a) The Department of Technology, under the guidance of the Government Operations Agency, the Office of Data and Innovation, and the Department of Human Resources, shall update the report, as needed, to respond to significant developments and shall, as appropriate, consult with academia, industry experts, and organizations that represent state exclusive employee representatives. |
|---|
| 102 | 116 | | |
|---|
| 103 | 117 | | (b) (1) The Office of Emergency Services shall, as appropriate, perform a risk analysis of potential threats posed by the use of GenAI to Californias critical infrastructure, including those that could lead to mass casualty events. |
|---|
| 104 | 118 | | |
|---|
| 105 | 119 | | (2) The analysis required by paragraph (1) shall be provided to the Governor, and, if appropriate, shall include recommendations reflecting changes to artificial intelligence technology, its applications, and risk management, including further private actions, administrative actions, and collaboration with the Legislature to guard against potential threats and vulnerabilities. |
|---|
| 106 | 120 | | |
|---|
| 107 | 121 | | (3) A high-level summary of the analysis required by paragraph (1) shall be submitted annually to the Legislature. |
|---|
| 108 | 122 | | |
|---|
| 109 | 123 | | (c) Any state agency or department shall consider procurement and enterprise use opportunities in which GenAI can improve the efficiency, effectiveness, accessibility, and equity of government operations consistent with the Government Operations Agency, the Department of General Services, and the Department of Technologys policies for public sector GenAI procurement. |
|---|
| 110 | 124 | | |
|---|
| 111 | 125 | | (d) Legal counsel for any state agency or department shall consider any potential impact of GenAI on regulatory issues under the respective agencys or departments authority and recommend necessary updates, if appropriate, as a result of this evolving technology. |
|---|
| 112 | 126 | | |
|---|
| 113 | 127 | | 11549.66. A state agency or department that utilizes GenAI to directly communicate with a person regarding government services and benefits shall ensure that those communications include both of the following:(a) A disclaimer that indicates to the person that the communication was generated by GenAI.(1) For written communications involving physical and digital media, including letters, email, and other occasional messages, the disclaimer shall appear prominently at the start of each communication.(2) For written communications involving continuous online interactions, including interactions with chatbots, the disclaimer shall be prominently displayed throughout the interaction.(3) For audio communications, the disclaimer shall be provided verbally at the start and end of the interaction.(4) For video communications, the disclaimer shall be prominently displayed throughout the interaction.(b) Information, or a link to an internet website containing information, describing how the person may contact a human employee of the state agency or department. |
|---|
| 114 | 128 | | |
|---|
| 115 | 129 | | |
|---|
| 116 | 130 | | |
|---|
| 117 | 131 | | 11549.66. A state agency or department that utilizes GenAI to directly communicate with a person regarding government services and benefits shall ensure that those communications include both of the following: |
|---|
| 118 | 132 | | |
|---|
| 119 | 133 | | (a) A disclaimer that indicates to the person that the communication was generated by GenAI. |
|---|
| 120 | 134 | | |
|---|
| 121 | 135 | | (1) For written communications involving physical and digital media, including letters, email, and other occasional messages, the disclaimer shall appear prominently at the start of each communication. |
|---|
| 122 | 136 | | |
|---|
| 123 | 137 | | (2) For written communications involving continuous online interactions, including interactions with chatbots, the disclaimer shall be prominently displayed throughout the interaction. |
|---|
| 124 | 138 | | |
|---|
| 125 | 139 | | (3) For audio communications, the disclaimer shall be provided verbally at the start and end of the interaction. |
|---|
| 126 | 140 | | |
|---|
| 127 | 141 | | (4) For video communications, the disclaimer shall be prominently displayed throughout the interaction. |
|---|
| 128 | 142 | | |
|---|
| 129 | 143 | | (b) Information, or a link to an internet website containing information, describing how the person may contact a human employee of the state agency or department. |
|---|