Please ensure Javascript is enabled for purposes of website accessibility
California Governor Vetoes Bill to Create First-in-Nation AI Safety Measures
gvw_ap_news
By Associated Press
Published 7 months ago on
September 30, 2024

Gov. Newsom vetoes landmark AI safety bill, citing potential chilling effect on industry and opting for expert partnerships instead. (AP File)

Share

Getting your Trinity Audio player ready...

SACRAMENTO — California Gov. Gavin Newsom vetoed a landmark bill aimed at establishing first-in-the-nation safety measures for large artificial intelligence models Sunday.

The decision is a major blow to efforts attempting to rein in the homegrown industry that is rapidly evolving with little oversight. The bill would have established some of the first regulations on large-scale AI models in the nation and paved the way for AI safety regulations across the country, supporters said.

Earlier this month, the Democratic governor told an audience at Dreamforce, an annual conference hosted by software giant Salesforce, that California must lead in regulating AI in the face of federal inaction but that the proposal “can have a chilling effect on the industry.”

Governor Cites Concerns Over Rigid Requirements

The proposal, which drew fierce opposition from startups, tech giants and several Democratic House members, could have hurt the homegrown industry by establishing rigid requirements, Newsom said.

“While well-intentioned, SB 1047 does not take into account whether an AI system is deployed in high-risk environments, involves critical decision-making or the use of sensitive data,” Newsom said in a statement. “Instead, the bill applies stringent standards to even the most basic functions — so long as a large system deploys it. I do not believe this is the best approach to protecting the public from real threats posed by the technology.”

Newsom on Sunday instead announced that the state will partner with several industry experts, including AI pioneer Fei-Fei Li, to develop guardrails around powerful AI models. Li opposed the AI safety proposal.

Bill’s Provisions and Supporters’ Arguments

The measure, aimed at reducing potential risks created by AI, would have required companies to test their models and publicly disclose their safety protocols to prevent the models from being manipulated to, for example, wipe out the state’s electric grid or help build chemical weapons. Experts say those scenarios could be possible in the future as the industry continues to rapidly advance. It also would have provided whistleblower protections to workers.

The bill’s author, Democratic state Sen. Scott Weiner, called the veto “a setback for everyone who believes in oversight of massive corporations that are making critical decisions that affect the safety and the welfare of the public and the future of the planet.”

“The companies developing advanced AI systems acknowledge that the risks these models present to the public are real and rapidly increasing. While the large AI labs have made admirable commitments to monitor and mitigate these risks, the truth is that voluntary commitments from industry are not enforceable and rarely work out well for the public,” Wiener said in a statement Sunday afternoon.

Wiener said the debate around the bill has dramatically advanced the issue of AI safety, and that he would continue pressing that point.

California’s Efforts to Regulate AI

The legislation is among a host of bills passed by the Legislature this year to regulate AI, fight deepfakes and protect workers. State lawmakers said California must take actions this year, citing hard lessons they learned from failing to rein in social media companies when they might have had a chance.

Proponents of the measure, including Elon Musk and Anthropic, said the proposal could have injected some levels of transparency and accountability around large-scale AI models, as developers and experts say they still don’t have a full understanding of how AI models behave and why.

The bill targeted systems that require a high level of computing power and more than $100 million to build. No current AI models have hit that threshold, but some experts said that could change within the next year.

“This is because of the massive investment scale-up within the industry,” said Daniel Kokotajlo, a former OpenAI researcher who resigned in April over what he saw as the company’s disregard for AI risks. “This is a crazy amount of power to have any private company control unaccountably, and it’s also incredibly risky.”

The United States is already behind Europe in regulating AI to limit risks. The California proposal wasn’t as comprehensive as regulations in Europe, but it would have been a good first step to set guardrails around the rapidly growing technology that is raising concerns about job loss, misinformation, invasions of privacy and automation bias, supporters said.

A number of leading AI companies last year voluntarily agreed to follow safeguards set by the White House, such as testing and sharing information about their models. The California bill would have mandated AI developers to follow requirements similar to those commitments, said the measure’s supporters.

But critics, including former U.S. House Speaker Nancy Pelosi, argued that the bill would “kill California tech” and stifle innovation. It would have discouraged AI developers from investing in large models or sharing open-source software, they said.

Implications for Future AI Regulation

Newsom’s decision to veto the bill marks another win in California for big tech companies and AI developers, many of whom spent the past year lobbying alongside the California Chamber of Commerce to sway the governor and lawmakers from advancing AI regulations.

Two other sweeping AI proposals, which also faced mounting opposition from the tech industry and others, died ahead of a legislative deadline last month. The bills would have required AI developers to label AI-generated content and ban discrimination from AI tools used to make employment decisions.

The governor said earlier this summer he wanted to protect California’s status as a global leader in AI, noting that 32 of the world’s top 50 AI companies are located in the state.

He has promoted California as an early adopter as the state could soon deploy generative AI tools to address highway congestion, provide tax guidance and streamline homelessness programs. The state also announced last month a voluntary partnership with AI giant Nvidia to help train students, college faculty, developers and data scientists. California is also considering new rules against AI discrimination in hiring practices.

Earlier this month, Newsom signed some of the toughest laws in the country to crack down on election deepfakes and measures to protect Hollywood workers from unauthorized AI use.

But even with Newsom’s veto, the California safety proposal is inspiring lawmakers in other states to take up similar measures, said Tatiana Rice, deputy director of the Future of Privacy Forum, a nonprofit that works with lawmakers on technology and privacy proposals.

“They are going to potentially either copy it or do something similar next legislative session,” Rice said. “So it’s not going away.”

RELATED TOPICS:

DON'T MISS

What Are Fresno Real Estate Experts Predicting for 2025 and Beyond?

DON'T MISS

First California EV Mandates Hit Automakers This Year. Most Are Not Even Close

DON'T MISS

Shedeur Sanders Snubbed in NFL Draft’s Round 1 but Leads List of Top Available Players for Day 2

DON'T MISS

Chargers Choose North Carolina RB Omarion Hampton in Effort to Boost Offense

DON'T MISS

49ers Draft Georgia Edge Rusher Mykel Williams With the No. 11 Pick in the NFL Draft

DON'T MISS

Trump’s Immigration Approval Ratings Decline as Enforcement Tactics Lose Support

DON'T MISS

Fresno Man Tased, Arrested After Suspected Reckless DUI in Kerman

DON'T MISS

Madera Vehicle Burglary Leads to Arrests, Gang Charges for Juveniles

DON'T MISS

Why Texas Is Ahead of California on Bilingual Education

DON'T MISS

US Universities Help Foreign Students Weather Trump Deportations

DON'T MISS

Alphabet Says Waymo May Offer Robotaxis for Personal Ownership in Future

DON'T MISS

US Pharma Tariffs Would Raise US Drug Costs by $51 Billion Annually, Report Finds

UP NEXT

Chargers Choose North Carolina RB Omarion Hampton in Effort to Boost Offense

UP NEXT

49ers Draft Georgia Edge Rusher Mykel Williams With the No. 11 Pick in the NFL Draft

UP NEXT

Trump’s Immigration Approval Ratings Decline as Enforcement Tactics Lose Support

UP NEXT

Fresno Man Tased, Arrested After Suspected Reckless DUI in Kerman

UP NEXT

Madera Vehicle Burglary Leads to Arrests, Gang Charges for Juveniles

UP NEXT

Why Texas Is Ahead of California on Bilingual Education

UP NEXT

US Universities Help Foreign Students Weather Trump Deportations

UP NEXT

Alphabet Says Waymo May Offer Robotaxis for Personal Ownership in Future

UP NEXT

US Pharma Tariffs Would Raise US Drug Costs by $51 Billion Annually, Report Finds

UP NEXT

Beware of Scammers Saying You Won the Publishers Clearing House Drawing

Trump’s Immigration Approval Ratings Decline as Enforcement Tactics Lose Support

34 minutes ago

Fresno Man Tased, Arrested After Suspected Reckless DUI in Kerman

40 minutes ago

Madera Vehicle Burglary Leads to Arrests, Gang Charges for Juveniles

55 minutes ago

Why Texas Is Ahead of California on Bilingual Education

1 hour ago

US Universities Help Foreign Students Weather Trump Deportations

1 hour ago

Alphabet Says Waymo May Offer Robotaxis for Personal Ownership in Future

1 hour ago

US Pharma Tariffs Would Raise US Drug Costs by $51 Billion Annually, Report Finds

2 hours ago

Beware of Scammers Saying You Won the Publishers Clearing House Drawing

2 hours ago

Abundance Meets Resistance: Are CA Dems Finally Ready to Go All In on Building Housing?

2 hours ago

Less Than Half of Californians Think K-12 Schools Are on the Right Track: Poll

2 hours ago

Shedeur Sanders Snubbed in NFL Draft’s Round 1 but Leads List of Top Available Players for Day 2

Deion Sanders insisted at Colorado’s pro day that Travis Hunter and Shedeur Sanders should go 1-2 in the NFL draft. He was talking abo...

10 minutes ago

Colorado quarterback Shedeur Sanders (2) throws a pass against Central Florida during the first half of an NCAA college football game, Saturday, Sept. 28, 2024, in Orlando, Fla. (AP File)
10 minutes ago

Shedeur Sanders Snubbed in NFL Draft’s Round 1 but Leads List of Top Available Players for Day 2

15 minutes ago

Chargers Choose North Carolina RB Omarion Hampton in Effort to Boost Offense

23 minutes ago

49ers Draft Georgia Edge Rusher Mykel Williams With the No. 11 Pick in the NFL Draft

President Donald Trump speaks at the National Prayer Breakfast at the Capitol in Washington, Feb. 6, 2025. (AP File)
34 minutes ago

Trump’s Immigration Approval Ratings Decline as Enforcement Tactics Lose Support

A Fresno man was arrested in Kerman on Wednesday, April 23, 2025, after allegedly driving recklessly, resisting arrest, and showing signs of being under the influence, police said. (Kerman PD)
40 minutes ago

Fresno Man Tased, Arrested After Suspected Reckless DUI in Kerman

A pedestrian was killed in a traffic collision early Monday morning in Madera, and police are asking for witnesses to come forward.
55 minutes ago

Madera Vehicle Burglary Leads to Arrests, Gang Charges for Juveniles

1 hour ago

Why Texas Is Ahead of California on Bilingual Education

Demonstrators hold a banner during a "Stand Up for Internationals" rally on the campus of Berkeley University in Berkeley, California, U.S., April 17, 2025. (REUTERS/Carlos Barria/File Photo)
1 hour ago

US Universities Help Foreign Students Weather Trump Deportations

Help continue the work that gets you the news that matters most.

Search

Send this to a friend