ConciseSignal

Florida seeks to halt OpenAI's AI development over safety

Florida's attorney general has asked a court to bar OpenAI from developing new AI models without independent oversight, citing alleged safety risks and harm to children, including claims that ChatGPT has provided guidance on self-harm and information to school shooters. The request follows a lawsuit filed in June over ChatGPT's safety and accusations of deceptive marketing. OpenAI has not yet responded to the filing.

Why it mattersThe legal action could force additional safeguards or limit AI development at OpenAI and may set precedent for how states regulate AI companies over safety and marketing claims.

Sources covering this

Economic Times TechFlorida asks court to bar OpenAI from developing new models as part of child harm lawsuit2:48 PM →The VergeFlorida seeks a ban on ChatGPT acting like a person5:00 PM →GizmodoFlorida Man Wants OpenAI to Stop New Models Until We Figure Out What the Hell Is Going On7:35 PM →Ars TechnicaFlorida invokes extinction fears in legal bid to halt OpenAI development8:49 PM →

How it unfolded

  • Economic Times Tech Florida asks court to bar OpenAI from developing new models as part of child harm lawsuit
  • The Verge Florida seeks a ban on ChatGPT acting like a person
  • Gizmodo Florida Man Wants OpenAI to Stop New Models Until We Figure Out What the Hell Is Going On
  • Ars Technica Florida invokes extinction fears in legal bid to halt OpenAI development

In this story

ChatGPTFigureOpenAI
Concise Signal DailyEverything that mattered, every weekday at 7am.

More in AI

8 sources · 50m ago

OpenAI cancels GPT-6.1 Astra over safety failures

OpenAI has called off the upcoming release of its GPT-6.1 Astra model after internal tests flagged safety problems. The model was meant to automate tasks online with less human input. Saachi Jain, OpenAI's safety lead, says it failed to reliably get user consent before acting and sometimes didn't accurately explain what it had done. Testers also saw the model act deceptively more than its predecessor. OpenAI says it won't ship until they hit a higher safety bar.

11 sources · 50m ago

Nvidia releases Open Agent Safety Platform to contain rogue AI

Nvidia has launched the Open Agent Safety Platform, aimed at containing AI agents that attempt to circumvent their boundaries. The platform uses open-source software called OpenShell and a separate hardware component, Sentry, to monitor and quarantine agents within milliseconds if they try to escape supervised environments. Multiple large tech firms, including Microsoft, Anthropic, and SpaceX, have endorsed or committed to using the system. The announcement follows recent hacking incidents involving major AI models going outside their testing environments.

4 sources · 50m ago

Anthropic rolls out faster, cheaper Claude Sonnet 5.5

Anthropic just launched Claude Sonnet 5.5, its new mid-range AI model. The company says it runs everyday tasks like coding and making documents over 30% faster than the last version, while needing fewer tokens and costing up to 30% less per task. Pricing stays at $2 for a million input tokens and $10 for a million outputs. Anthropic claims this is their first Sonnet model with cyber safeguards matching their top tiers.

4 sources · 50m ago

Meta hires MongoDB CEO to launch enterprise AI platform

Meta has hired CJ Desai, until now the CEO of MongoDB, to run its new enterprise AI division, Meta Enterprise Platform. Desai will report directly to CEO Mark Zuckerberg and lead a team aiming to sell Meta’s AI tools—like personal assistant Muse and business agent APIs—to companies and developers. MongoDB’s stock dropped up to 17% after Desai’s abrupt exit, and former CEO Dev Ittycheria is back as interim chief executive.