AI Frontiers
Avsnitt

“AI Content Must Now Carry a Label. Cameras Are Next.” by AI Frontiers

AI Frontiers
Dela

Subtitle: New EU and California laws require AI companies, and eventually camera makers, to sign their media outputs. It's our best chance to tell what's real.

Eddan Katz, Head of Policy & Gov Affairs at Encypher — August 13, 2026

Two days before Slovakia's 2023 parliamentary election, a fabricated audio clip spread widely on social media, appearing to catch a leading candidate and a prominent journalist discussing how to rig the vote. The following year, nonconsensual pornographic deepfakes of Taylor Swift amassed over 45 million views on X in less than 24 hours. In summer 2025, an elderly woman in Ontario lost her life savings to a cryptocurrency scam, which began with a Facebook advertisement featuring a deepfake of Prime Minister Mark Carney.

In each of these cases, harm might have been reduced by content provenance metadata: information attached to content that declares how it was produced. (Generally, the term “provenance” refers to a record of where something came from and what happened to it along the way.) Content provenance tools can’t directly prove whether a bare image or video is real or synthetic; no technology reliably can. Instead, they serve as an evidentiary layer of AI governance [...]

---

Outline:

(02:49) What Content Provenance Is and How It Works

(06:51) Limitations of Content Credentials

(12:00) What the EU and California Acts Require

(15:15) The EU and California Laws' Global Impact

(17:43) How Provenance Mandates Support Courts in Tackling Deepfake Evidence

(21:21) Discussion about this post

(21:25) Ready for more?

---

First published:
August 13th, 2026

Source:
https://newsletter.ai-frontiers.org/p/ai-content-must-now-carry-a-label

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Rose gold laptop and camera on gimbal, wooden desk.A simplified representation of how Content Credentials metadata is generated. The original data, such as a raw image, and statements about it are hashed and combined into a set of numbers called a “claim.” Hardware manufacturers embed trusted keys in their devices to “sign” claims. With Content Credentials, outside observers can easily verify that the data and statements were signed by the hardware manufacturer’s key.A tool provided by the Content Authenticity Initiative displays C2PA metadata from an image generated in ChatGPT, revealing its true provenance.Sony’s Camera Authenticity Solution makes it hard to pass off synthetic images as genuine by photographing them off a screen, addressing the signing-through-camera vulnerability. Source: Sony.

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

Rss Apple Podcaster
Podden och tillhörande omslagsbild på den här sidan tillhör Center for AI Safety. Innehållet i podden är skapat av Center for AI Safety och inte av, eller tillsammans med, Poddtoppen.