Skip to content
Artificial intelligence. Clearly. RSS feed
AI NEWS AI

News. Evidence. Perspective.

The deepfake problem in court starts before the detector: who can prove where a recording came from?

OpenAI and Meta have warned US rule-makers that no foolproof deepfake detector exists. Existing authentication law already asks a broader question than “does an algorithm flag this?”—whether the proponent can support the claim that the item is what it is said to be.

A convincing fake video creates an instinctive demand for a better fake-video detector. In court, that is only one part of the problem. A recording can be authentic yet misleadingly edited, generated yet accurately labelled as a reconstruction, or genuine but stripped of the metadata and witnesses needed to explain where it came from. The legal question is not simply whether pixels look synthetic. It is whether the evidence can be connected to the event, device, person and process claimed for it.

Representatives of OpenAI and Meta told the US Judicial Conference’s evidence-rules committee that generative systems are making fabricated audio and video harder to identify. Reuters reported that no foolproof detection method exists or is expected to emerge, while watermarking and verification systems remain non-universal. The reported courtroom incidence is still limited: 15 of 931 judges in a survey said they had encountered a deepfake-related challenge.[1]

Authentication already has more than one route

Federal Rule of Evidence 901 sets the general threshold: the party offering an item must produce evidence sufficient to support a finding that the item is what the party claims. Its examples include a witness with knowledge, distinctive characteristics, voice identification, comparison with an authenticated specimen and evidence describing a process or system. The examples are illustrative rather than exhaustive.[2]

The process

Layers of proof around a disputed recording

Layers of proof around a disputed recording
LayerQuestion it can answerEvidence that may helpWhat it cannot settle alone
OriginWhere did the file first appear?Device records, account logs, camera identifiers, upload historyWhether later edits changed its meaning
ContinuityWas the file preserved through a traceable chain?Hashes, custody records, timestamps, storage logsWhether the original event was staged
ContentDoes the image or voice show signs of synthesis or manipulation?Forensic analysis, detector outputs, compression and edit artefactsA universal yes-or-no verdict
ContextWhat event does the recording actually depict?Witness testimony, location evidence, surrounding communicationsWhether every statement inside the recording is true
System provenanceWas it created or captured by a declared tool?Signed metadata, content credentials, platform recordsCompleteness when provenance data were never attached or were removed

Why detector confidence is not courtroom certainty

A detector normally estimates whether a file resembles examples it learned to classify. Its result depends on the model version, training data, threshold and transformations applied to the evidence. Cropping, re-encoding, screen-recording and audio compression can all change the signal being measured. A score can therefore be useful expert evidence without becoming a magic label attached to the file.

The opposite error is equally dangerous. A detector that does not flag a recording has not proved it authentic. It may not recognise the generation method, the file may have been altered to evade detection, or the manipulation may be an ordinary edit rather than a fully synthetic creation. “Not detected” describes the tool’s output under stated conditions; it is not a historical account of how the recording was made.

The best defence begins at capture

For high-value evidence, the strongest system is prospective rather than reactive. A camera or recorder can sign material when it is captured; an organisation can preserve the original file, record every transfer and retain logs that bind the file to a device and time. That does not make fraud impossible, but it creates a history that later investigators can test instead of asking one classifier to reconstruct the past from the final compressed clip.

  • Preserve the earliest available original rather than a social-media copy.
  • Record who collected it, from which device or account, and when.
  • Retain hashes and logs for each transfer or export.
  • Document every enhancement, edit and transcoding step.
  • Use detector results with the model version, threshold, input file and limitations attached.

The committee’s caution about rushing into a deepfake-specific rule reflects the same structure. The technology is changing quickly, reported cases remain relatively uncommon, and existing rules already permit several forms of authentication. The urgent work is less glamorous than inventing a perfect detector: improve provenance, train judges and lawyers to interrogate technical evidence, and make every claimed chain of origin specific enough to challenge.

Deepfakes make visual intuition less trustworthy. They do not make evidence unknowable. They shift the burden from “this looks real” toward a documented account of capture, custody, transformation and context. A detector may contribute to that account. It should not be mistaken for the account itself.

Follow the evidence

Sources & further reading

  1. Rule 901. Authenticating or Identifying Evidence Legal Information Institute, Cornell Law School · Accessed 16 Oct 2026