RoboFake: Are Deepfake Detectors Ready for Humanoid Face Robots?

Key points

• Give such a robot the face of a real person and drive it with generated speech, and you get a face forgery that happens in front of the camera: the camera records a real object, and no pixel is edited.1
• In this paper we ask what current deepfake detectors do when they see a robot face.1
• We test six public detectors trained on FaceForensics++ on video of a physical lip-syncing face robot, on a synthesized video of the same robot, and on rendered robot faces.1
• We release our evaluation protocol and code, and state three testable hypotheses about realistic, interactive RoboFakes.1

Sources (1)

• [1]RoboFake: Are Deepfake Detectors Ready for Humanoid Face Robots?
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 9, 07:42 PM

  Humanoid face robots can now move their lips in sync with speech and show detailed facial expressions.

  Give such a robot the face of a real person and drive it with generated speech, and you get a face forgery that happens in front of the camera: the camera records a real object, and no pixel is edited.

Extractive summary: sentences quoted from the sources.