FlashReFocus: Interactive Image Refocusing in Seconds

Key points

• Recent generative methods, however, rerun large diffusion models for every edit.1
• We observe that the two sub-problems differ in kind: recovering the all-in-focus image is ill-posed and needs a generative prior, whereas rendering blur is largely determined by depth and the focal plane.1
• We therefore propose FlashReFocus, which runs diffusion once per photograph and renders every edit with a lightweight network.1
• FlashReFocus achieves the best perceptual fidelity for zero-shot bokeh rendering on EBB! and 3CReal, refocuses 148.3x faster than GenRefocus, and takes about half a second per further edit, 462x faster.1

Sources (1)

• [1]FlashReFocus: Interactive Image Refocusing in Seconds
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 16, 11:04 AM

  Single-image refocusing changes the focal plane and depth of field of a photograph after capture.

  Recent generative methods, however, rerun large diffusion models for every edit.

Extractive summary: sentences quoted from the sources.