Korean academics claim breakthrough in Face Super-ResolutionKorean academics claim breakthrough in Face Super-Resolution
Korean academics claim breakthrough in Face Super-Resolution
September 2, 2019
How much information can hide in just 256 pixels? Turns out, quite a lot
by Max Smolaks 2 August 2019
A team of researchers from the KoreaAdvanced Institute of Science andTechnology (KAIST) says it has perfected an algorithm that can recreate detailedportraits of human faces out of images that measure just 16 by 16 pixels.
The algorithm is the latest in a long series ofexperiments focusing on Face Super-Resolution, also knownas “face hallucination,” asubfield of the Super Resolution domain that deals with the reconstruction of realisticface images from low-rez icons.
The KAIST team claims its take on Face Super-Resolution is more accurate than any of the current methods, thanks to a combination of advances in progressive training (that isn’t normally employed for SR) and clever use of face heatmaps that predict where certain parts of a face are usually found. See an example below:
“We propose a novel face SR method that generates photo-realistic 8x super-resolved face images with fully retained facial details,” the KAIST team said in a paper published on ArXiv. “To that end, we adopt a progressive training method, which allows stable training by splitting the network into successive steps, each producing output with a progressively higher resolution.
“We also propose a novel facial attentionloss and apply it at each step to focus on restoring facial attributes ingreater details by multiplying the pixel difference and heatmap values.
“Lastly, we propose a compressed version ofthe state-of-the-art face alignment network (FAN) for landmark heatmapextraction. With the proposed FAN, we can extract the heatmaps suitable forface SR and also reduce the overall training time.”
The new algorithms have already been subverted to generate human faces out of Twitter and Twitch emoticons, with terrifying results; these include a pizza garnished with human lips instead of pepperoni.
Story via @hackermaderas