Advanced Facial Upscaling Tested with WC3 (June 23, 2022)


Super Soaker Collector / Administrator
CD1188 Entertainment has posted a neat video of the latest AI upscaling and image processing techniques. They're using a screenshot from the WC3 introduction to demonstrate how amazing the technology is. AD asked the Wing Commander community's resident neural net expert, ODVS, for his take and he provided some additional context:

They're using Gigapixel AI with its new Facial Recovery algo (which was just released). I'm already doing a deep-dive into experimenting with it for motion. It's impressive, but you hit the uncanny valley pretty hard. Sadly, they've currently only trained it for static images. I suspect it will be a while before it gets incorporated into their motion-friendly models, but I have no doubt that's coming. I am already doing experiments, though. :D

Even if this isn't quite ready to actually animate videos with, the technology remains incredibly impressive!

Original update published on June 23, 2022
So what software was used for this?
Topaz Gigapixel AI, specifically with the new "face recovery" setting/algorithm turned on. It's undeniably impressive, but trained and tuned specifically for static images. I have been experimenting with splitting sequences of Wing Commander III/IV footage into sequences of static frames to see how well it does. Each individual frame looks impressive but, sadly, when you merge them all back together into video it looks far less realistic and natural.

Now... when this gets implemented into an AI app specifically designed for video upscaling like Topaz Video Enhance AI... then we're talking!