Can PixelBender be used to enhance video quality ?
PixelBender is a new exciting feature of Flash Player 10. In short it is a language, a runtime environment and a JIT compiler (with a fall back interpreter) capable to generate and execute machine code optimized for image filtering. PixelBender filters are flexible, fast and are execute in multi-threading over multiple core. I suggest the reading of Tinic Uro’s Blog to know more about it.
But what is the point about PixelBender and Video Playback Enhancement ?
I think PixelBender to be very interesting for the design of fast and sophisticated post filtering kernels for enhancing video quality. Differently from Vp6 and Vp7, H.264 which is the “king on the hill” codec today, does not implements standard post processing or post filtering technology. This is really a mess, because at high compress ratio post processing is very usefull to reduce blockyness and restore picture sharpness. Now with PixelBender will be possible to create sofisticated custom post-processing filters to fill this lack and futherly enhance H.264 video quality at any resolution.
What we could do with Pixel Bender ? For example:
- enhance the details lost with compression using adaptive hi-pass filters.
– reduce the residual blocking in low bitrate video with deblocking filters.
– restore quality by simulation a fine grain over the video.
– smooth the areas of the picture which suffered of excessive quantization (usually dark areas).
If applyed carefully, post processing can also improve PSNR (Power Signal Noise Ratio) but most of all perceptual quality.
I’m starting a bunch of test about this potentialities. And these are two frames of a standard encoded H.264 (left) and the enhanced one (right). I’ll keep you informed.