Flickering Problem

[GrigorySamokhin]

Hello! Thanks for your amazing work!

Im wondering is there any possible ways to reduce flickering on the result animation in IOS / SIBR viewer? I have tested with 0, 10, 25 qp value for compression. My result for actor1 greeting (the middle of the video): https://drive.google.com/file/d/1Hmm_9afwv1kwWPwGck9GLH-vQmoGjmbQ/view?usp=drive_link

I have also checked your result videos and there are no such flickering.

Also, maybe you can navigate me how to get the best quality without taking performance into account?

Thanks in advance!

[AuthorityWang]

Hi, sorry for the late response.
The flickering problem is probably due to temporal inconsistency. Therefore, try to train with larger temporal loss lambda, or reduce the iteration of the fine-tuning stage in the two-stage training scheme, which can enhance the temporal consistency of the result. Besides, the different qp values may not reduce the flickering according to our experiments.
Flickering is a common problem in dynamic reconstruction tasks, we have tried to integrate some temporal loss to enhance this. Maybe trying to integrate some real-time flickering denoiser in the viewer as a post process can solve the flickering problem efficiently.