Add detection of sudden jumps in time and reset the timers in that case.
Can be replaced if HAL decides to emit a signal...

I would appreciate feedback if this actually works for you.