TV connected to optical input - Blue node 2i delays playback of TV stream while "syncing" with

I'm experiencing a very very annoying delay every time i want to switch from one streamed program to another. I only watch TV via Apple TV and when i start a show the program freezes 1-2 minutes while the Blue node is collecting/syncing data. When that is done i can see what show is playing in the app and the sound works fine but in totally sucks having to wait for several minutes every time you switch to a new show. 

TV is connected via toslink cable to optical input 2

What can i do to have this resolved?