Not delaying stereo->mono transitions to/from CELT