Don't update the internal decoder state until we know the packet is valid