Don't discard timestamps from invalid packets.