Don't free not inited vorbis structures if only doing the first scanning pass.