Opus custom requires libm unconditionally.