Scaled epsilon the wrong way.

Should have been 0.5 to widen the bounds, since this is inverse
precision.  Setting to 0.5, however, leads to many more failing
tests at Google, so reverting to 1 for now.
This commit is contained in:
Antonio Sanchez 2021-04-07 15:08:39 -07:00
parent 6197ce1a35
commit fcb5106c6e

View File

@ -508,7 +508,7 @@ ComputationInfo computeFromTridiagonal_impl(DiagType& diag, SubDiagType& subdiag
typedef typename DiagType::RealScalar RealScalar;
const RealScalar considerAsZero = (std::numeric_limits<RealScalar>::min)();
const RealScalar precision_inv = RealScalar(2)/NumTraits<RealScalar>::epsilon();
const RealScalar precision_inv = RealScalar(1)/NumTraits<RealScalar>::epsilon();
while (end>0)
{
for (Index i = start; i<end; ++i) {