2010-06-28 22:43:11 +08:00
namespace Eigen {
/** \page TopicLinearAlgebraDecompositions Linear algebra and decompositions
\section TopicLinAlgBigTable Catalogue of decompositions offered by Eigen
<table border="1">
<tr>
<td></td>
<td colspan="5" align="center">Generic information, not Eigen-specific</td>
2010-06-30 02:59:23 +08:00
<td colspan="3" align="center">Eigen-specific</td>
2010-06-28 22:43:11 +08:00
</tr>
<tr>
<td>Decomposition</td>
<td>Requirements on the matrix</td>
<td>Speed</td>
<td>Algorithm reliability and accuracy</td>
<td>Rank-revealing</td>
<td>Allows to compute (besides linear solving)</td>
<td>Linear solver provided by Eigen</td>
<td>Maturity of Eigen's implementation</td>
2010-06-30 02:44:51 +08:00
<td>Optimizations</td>
2010-06-28 22:43:11 +08:00
</tr>
<tr>
<td>PartialPivLU</td>
<td>Invertible</td>
<td>Fast</td>
<td>Depends on condition number</td>
<td>-</td>
<td>-</td>
<td>Yes</td>
<td>Excellent</td>
2010-06-30 02:44:51 +08:00
<td>Blocking</td>
2010-06-28 22:43:11 +08:00
</tr>
<tr>
<td>FullPivLU</td>
<td>-</td>
<td>Slow</td>
<td>Proven</td>
<td>Yes</td>
<td>-</td>
<td>Yes</td>
<td>Excellent</td>
2010-06-30 02:44:51 +08:00
<td>-</td>
2010-06-28 22:43:11 +08:00
</tr>
<tr>
<td>HouseholderQR</td>
<td>-</td>
<td>Fast</td>
<td>Depends on condition number</td>
2010-06-29 22:02:33 +08:00
<td>-</td>
2010-06-28 22:43:11 +08:00
<td>Orthogonalization</td>
<td>Yes</td>
<td>Excellent</td>
2010-06-30 02:44:51 +08:00
<td>Blocking</td>
2010-06-28 22:43:11 +08:00
</tr>
<tr>
<td>ColPivHouseholderQR</td>
<td>-</td>
<td>Fast</td>
<td>Good</td>
<td>Yes</td>
<td>Orthogonalization</td>
<td>Yes</td>
<td>Excellent</td>
2010-06-30 02:44:51 +08:00
<td><em>Soon: blocking</em></td>
2010-06-28 22:43:11 +08:00
</tr>
<tr>
<td>FullPivHouseholderQR</td>
<td>-</td>
<td>Slow</td>
<td>Proven</td>
<td>Yes</td>
<td>Orthogonalization</td>
<td>Yes</td>
<td>Average</td>
2010-06-30 02:44:51 +08:00
<td>-</td>
2010-06-28 22:43:11 +08:00
</tr>
<tr>
<td>LLT</td>
<td>Positive definite</td>
<td>Very fast</td>
<td>Depends on condition number</td>
<td>-</td>
<td>-</td>
<td>Yes</td>
2010-06-30 02:44:51 +08:00
<td>Excellent</td>
<td>Blocking \n <em>Soon: meta unroller</em></td>
2010-06-28 22:43:11 +08:00
</tr>
<tr>
<td>LDLT</td>
2010-06-30 16:37:23 +08:00
<td>Positive or negative semidefinite<sup><a href="#note1">1</a></sup></td>
2010-06-28 22:43:11 +08:00
<td>Very fast</td>
<td>Good</td>
<td>-</td>
<td>-</td>
<td>Yes</td>
2010-06-30 02:44:51 +08:00
<td>Excellent</td>
<td><em>Soon: blocking</em></td>
2010-06-28 22:43:11 +08:00
</tr>
2010-06-30 17:41:23 +08:00
<tr><td colspan="9">\n Singular values and eigenvalues decompositions</td></tr>
2010-06-30 16:37:23 +08:00
2010-06-28 22:43:11 +08:00
<tr>
<td>SVD</td>
<td>-</td>
<td>Average</td>
<td>Good</td>
<td>Yes</td>
<td>Singular values/vectors, least squares</td>
<td>Yes</td>
<td>Average</td>
2010-06-30 02:44:51 +08:00
<td>-</td>
2010-06-28 22:43:11 +08:00
</tr>
<tr>
<td>JacobiSVD</td>
<td>-</td>
<td>Slow (but fast for small matrices)</td>
<td>Proven</td>
<td>Yes</td>
<td>Singular values/vectors, least squares</td>
<td>-</td>
<td>Excellent</td>
2010-06-30 02:44:51 +08:00
<td>-</td>
2010-06-28 22:43:11 +08:00
</tr>
<tr>
<td>SelfAdjointEigenSolver</td>
<td>Self-adjoint</td>
2010-06-30 16:37:23 +08:00
<td>Fast-average<sup><a href="#note2">2</a></sup></td>
2010-06-28 22:43:11 +08:00
<td>Good</td>
<td>Yes</td>
<td>Eigenvalues/vectors</td>
<td>-</td>
2010-06-30 02:44:51 +08:00
<td>Good</td>
2010-06-30 02:59:23 +08:00
<td><em>Soon: specializations for 2x2 and 3x3</em></td>
2010-06-28 22:43:11 +08:00
</tr>
<tr>
<td>ComplexEigenSolver</td>
<td>Square</td>
2010-06-30 16:37:23 +08:00
<td>Slow-very slow<sup><a href="#note2">2</a></sup></td>
2010-06-30 02:59:23 +08:00
<td>Depends on condition number</td>
2010-06-28 22:43:11 +08:00
<td>Yes</td>
<td>Eigenvalues/vectors</td>
<td>-</td>
2010-06-30 02:44:51 +08:00
<td>Average</td>
<td>-</td>
2010-06-28 22:43:11 +08:00
</tr>
<tr>
<td>EigenSolver</td>
<td>Square and real</td>
2010-06-30 16:37:23 +08:00
<td>Average-slow<sup><a href="#note2">2</a></sup></td>
2010-06-30 02:59:23 +08:00
<td>Depends on condition number</td>
2010-06-28 22:43:11 +08:00
<td>Yes</td>
<td>Eigenvalues/vectors</td>
<td>-</td>
2010-06-30 17:41:23 +08:00
<td>Average</td>
2010-06-30 02:44:51 +08:00
<td>-</td>
2010-06-28 22:43:11 +08:00
</tr>
<tr>
<td>GeneralizedSelfAdjointEigenSolver</td>
<td>Square</td>
2010-06-30 16:37:23 +08:00
<td>Fast-average<sup><a href="#note2">2</a></sup></td>
2010-06-30 02:44:51 +08:00
<td>Depends on condition number</td>
2010-06-28 22:43:11 +08:00
<td>-</td>
<td>Generalized eigenvalues/vectors</td>
<td>-</td>
2010-06-30 02:44:51 +08:00
<td>Good</td>
<td>-</td>
2010-06-28 22:43:11 +08:00
</tr>
2010-06-30 17:41:23 +08:00
<tr><td colspan="9">\n Helper decompositions</td></tr>
2010-06-30 16:37:23 +08:00
2010-06-28 22:43:11 +08:00
<tr>
<td>RealSchur</td>
<td>Square and real</td>
2010-06-30 16:37:23 +08:00
<td>Average-slow<sup><a href="#note2">2</a></sup></td>
2010-06-30 02:59:23 +08:00
<td>Depends on condition number</td>
2010-06-28 22:43:11 +08:00
<td>Yes</td>
<td>-</td>
<td>-</td>
2010-06-30 17:41:23 +08:00
<td>Average</td>
2010-06-30 02:44:51 +08:00
<td>-</td>
2010-06-28 22:43:11 +08:00
</tr>
2010-06-30 02:59:23 +08:00
<tr>
<td>ComplexSchur</td>
2010-06-30 17:41:23 +08:00
<td>Square</td>
2010-06-30 16:37:23 +08:00
<td>Slow-very slow<sup><a href="#note2">2</a></sup></td>
2010-06-30 02:59:23 +08:00
<td>Depends on condition number</td>
<td>Yes</td>
<td>-</td>
<td>-</td>
<td>Average</td>
<td>-</td>
</tr>
2010-06-28 22:43:11 +08:00
<tr>
<td>UpperBidiagonalization</td>
2010-06-30 17:41:23 +08:00
<td>Rows >= columns</td>
2010-06-28 22:43:11 +08:00
<td>Fast</td>
<td>Good</td>
<td>-</td>
<td>-</td>
<td>-</td>
<td>Good</td>
2010-06-30 02:44:51 +08:00
<td>-</td>
2010-06-28 22:43:11 +08:00
</tr>
<tr>
<td>Tridiagonalization</td>
<td>Self-adjoint</td>
<td>Fast</td>
<td>Good</td>
<td>-</td>
<td>-</td>
<td>-</td>
<td>Good</td>
2010-06-30 02:59:23 +08:00
<td><em>Soon: blocking</em></td>
2010-06-28 22:43:11 +08:00
</tr>
<tr>
<td>HessenbergDecomposition</td>
2010-06-30 16:37:23 +08:00
<td>Square</td>
2010-06-30 02:44:51 +08:00
<td>Average</td>
<td>Good</td>
2010-06-28 22:43:11 +08:00
<td>-</td>
<td>-</td>
<td>-</td>
2010-06-30 02:44:51 +08:00
<td>Good</td>
2010-06-30 02:59:23 +08:00
<td><em>Soon: blocking</em></td>
2010-06-28 22:43:11 +08:00
</tr>
</table>
2010-06-30 16:37:23 +08:00
\b Notes:
<ul>
2010-07-01 07:27:30 +08:00
<li><a name="note1">\b 1: </a>There exist two variants of the LDLT algorithm. Eigen's one produces a pure diagonal D matrix, and therefore it cannot handle indefinite matrices, unlike Lapack's one which produces a block diagonal D matrix.</li>
<li><a name="note2">\b 2: </a>Eigenvalues, SVD and Schur decompositions rely on iterative algorithms. Their convergence speed depends on how well the eigenvalues are separated.</li>
2010-06-30 16:37:23 +08:00
</ul>
2010-06-28 22:43:11 +08:00
\section TopicLinAlgTerminology Terminology
2010-06-30 16:37:23 +08:00
<dl>
<dt><b>Selfadjoint</b></dt>
<dd>For a real matrix, selfadjoint is a synonym for symmetric. For a complex matrix, selfadjoint is a synonym for \em hermitian.
More generally, a matrix \f$ A \f$ is selfadjoint if and only if it is equal to its adjoint \f$ A^* \f$. The adjoint is also called the \em conjugate \em transpose. </dd>
<dt><b>Positive/negative definite</b></dt>
<dd>A selfadjoint matrix \f$ A \f$ is positive definite if \f$ v^* A v > 0 \f$ for any non zero vector \f$ v \f$.
In the same vein, it is negative definite if \f$ v^* A v < 0 \f$ for any non zero vector \f$ v \f$ </dd>
<dt><b>Positive/negative semidefinite</b></dt>
<dd>A selfadjoint matrix \f$ A \f$ is positive semi-definite if \f$ v^* A v \ge 0 \f$ for any non zero vector \f$ v \f$.
In the same vein, it is negative semi-definite if \f$ v^* A v \le 0 \f$ for any non zero vector \f$ v \f$ </dd>
2010-06-28 22:43:11 +08:00
2010-06-30 16:37:23 +08:00
<dt><b>Blocking</b></dt>
2010-06-30 17:41:23 +08:00
<dd>Means the algorithm can work per block, whence guaranteeing a good scaling of the performance for large matrices.</dd>
2010-06-30 16:37:23 +08:00
<dt><b>Meta-unroller</b></dt>
<dd>Means the algorithm is automatically and explicitly unrolled for very small fixed size matrices.</dd>
<dt><b></b></dt>
<dd></dd>
</dl>
2010-06-28 22:43:11 +08:00
*/
}