Linear Operators and Matrices
Now, see a linear operator is just a matrix. Suppose and are basis of and is a basis of then,
Ok so imagine an operation such that the following shit holds ok?
In finite dimensions, inner product space i.e., vector spaces equipped with inner prducts for all vector space Hilbert Space
Consider to be orthonormal basis, we have —
Norm of a vector
We can say that is normalized iff .
A set of vectors is orthonormal if i.e., and .
Gram Schmidt: for orthonormal basis
From this notion we obtain the completeness relation, .
Eigenvectors and Eigenvalues
Under a given linear transformation , where s.t. they do not get shifted off their span.
All such vectors are referred as eigenvectors and gives all possible eigenvalue.
It is the space of all vectors with a given eigenvalue . When an eigenspace is more than one dimensional, we call it degenerate.
Adjoints and Hermitian
Suppose then such that we have,
This operator is called as the adjoint or Hermitian conjugate of the operator .
A normal matrix is Hermitian if and only if it has real eigenvalues.
diagonalizable if and only if it is normal.: A linear operator is
Some notes and derivation regarding the above:
where 's are linearly independent eigenvalues of .
Matrices and Vectors
In the following statements we are dealing with as a orthonormal basis set.
Now, to represent a operator or linear transformation as matrix in orthonormal basis.
Now diagonalization for any normal matrix.
where are eigenvalues of under a given orthonormal basis set for vector space , each is an eigenvector of with eigenvalue .
If is Hermitian, all eigenvalues are non-negative.
forms the linear operator that acts on vector space givern that acts on and acts on .
Properties of trace are given below as follows.
for orthonormal basis
The above properties yield certain implications as follows.
Hilbert-Schimdt Inner Product
forms the vector space of operators over the Hilbert space . Then, we can show that is also a Hilbert space with as the inner product operator on .
Also, we have .
Commutator and Anti-commutator
Theorem of Simultaneous Diagonalization
Suppose and are both Hermitian matrices, then iff orthonormal basis such that both and are diagonal with respect to that basis.
Polar Value Decomposition
If is any linear operator and is a unitary then are positive operators, such that
Moreover, if exists, then is unique.
Singular Value Decomposition
If is a square matrix and unitaries then is a diagonal matrix, such that
where has non-negative values.