Linear Operators and Matrices
Now, see a linear operator is just a matrix. Suppose and are basis of and is a basis of then,
Inner Products
Ok so imagine an operation such that the following shit holds ok?
1.
2.
3.
and iff
In finite dimensions, inner product space i.e., vector spaces equipped with inner prducts for all vector space Hilbert Space
Consider to be orthonormal basis, we have —
Norm of a vector
We can say that is normalized iff .
A set of vectors is orthonormal if i.e., and .
Gram Schmidt: for orthonormal basis
Outer Product
•
From this notion we obtain the completeness relation, .
•
•
Cauchy Schwarz:
Eigenvectors and Eigenvalues
Under a given linear transformation , where s.t. they do not get shifted off their span.
All such vectors are referred as eigenvectors and gives all possible eigenvalue.
Eigenspace
It is the space of all vectors with a given eigenvalue . When an eigenspace is more than one dimensional, we call it degenerate.
Adjoints and Hermitian
Suppose then such that we have,
This operator is called as the adjoint or Hermitian conjugate of the operator .
•
We have,
•
Some defintions
•
Normal matrices:
•
Hermitian matrices:
•
Unitary matrices:
•
A normal matrix is Hermitian if and only if it has real eigenvalues.
Spectral Decomposition
Definition: A linear operator is diagonalizable if and only if it is normal.
Some notes and derivation regarding the above:
where 's are linearly independent eigenvalues of .
where
Matrices and Vectors
In the following statements we are dealing with as a orthonormal basis set.
Now, to represent a operator or linear transformation as matrix in orthonormal basis.
Now diagonalization for any normal matrix.
where are eigenvalues of under a given orthonormal basis set for vector space , each is an eigenvector of with eigenvalue .
If is Hermitian, all eigenvalues are non-negative.
Tensor Products
•
•
•
•
Linear Product
forms the linear operator that acts on vector space givern that acts on and acts on .
Inner Product
Trace
Properties of trace are given below as follows.
•
•
for orthonormal basis
•
•
The above properties yield certain implications as follows.
•
•
Hilbert-Schimdt Inner Product
forms the vector space of operators over the Hilbert space . Then, we can show that is also a Hilbert space with as the inner product operator on .
Also, we have .
Commutator and Anti-commutator
Theorem of Simultaneous Diagonalization
Suppose and are both Hermitian matrices, then iff orthonormal basis such that both and are diagonal with respect to that basis.
Polar Value Decomposition
If is any linear operator and is a unitary then are positive operators, such that
Moreover, if exists, then is unique.
Singular Value Decomposition
If is a square matrix and unitaries then is a diagonal matrix, such that
where has non-negative values.