quantum mechanics - What is the most general expression for the coordinate representation of momentum operator?

I have a question about deriving the coordinate representation of momentum operator from the commutation relation, $[x,p]= i$.

One derivation (ref W. Greiner's Quantum Mechanics: An Introduction, 4th edi, p442) is as following:

$$\langle x|[x,p]|y \rangle = \langle x|xp-px|y \rangle = (x-y) \langle x|p|y \rangle.$$ On the other hand, $\langle x|[x,p]|y \rangle = i \langle x|y \rangle = i \delta (x-y)$. Thus $$(x-y) \langle x|p|y \rangle = i \delta(x-y). \tag{1}$$

We use $(x-y) \delta(x-y) = 0$. Take the derivative with respect to $x$; we have $\delta(x-y) + (x-y) \delta'(x-y) = 0$. Thus

$$(x-y) \delta'(x-y) = - \delta(x-y). \tag{2}$$

Comparing Eqs. (1) and (2), we identify

$$\langle x|p|y \rangle = -i \delta'(x-y). \tag{3}$$

In addition, we can add $\alpha \delta(x-y)$ on the right-hand side of Eq. (3), i.e.

$$\langle x|p|y \rangle = -i \delta'(x-y) + \alpha \delta(x-y),$$ and $[x,p] = i$ is still satisfied. We can also add $$\frac{\beta}{\sqrt{|x-y|}}\delta(x-y)$$ on the RHS of Eq. (3). Here $\alpha$ and $\beta$ are two real numbers.

My question is, what is the most general expression of $\langle x|p|y \rangle$? Can we always absorb the additional term into a phase factor like Dirac's quantum mechanics book did?

Thank you very much in advance.

Answer

We start by mentioning a couple of standard formulas

$$\tag{1} \psi(x)~=~\langle x | \psi \rangle,$$

and

$$\tag{2} \langle x | y \rangle ~=~\delta(x-y).$$

The canonical commutation relation (CCR) is

$$\tag{3} [\hat{x}, \hat{p}] ~=~i\hbar{\bf 1}.$$

The standard Schrödinger position representation reads

$$\tag{4}\hat{x}~=~x, \qquad \hat{p}~=~-i\hbar\frac{\partial}{\partial x}.$$

We may conjugate the standard Schrödinger position representation (4) by an unitary operator $\hat{U}=e^{-if(\hat{x})}$, where $f:\mathbb{R}\to\mathbb{R}$ is a given differentiable function. In this way we obtain an unitary equivalent position representation

$$\tag{5}\hat{x}~=~x, \qquad \hat{p} ~=~-i\hbar e^{-if(x)}\frac{\partial}{\partial x}e^{if(x)} ~=~-i\hbar\frac{\partial}{\partial x}+ \hbar f^{\prime}(x),$$

of the CCR (3). The standard Schrödinger position representation (4) corresponds to $f\equiv {\rm const}$. For a general irreducible representation of the CCR (3), see the Stone-von Neumann Theorem.

The representation (5) implies

$$\tag{6} \langle x | \hat{p} |\psi \rangle~=~(\hat {p} \psi)(x) ~=~-i\hbar e^{-if(x)}(e^{if}\psi)^{\prime}(x) ~=~-i\hbar\psi^{\prime}(x)+ \hbar f^{\prime}(x)\psi(x).$$

From (6) we conclude that the momentum matrix elements reads

$$\tag{7} \langle x | \hat{p} |y \rangle~=~-i\hbar\delta^{\prime}(x-y)+ \hbar f^{\prime}(x)\delta(x-y)$$

in the representation (5).

Finally, here and here are two other Phys.SE posts that also discuss ambiguities in $x\leftrightarrow p$ overlaps.