$\renewcommand{\Re}{\operatorname{Re}}$ $\renewcommand{\Im}{\operatorname{Im}}$ $\newcommand{\erf}{\operatorname{erf}}$ $\newcommand{\supp}{\operatorname{supp}}$ $\newcommand{\dag}{\dagger}$ $\newcommand{\const}{\mathrm{const}}$ $\newcommand{\arcsinh}{\operatorname{arcsinh}}$
During this course we considered many linear operators: differential operators like $u\to Lu:= au_{xx}+ 2bu_{xy}+ cu$ and integral operators \begin{equation} u(x)\to (Lu)(x):= \int K(x,y)u(y)\, dy \label{eq-11.3.1} \end{equation} (recall that solutions of IVP, BVP and IBVP for PDEs was often given in such form). For integral operators $K(x,y)$ is called (integral) kernel of operator $L$ (not to be confused with the kernel of operator $L$ which is $N(L)=\{u:\, Lu=0\}$.
L.Schwartz proved a remarkable theorem showing that each linear operator is in some sense integral operator:
Theorem 1.
Definition 1. Such $K$ is called Schwartz kernel of operator $L$.
Example 1.
More examples are coming.
In Physics you considered masses or charges at several points (atom masses or charges) and continuously distributed. In the Probability Theory the same was for probabilities. Continuously distributed masses, charges or probabilities had densities while atom masses, charges or probabilities had not.
Remark 1. For those who took Real Analysis: in fact densities were assigned only to absolutely continuous, not to singular continuous distributions. But it does not matter here.
The theory of distributions allows us a unified approach. Consider $1$-dimensional case first. Let $Q(x)$ be a charge of $(-\infty, x)$. Similarly, in probability theory let $P(x)$ be a probability to fall into $(-\infty, x)$. Both $Q(x)$ and $P(x)$ are functions of distribution (of charge or probability). If they were smooth functions then their derivatives would be densities. But even if they are not we can differentiate them in the sense of distributions!
Similarly, in $d$-dimensional case for $x=(x_1,x_2,\ldots,x_d)$ we can introduce $d$-dimensional functions of distributions: let $Q(x)$ be a charge of $(-\infty, x_1)\times (-\infty, x_2)\times \ldots \times (-\infty, x_d)$ or probability to fall into this set. Then \begin{equation} p(x)=\partial_{x_1}\partial_{x_2}\cdots \partial_{x_d}P(x) \label{eq-11.3.3} \end{equation} is a density.
Example 2.
We know that function $g(x)=\left\{\begin{aligned} & |x|^{2-d} &&d\ne 2,\\ &\ln |x| &&d=2\end{aligned}\right.$ satisfies Laplace equation as $x\ne 0$. Now we need to check what happens at $x=0$. Namely, we need to calculate $\Delta g$ in the sense of distributions and to do this we consider \begin{equation*} g(\Delta \varphi)= \int g(x) \Delta \varphi(x)\, dx = \lim_{\varepsilon \to 0} \int_{\Omega_\varepsilon} g(x) \Delta \varphi(x)\, dx \end{equation*} where $\Omega_\varepsilon =\mathbb{R}^d\setminus B(0,\varepsilon)$. The same calculations as earlier in Subsection 7.2.2 show that it is equal to (we skip limit temporarily) \begin{equation*} \int_{\Omega_\varepsilon} (\Delta g(x)) \varphi(x)\, dx + \int_{S(0,\varepsilon)} \Bigl[ (-\partial_r \varphi(x)) g(x)+ \varphi(x)\partial_r g(x)\Bigr]\, d\sigma \end{equation*} and since $\Delta g=0$ in $\Omega_\varepsilon$ the first term is $0$ and the second one is \begin{equation*} \int_{S(0,\varepsilon)} \Bigl[ (-\varepsilon^{2-d}\partial_r \varphi(x)) + \underbracket{(2-d)\varepsilon^{1-d}}\varphi(x)\Bigr]\, d\sigma \end{equation*} where for $d=2$ selected expression should be replaced by $\varepsilon^{-1}$. Taking the limit we see that since the area of $S(0,\varepsilon)$ is $\sigma_d\varepsilon^{-1}$ the first term disappears and the second becomes $(2-d)\sigma_d \varphi(0)$ as $d\ne 2$ and $\sigma_2 \varphi(0)$ where $\sigma_d$ is an "area" of $S(0,1)$.
Therefore \begin{equation} \Delta G (x)= \delta (x) \label{eq-11.3.4} \end{equation} where \begin{equation} G (x)= \left\{\begin{aligned} -(d-2)^{-1}\sigma_d^{-1} |x|^{2-d}& &&d\ne 2,\\ (2\pi)^{-1}\ln |x|& &&d=2\end{aligned}\right. . \label{eq-11.3.5} \end{equation} But then $u=G* f$ solves $\Delta u=f$ in $\mathbb{R}^d$. Indeed, as $\Delta$ has constant coefficients and derivatives could be applied to any "factor" in the convolution $\Delta (G*f)=(\Delta G)*f=\delta*f=f$.
Remark 2.
Remark 3. As $d=3$ from Subsection 9.1.5 we can guess that $G(x,\omega) = -\frac{1}{4\pi}|x|^{-1}e^{\mp i\omega |x|}$ solves Helmholtz equation with Sommerfeld radiating conditions \begin{align} &\!\bigl(\Delta +\omega^2\bigr)G = \delta(x) \label{eq-11.3.6},\\ &G= o(1) &&\text{as }|x|\to \infty,\label{eq-11.3.7}\\ &(\partial_r \pm i\omega )G= o( r^{-1}) &&\text{as }|x|\to \infty. \label{eq-11.3.8} \end{align}
Remark 4. Similarly Green function $G(x,y)$ for Dirichlet boundary problem in $\Omega$ satisfies \begin{align} &\Delta_x G = \delta(x-y) \label{eq-11.3.9},\\ &G|_{x\in \partial \Omega}= 0.\label{eq-11.3.10} \end{align} and Green function $G(x,y)$ for Robin boundary problem in $\Omega$ satisfies the same equation but with Robin boundary condition \begin{equation} (\partial_{\nu_x} + \alpha)G|_{x\in \partial \Omega}= 0.\label{eq-11.3.11} \end{equation} Here $x,y\in \Omega$.
Consider Green function for diffusion equation im $\mathbb{R}^d$: \begin{equation} G(x,t) = (4\pi kt)^{-\frac{d}{2}} e^{-\frac{|x|^2}{4kt}}. \label{eq-11.3.12} \end{equation} It satisfies diffusion equation $G_t= k\Delta G$ as $t>0$ and as $t\to 0$ it tends to $\delta (x)$.
Further, if we define \begin{equation} H^+(x,t)= \left\{\begin{aligned} G(x,t)&&&t >0,\\ 0&&&t\le 0 \end{aligned}\right. \label{eq-11.3.13} \end{equation} we see that \begin{equation} (\partial_t- k\Delta)H^+(x,t)=\delta(x)\delta(t). \label{eq-11.3.14} \end{equation}
Similarly \begin{equation} G(x,t) = (4\pi k|t|)^{-\frac{d}{2}} e^{\mp \frac{id\pi}{4}} e^{-\frac{|x|^2}{4kit}}\qquad\text{as }\pm t>0 \label{eq-11.3.15} \end{equation} satisfies Schrödinger equation $G_t=ik\Delta G$ (even as $t=0$) and as $t\to 0$ it tends to $\delta (x)$. Further, if we define \begin{equation} H^\pm (x,t)= \left\{\begin{aligned} \pm G(x,t)&&&\pm t >0,\\ 0&&&\pm t\le 0 \end{aligned}\right. \label{eq-11.3.16} \end{equation} we see that \begin{equation} (\partial_t- ik\Delta)H^\pm (x,t)=\delta(x)\delta(t). \label{eq-11.3.17} \end{equation}
It follows from Kirchhoff formula that \begin{equation} G(x,t)= \frac{1}{4\pi c^2 |t|}\bigl( \delta (|x|-ct)-\delta (|x|+ct)\bigr) \label{eq-11.3.18} \end{equation} satisfies $3$-dimensional wave equation $G_{tt}-c^2\Delta G=0$ and also \begin{equation} G(x,t)\bigr|_{t=0}= 0, \qquad G_t(x,t)\bigr|_{t=0}= \delta (x). \label{eq-11.3.19} \end{equation} It follows from (9.1.15) that \begin{equation} G(x,t)= \pm \frac{1}{2\pi c } (c^2t^2-|x-y|^2)_+^{-\frac{1}{2}} \label{eq-11.3.20} \end{equation} satisfies $2$-dimensional wave equation $G_{tt}-c^2\Delta G=0$ and also (\ref{eq-11.3.19}); here $z_+^\lambda= z^\lambda \theta(z)$; recall that $\theta(z)$ is a Heaviside function.
Formulae (9.1.23) and (9.1.24) allow us to construct $G(x,t)$ for odd $d\ge 3$ and even $d\ge 2$.
D'Alembert formula allows us to construct as $d=1$: \begin{equation} G(x,t)= \frac{1}{2c}\bigl( \theta (x+ct)-\theta (x-ct)\bigr). \label{eq-11.3.21} \end{equation}
Defining $H^\pm (x,t)$ by (\ref{eq-11.3.16}) we get \begin{equation} (\partial^2_t- c^2\Delta)H^\pm (x,t)=\delta(x)\delta(t). \label{eq-11.3.22} \end{equation}
Definition 2. If $H$ satisfies $LH=\delta (x-y)$ it is called fundamental solution to $L$.
$\Leftarrow$ $\Uparrow$ $\Rightarrow$