8.3 Theorem Given a double sequence , suppose that
$$
\begin{equation} \sum_{j=1}^{\infty}\vert a_{i,j}\vert=b_i\hspace{1cm}(i=1,2,3,\ldots)\end{equation}
$$
and converges. Then
$$
\begin{equation} \sum_{i=1}^{\infty}\sum_{j=1}^{\infty}a_{i,j}= \sum_{j=1}^{\infty}\sum_{i=1}^{\infty}a_{i,j}.\end{equation}
$$
Proof Let be a countable set, consisting of the points and suppose as . Define
$$
\begin{equation} \begin{aligned} f_i(x_n)&=\sum_{j=1}^{n}a_{i,j} \hspace{1cm}(i,n=1,2,3,\ldots),\\ f_i(x_0)&=\sum_{j=1}^{\infty}a_{i,j} \hspace{1cm}(i=1,2,3,\ldots),\\ g(x)&=\sum_{i=1}^{\infty}f_{i}(x) \hspace{1cm}(x\in E). \end{aligned}\end{equation}
$$
And they are pretty well-defined. Since
$$
\begin{equation} \lim_{n\rightarrow\infty} f_i(x_n)=f_i(x_0)\end{equation}
$$
and
$$
\begin{equation} \lim_{n \rightarrow \infty}x_n=x_0,\end{equation}
$$
is continuous at . In addition, since
$$
\begin{equation} f_i(x_0)\leq \sum_{j=1}^{\infty}\vert a_{i,j}\vert=b_i\hspace{1cm}(i=1,2,3,\ldots),\\ f_i(x_n)\leq \sum_{j=1}^{\infty}\vert a_{i,j}\vert=b_i\hspace{1cm}(i=1,2,3,\ldots),\end{equation}
$$
and converges, we know that converges uniformly, thus is continuous at too. The continuity of implies that
$$
\begin{equation} \begin{aligned} \lim_{n \rightarrow \infty}g(x_n)&=g(x_0), \\ g(x_0)=\sum_{i=1}^{\infty}\sum_{j=1}^{\infty}a_{i,j}&=\lim_{n \rightarrow \infty}g(x_n)=\lim_{n \rightarrow \infty}\sum_{i=1}^{\infty}\sum_{j=1}^{n}a_{i,j}. \end{aligned}\end{equation}
$$
Note that
$$
\begin{equation} g(x_n)=\sum_{i=1}^{\infty}\sum_{j=1}^{n}a_{i,j} =\sum_{j=1}^{n}\sum_{i=1}^{\infty}a_{i,j},\end{equation}
$$
which can be proved by using the mathematical induction.
Firstly, it’s obivious that the equation is correct when . Assume that it holds for . i.e.,
$$
\begin{equation} g(x_k)=\sum_{i=1}^{\infty}\sum_{j=1}^{k}a_{i,j}= \sum_{j=1}^{k}\sum_{i=1}^{\infty}a_{i,j},\end{equation}
$$
and then consider the situation where . Since
$$
\begin{equation} \begin{aligned} g(x_{k+1})&=\sum_{i=1}^{\infty}\sum_{j=1}^{k+1}a_{i,j}= \sum_{i=1}^{\infty}\sum_{j=1}^{k}a_{i,j}+\sum_{i=1}^{\infty}a_{i,k+1}\\ &=\sum_{j=1}^{k}\sum_{i=1}^{\infty}a_{i,j}+\sum_{i=1}^{\infty}a_{i,k+1}\\ &=\sum_{j=1}^{k+1}\sum_{i=1}^{\infty}a_{i,j}, \end{aligned}\end{equation}
$$
hence we conclude that
$$
\begin{equation} g(x_n)=\sum_{i=1}^{\infty}\sum_{j=1}^{n}a_{i,j} =\sum_{j=1}^{n}\sum_{i=1}^{\infty}a_{i,j}.\end{equation}
$$
Thus,
$$
\begin{equation} \begin{aligned} g(x_0)=\sum_{i=1}^{\infty}\sum_{j=1}^{\infty}a_{i,j}&=\lim_{n \rightarrow \infty}g(x_n)=\lim_{n \rightarrow \infty}\sum_{i=1}^{\infty}\sum_{j=1}^{n}a_{i,j}\\ &=\lim_{n \rightarrow \infty}\sum_{j=1}^{n}\sum_{i=1}^{\infty}a_{i,j}\\ &=\sum_{j=1}^{\infty}\sum_{i=1}^{\infty}a_{i,j}, \end{aligned}\end{equation}
$$
i.e.,
$$
\begin{equation} \sum_{i=1}^{\infty}\sum_{j=1}^{\infty}a_{i,j}= \sum_{j=1}^{\infty}\sum_{i=1}^{\infty}a_{i,j}.\end{equation}
$$