8.3 Theorem Given a double sequence , suppose that

$$ \begin{equation} \sum_{j=1}^{\infty}\vert a_{i,j}\vert=b_i\hspace{1cm}(i=1,2,3,\ldots)\end{equation} $$

and  converges. Then

$$ \begin{equation} \sum_{i=1}^{\infty}\sum_{j=1}^{\infty}a_{i,j}= \sum_{j=1}^{\infty}\sum_{i=1}^{\infty}a_{i,j}.\end{equation} $$

Proof Let be a countable set, consisting of the points and suppose as . Define

$$ \begin{equation} \begin{aligned} f_i(x_n)&=\sum_{j=1}^{n}a_{i,j} \hspace{1cm}(i,n=1,2,3,\ldots),\\ f_i(x_0)&=\sum_{j=1}^{\infty}a_{i,j} \hspace{1cm}(i=1,2,3,\ldots),\\ g(x)&=\sum_{i=1}^{\infty}f_{i}(x) \hspace{1cm}(x\in E). \end{aligned}\end{equation} $$

And they are pretty well-defined. Since

$$ \begin{equation} \lim_{n\rightarrow\infty} f_i(x_n)=f_i(x_0)\end{equation} $$

and

$$ \begin{equation} \lim_{n \rightarrow \infty}x_n=x_0,\end{equation} $$

is continuous at . In addition, since

$$ \begin{equation} f_i(x_0)\leq \sum_{j=1}^{\infty}\vert a_{i,j}\vert=b_i\hspace{1cm}(i=1,2,3,\ldots),\\ f_i(x_n)\leq \sum_{j=1}^{\infty}\vert a_{i,j}\vert=b_i\hspace{1cm}(i=1,2,3,\ldots),\end{equation} $$

and converges, we know that converges uniformly, thus is continuous at too. The continuity of implies that

$$ \begin{equation} \begin{aligned} \lim_{n \rightarrow \infty}g(x_n)&=g(x_0), \\ g(x_0)=\sum_{i=1}^{\infty}\sum_{j=1}^{\infty}a_{i,j}&=\lim_{n \rightarrow \infty}g(x_n)=\lim_{n \rightarrow \infty}\sum_{i=1}^{\infty}\sum_{j=1}^{n}a_{i,j}. \end{aligned}\end{equation} $$

  Note that

$$ \begin{equation} g(x_n)=\sum_{i=1}^{\infty}\sum_{j=1}^{n}a_{i,j} =\sum_{j=1}^{n}\sum_{i=1}^{\infty}a_{i,j},\end{equation} $$

which can be proved by using the mathematical induction.

  Firstly, it’s obivious that the equation is correct when . Assume that it holds for . i.e.,

$$ \begin{equation} g(x_k)=\sum_{i=1}^{\infty}\sum_{j=1}^{k}a_{i,j}= \sum_{j=1}^{k}\sum_{i=1}^{\infty}a_{i,j},\end{equation} $$

and then consider the situation where . Since

$$ \begin{equation} \begin{aligned} g(x_{k+1})&=\sum_{i=1}^{\infty}\sum_{j=1}^{k+1}a_{i,j}= \sum_{i=1}^{\infty}\sum_{j=1}^{k}a_{i,j}+\sum_{i=1}^{\infty}a_{i,k+1}\\ &=\sum_{j=1}^{k}\sum_{i=1}^{\infty}a_{i,j}+\sum_{i=1}^{\infty}a_{i,k+1}\\ &=\sum_{j=1}^{k+1}\sum_{i=1}^{\infty}a_{i,j}, \end{aligned}\end{equation} $$

hence we conclude that

$$ \begin{equation} g(x_n)=\sum_{i=1}^{\infty}\sum_{j=1}^{n}a_{i,j} =\sum_{j=1}^{n}\sum_{i=1}^{\infty}a_{i,j}.\end{equation} $$

  Thus,

$$ \begin{equation} \begin{aligned} g(x_0)=\sum_{i=1}^{\infty}\sum_{j=1}^{\infty}a_{i,j}&=\lim_{n \rightarrow \infty}g(x_n)=\lim_{n \rightarrow \infty}\sum_{i=1}^{\infty}\sum_{j=1}^{n}a_{i,j}\\ &=\lim_{n \rightarrow \infty}\sum_{j=1}^{n}\sum_{i=1}^{\infty}a_{i,j}\\ &=\sum_{j=1}^{\infty}\sum_{i=1}^{\infty}a_{i,j}, \end{aligned}\end{equation} $$

i.e.,

$$ \begin{equation} \sum_{i=1}^{\infty}\sum_{j=1}^{\infty}a_{i,j}= \sum_{j=1}^{\infty}\sum_{i=1}^{\infty}a_{i,j}.\end{equation} $$