Abstract
The viscosity technique for the implicit midpoint rule of nonexpansive mappings in Hilbert spaces is established. The strong convergence of this technique is proved under certain assumptions imposed on the sequence of parameters. Moreover, it is shown that the limit solves an additional variational inequality. Applications to variational inequalities, hierarchical minimization problems, and nonlinear evolution equations are included.
Similar content being viewed by others
1 Introduction
The viscosity technique for nonexpansive mappings in Hilbert spaces was introduced by Moudafi [1], following the ideas of Attouch [2]. Refinements in Hilbert spaces and extensions to Banach spaces were obtained by Xu [3]. This technique uses (strict) contractions to regularize a nonexpansive mapping for the purpose of selecting a particular fixed point of the nonexpansive mapping, for instance, the fixed point of minimal norm or of a solution to another variational inequality.
Let H be a Hilbert space, let \(T: H\to H\) be a nonexpansive mapping (i.e., \(\|Tx-Ty\|\le\|x-y\|\) for all \(x,y\in H\)), and let \(f: H\to H\) be a contraction (i.e., \(\|f(x)-f(y)\|\le\alpha\|x-y\|\) for all \(x,y\in H\) and some \(\alpha\in[0,1)\)). The explicit viscosity method for nonexpansive mappings generates a sequence \(\{x_{n}\}\) through the iteration process:
where I is the identity of H and \(\{\alpha_{n}\}\) is a sequence in \((0,1)\). It is well known [1, 3] that under certain conditions, the sequence \(\{x_{n}\}\) converges in norm to a fixed point q of T which solves the variational inequality (VI)
where S is the set of fixed points of T, namely, \(S=\{x\in H: Tx=x\}\).
The implicit midpoint rule (IMR) is one of the powerful methods for solving ordinary differential equations; see [4–9] and the references therein. For instance, consider the initial value problem for the differential equation \(y'(t)=f(y(t))\) with the initial condition \(y(0)=y_{0}\), where f is a continuous function from \(\mathbb{R}^{d}\) to \(\mathbb{R}^{d}\). The IMR is an implicit method that generates a sequence \(\{y_{n}\}\) via the relation
In the case of nonlinear dissipative evolution equations in a Hilbert space H, the function f is of the form \(f=I-T\) with I the identity and T a nonexpansive mapping of H. The equilibrium problem is reduced to the fixed point problem \(x=Tx\). The IMR has therefore been extended [10] to nonexpansive mappings, which generates a sequence \(\{x_{n}\}\) by the implicit procedure:
where the initial guess \(x_{0}\in H\) is arbitrarily chosen, \(t_{n}\in (0,1)\) for all n.
In the present paper we will apply the viscosity technique to the implicit midpoint rule for nonexpansive mappings. More precisely, we consider the following semi-implicit algorithm which we call viscosity implicit midpoint rule (VIMR, for short):
The idea is to use contractions to regularize the implicit midpoint rule for nonexpansive mappings. We will prove that the VIMR converges in norm to a fixed point of T which, in addition, also solves the VI (1.2).
The structure of the paper is set as follows. In Section 2, we introduce the notion of nearest point projections, the demiclosedness principle of nonexpansive mappings, and a convergence lemma. The viscosity implicit midpoint rule for nonexpansive mappings is introduced in Section 3. The main result, that is, the strong convergence of this method, is proved also in this section. Applications to variational inequalities, hierarchical minimization problems and nonlinear evolution equations are presented in the final section, Section 4.
2 Preliminaries
Assume that H is a Hilbert space with inner product \(\langle\cdot ,\cdot\rangle\) and norm \(\|\cdot\|\), respectively, and let C be a nonempty, closed, and convex subset of H. We then have the nearest point projection from H onto C, \(P_{C}\), defined by
Namely, \(P_{C}x\) is the only point in C that minimizes the objective \(\| x-z\|^{2}\) over \(z\in C\).
Note that \(P_{C}x\) is characterized as follows:
Recall that a mapping \(T: C\to C\) is said to be nonexpansive if
The set of fixed points of T is written \(\operatorname{Fix}(T)\), that is, \(\operatorname{Fix}(T)=\{x\in C: Tx=x\}\). Note that \(\operatorname{Fix}(T)\) is always closed and convex; further note that if, in addition, C is bounded, then \(\operatorname{Fix}(T)\) is nonempty (cf. [11]).
The demiclosedness principle of nonexpansive mappings is quite helpful in verifying the weak convergence of an algorithm to a fixed point of a nonexpansive mapping.
Lemma 2.1
[11] (The demiclosedness principle)
Let H be a Hilbert space, C a closed convex subset of H, and \(T: C\to C\) a nonexpansive mapping with \(\operatorname{Fix}(T)\neq\emptyset\). If \(\{x_{n}\}\) is a sequence in C such that (i) \(\{x_{n}\}\) weakly converges to x and (ii) \(\{(I-T)x_{n}\}\) converges strongly to 0, then \(x=Tx\).
In proving the strong convergence of a sequence \(\{x_{n}\}\) to a point \(\bar{x}\), we always consider the real sequence \(\{\|x_{n}-\bar{x}\|^{2}\}\) and then apply the following convergence lemma.
Lemma 2.2
[12]
Assume \(\{a_{n}\}\) is a sequence of nonnegative real numbers such that
where \(\{\gamma_{n}\}\) is a sequence in \((0,1)\) and \(\{\delta_{n}\}\) is a sequence in ℝ such that
-
(i)
\(\sum_{n=1}^{\infty}\gamma_{n}=\infty\), and
-
(ii)
either \(\limsup_{n\to\infty}\delta_{n}/\gamma_{n}\le0\) or \(\sum_{n=1}^{\infty}|\delta_{n}|<\infty\).
Then \(\lim_{n\to\infty} a_{n}=0\).
3 The viscosity technique for implicit midpoint rule
Let H be a Hilbert space, C a nonempty, closed, and convex subset of H, and \(T: C\to C\) a nonexpansive mapping such that \(\operatorname{Fix}(T)\neq\emptyset\). Moreover, let \(f: C\to C\) be a contraction with coefficient \(\alpha\in[0,1)\). The viscosity method for nonexpansive mappings is essentially a regularization method of nonexpansive mappings by contractions. In this section we consider the viscosity technique for the implicit midpoint rule of nonexpansive mappings which generates a sequence \(\{x_{n}\}\) in the semi-implicit manner:
where \(\alpha_{n}\in(0,1)\) for all n. Note that the scheme (3.1) is well defined for all n.
We will employ the following conditions on \(\{\alpha_{n}\}\):
-
(C1)
\(\lim_{n\to\infty}\alpha_{n}=0\),
-
(C2)
\(\sum_{n=0}^{\infty}\alpha_{n}=\infty\),
-
(C3)
either \(\sum_{n=0}^{\infty}|\alpha_{n+1}-\alpha_{n}|<\infty\) or \(\lim_{n\to\infty}\frac{\alpha_{n+1}}{\alpha_{n}}=1\).
The main result of this paper is the following result, the proof of which seems nontrivial.
Theorem 3.1
Let H be a Hilbert space, C a closed convex subset of H, \(T: C\to C\) a nonexpansive mapping with \(S:=\operatorname{Fix}(T)\neq\emptyset\), and \(f: C\to C\) a contraction with coefficient \(\alpha\in[0,1)\). Let \(\{x_{n}\}\) be generated by the viscosity implicit midpoint rule (3.1). Assume the conditions (C1)-(C3). Then \(\{x_{n}\}\) converges in norm to a fixed point q of T, which is also the unique solution of the variational inequality
In other words, q is the unique fixed point of the contraction \(P_{S}f\), that is, \(P_{S}f(q)=q\).
Proof
We divide the proof into several steps.
Step 1. We prove that \(\{x_{n}\}\) is bounded. To see this we take \(p\in S\) to deduce that
It then follows that
and, moreover,
Consequently, we get
By induction we readily obtain
for all n. It turns out that \(\{x_{n}\}\) is bounded.
Step 2. \(\lim_{n\to\infty}\|x_{n+1}-x_{n}\|=0\). To see this we apply (3.1) to get
Here \(M>0\) is a constant such that
It turns out that
Consequently, we arrive at
By virtue of the conditions (C2) and (C3), we can apply Lemma 2.2 to (3.3) to obtain \(\|x_{n+1}-x_{n}\|\to0\) as \(n\to\infty\), as required.
Step 3. \(\lim_{n\to\infty}\|x_{n}-Tx_{n}\|=0\). This follows from the argument below:
Step 4. We prove that \(\omega_{w}(x_{n})\subset \operatorname{Fix}(T)\). Here
is the weak ω-limit set of \(\{x_{n}\}\). This is now a straightforward consequence of Step 3 and Lemma 2.1.
Step 5. We claim that
where \(q\in S\) is the unique fixed point of the contraction \(P_{S}f\), that is, \(q=P_{S}(f(q))\).
As a matter of fact, we can find a subsequence \(\{x_{n_{j}}\}\) of \(\{x_{n}\} \) such that \(\{x_{n_{j}}\}\) converges weakly to a point p and moreover,
Since \(p\in \operatorname{Fix}(T)\) by Step 4, we can combine (3.4) and (3.5) and use (2.2) to conclude
Step 6. We finally prove that \(x_{n}\to q\) in norm. Here again \(q\in \operatorname{Fix}(T)\) is the unique fixed point of the contraction \(P_{S}f\) or in other words, \(q=P_{S}f(q)\). We present the details as follows:
Let
It turns out that
Solving this quadratic inequality for \(\Vert \frac {x_{n}+x_{n+1}}{2}-q\Vert \) yields
This implies that
We therefore get
which is reduced to the inequality
which is further reduced by using the elementary inequality
to the following inequality:
Solving for \(\|x_{n+1}-q\|^{2}\) yields
where
Observing
and
we can rewrite (3.7) as
Consider the function
It is not hard (after certain manipulations) to rewrite \(h(t)\) as
It turns out that
Let \(\delta_{0}>0\) satisfy
In other words, we have
As \(\alpha_{n}\to0\) as \(n\to\infty\), we have an integer \(N_{0}\) big enough so that \(\alpha_{n}<\delta\) for all \(n\ge N_{0}\). It then turns out from (3.9) that, for all \(n\ge N_{0}\),
Notice that by Steps 2 and 3, we have
It then turns out from the definition (3.6) of \(\beta_{n}\) and (3.4) that
which in turn implies that
Finally, (3.11) and the conditions (C1) and (C2) enable us to apply Lemma 2.2 to the inequality (3.10) to conclude that \(\lim_{n\to\infty} \|x_{n}-q\|^{2}=0\), namely, \(x_{n}\to q\) in norm. The proof is therefore complete. □
4 Applications
4.1 Application to variational inequalities
Consider the variational inequality (VI)
where A is a (single-valued) monotone operator in H and C is a closed convex subset of H. We assume \(C\subset\operatorname{dom}(A)\). An example of (4.1) is the constrained minimization problem
where \(\varphi: H\to\mathbb{R}\) is a lower-semicontinuous convex function. If φ is (Fréchet) differentiable, then the minimization (4.2) is equivalently reformulated as (4.1) with \(A=\nabla\varphi\).
Notice that the VI (4.1) is equivalent to the fixed point problem, for any \(\lambda>0\),
If A is Lipschitzian and strongly monotone, then, for \(\lambda>0\) small enough, T is a contraction and its unique fixed point is also the unique solution of the VI (4.1). However, if A is not strongly monotone, T is no longer a contraction, in general. In this case we must deal with nonexpansive mappings for solving the VI (4.1). More precisely, we assume
-
(A1)
A is L-Lipschitzian for some \(L>0\), that is,
$$\|Ax-Ay\|\le L\|x-y\|,\quad x,y\in H. $$ -
(A2)
A is μ-inverse strongly monotone (μ-ism) for some \(\mu>0\), namely,
$$\langle Ax-Ay,x-y\rangle\ge\mu\|Ax-Ay\|^{2},\quad x,y \in H. $$
Note that if ∇φ is L-Lipschtzian, then ∇φ is \(\frac{1}{L}\)-ism.
Under the conditions (A1) and (A2), it is well known [13] that the operator \(T=P_{C}(I-\lambda A)\) is nonexpansive provided \(0<\lambda<2\mu\). It turns out that for this range of values of λ, fixed point algorithms can be applied to solve the VI (4.1). Applying Theorem 3.1 we get the result below.
Theorem 4.1
Assume the VI (4.1) is solvable. Assume also A satisfies (A1) and (A2), and \(0<\lambda<2\mu\). Let \(f: C\to C\) be a contraction. Define a sequence \(\{x_{n}\}\) by the viscosity implicit midpoint rule:
In addition, assume \(\{\alpha_{n}\}\) satisfies the conditions (C1)-(C3). Then \(\{x_{n}\}\) converges in norm to a solution \(x^{*}\) of the VI (4.1) which is also a solution to the VI
4.2 Application to hierarchical minimization
We next consider a hierarchical minimization problem (see [14] and references therein).
Let \(\varphi_{0}, \varphi_{1}: H\to\mathbb{R}\) be lower semicontinuous convex functions. Consider the hierarchical minimization
Here we always assume that \(S_{0}\) is nonempty. Let \(S=\arg\min_{x\in S_{0}}\varphi_{1}(x)\) and assume \(S\neq\emptyset\).
Assume \(\varphi_{0}\) and \(\varphi_{1}\) are differentiable and their gradients satisfy the Lipschitz continuity conditions:
Note that the condition (4.5) implies that \(\nabla\varphi_{i}\) is \(\frac{1}{L_{i}}\)-ism (\(i=0,1\)). Now let
where \(\gamma_{0}>0\) and \(\gamma_{1}>0\). Note that \(T_{i}\) is (averaged) nonexpansive [13] if \(0<\gamma_{i}<2/L_{i}\) (\(i=0,1\)). Also, it is easily seen that \(S_{0}=\operatorname{Fix}(T_{0})\).
The optimality condition for \(x^{*}\in S_{0}\) to be a solution of the hierarchical minimization (4.4) is the VI:
This is the VI (4.1) with \(C=S_{0}\) and \(A=\nabla\varphi_{1}\). We therefore have the following result.
Theorem 4.2
Assume the hierarchical minimization problem (4.4) is solvable. Assume (4.5) and \(0<\gamma_{i}<2/L_{i}\) (\(i=0,1\)). Let \(f: C\to C\) be a contraction. Define a sequence \(\{x_{n}\}\) by the viscosity implicit midpoint rule:
In addition, assume \(\{\alpha_{n}\}\) satisfies the conditions (C1)-(C3). Then \(\{x_{n}\}\) converges in norm to a solution \(x^{*}\) of the VI (4.1) which also solves the VI
4.3 Application to nonlinear evolution equation
Browder [15] proved the existence of a periodic solution of the time-dependent nonlinear evolution equation in a (real) Hilbert space H,
where \(A(t)\), a family of closed linear operators in H, and \(f: \mathbb{R}\times H \to H\) satisfy the following conditions:
-
(B1)
\(A(t)\) and \(f(t,u)\) are periodic in t of period \(\xi> 0\).
-
(B2)
For each t and each pair \(u, v \in H\),
$$\bigl\langle f(t,u) - f(t,v), u - v\bigr\rangle \le0. $$ -
(B3)
For each t and each \(u\in D(A(t))\), \(\langle A(t)u,u\rangle\ge0\).
-
(B4)
There exists a mild solution u of (4.7) on \(\mathbb{R}^{+}\) for each initial value \(v \in H\). Recall that u is a mild solution of (4.7) with initial value \(u(0)=v\) if, for each \(t>0\),
$$u(t)=U(t,0)v+\int_{0}^{t} U(t,s)f\bigl(s,u(s) \bigr)\,ds, $$where \(\{U(t,s)\}_{t\ge s\ge0}\) is the evolution system for the homogeneous linear system
$$ \frac{du}{dt}+A(t)u=0\quad (t>s). $$(4.8) -
(B5)
There exists some \(R > 0\) such that
$$\bigl\langle f(t,u),u\bigr\rangle < 0 $$for \(\|u\|= R\) and all \(t \in[0,\xi]\).
Note that under the conditions (B1)-(B5), the solution u has period ξ and \(\|u(0)\|< R\).
We now apply our viscosity technique for IMR to (4.7). To this end, we define a mapping \(T: H\to H\) by
where u is the solution of (4.7) satisfying the initial condition \(u(0)=v\).
It is easy to find that T is nonexpansive. Moreover, the assumption (B5) implies that T is a self-mapping of the closed ball \(B:=\{v\in H: \|v\|\le R\}\). Consequently, T has a fixed point in B which we denote by v, and the corresponding solution u of (4.7) is the periodic solution of (4.7) with period ξ with the initial condition \(u(0)=v\). In other words, finding a periodic solution of (4.7) is equivalent to finding a fixed point of T. Therefore, our viscosity technique for IMR is applicable to (4.7). It turns out that the sequence \(\{v_{n}\}\) defined by the IMR
with \(\{\alpha_{n}\}\) satisfying the conditions (C1)-(C3) of Theorem 3.1, converges weakly to a fixed point v of T, and then the corresponding mild solution u of (4.7) with initial value \(u(0)=\xi\) is a periodic solution of (4.7). Note that the iteration procedure (4.9) is essentially to find a mild solution of the nonlinear evolution system (4.7) with the initial value \((v_{n}+v_{n+1})/2\).
References
Moudafi, A: Viscosity approximation methods for fixed-points problems. J. Math. Anal. Appl. 241, 46-55 (2000)
Attouch, H: Viscosity approximation methods for minimization problems. SIAM J. Optim. 6(3), 769-806 (1996)
Xu, HK: Viscosity approximation methods for nonexpansive mappings. J. Math. Anal. Appl. 298, 279-291 (2004)
Auzinger, W, Frank, R: Asymptotic error expansions for stiff equations: an analysis for the implicit midpoint and trapezoidal rules in the strongly stiff case. Numer. Math. 56, 469-499 (1989)
Bader, G, Deuflhard, P: A semi-implicit mid-point rule for stiff systems of ordinary differential equations. Numer. Math. 41, 373-398 (1983)
Deuflhard, P: Recent progress in extrapolation methods for ordinary differential equations. SIAM Rev. 27(4), 505-535 (1985)
Schneider, C: Analysis of the linearly implicit mid-point rule for differential-algebra equations. Electron. Trans. Numer. Anal. 1, 1-10 (1993)
Somalia, S: Implicit midpoint rule to the nonlinear degenerate boundary value problems. Int. J. Comput. Math. 79(3), 327-332 (2002)
Van Veldhuxzen, M: Asymptotic expansions of the global error for the implicit midpoint rule (stiff case). Computing 33, 185-192 (1984)
Alghamdi, MA, Alghamdi, MA, Shahzad, N, Xu, HK: The implicit midpoint rule for nonexpansive mappings. Fixed Point Theory Appl. 2014, 96 (2014)
Goebel, K, Kirk, WA: Topics in Metric Fixed Point Theory. Cambridge Studies in Advanced Mathematics, vol. 28. Cambridge University Press, Cambridge (1990)
Xu, HK: Iterative algorithms for nonlinear operators. J. Lond. Math. Soc. 66, 240-256 (2002)
Xu, HK: Averaged mappings and the gradient-projection algorithm. J. Optim. Theory Appl. 150, 360-378 (2011)
Cabot, A: Proximal point algorithm controlled by a slowly vanishing term: applications to hierarchical minimization. SIAM J. Optim. 15, 555-572 (2005)
Browder, FE: Existence of periodic solutions for nonlinear equations of evolution. Proc. Natl. Acad. Sci. USA 53, 1100-1103 (1965)
Acknowledgements
The authors are grateful to the anonymous referees for their helpful comments and suggestions, which improved the presentation of this manuscript. This project was funded by the Deanship of Scientific Research (DSR), King Abdulaziz University, under grant No. (49-130-35-HiCi). The authors, therefore, acknowledge technical and financial support of KAU.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
All authors contributed equally to the writing of this paper. All authors read and approved the final manuscript.
Rights and permissions
Open Access This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.
About this article
Cite this article
Xu, HK., Alghamdi, M.A. & Shahzad, N. The viscosity technique for the implicit midpoint rule of nonexpansive mappings in Hilbert spaces. Fixed Point Theory Appl 2015, 41 (2015). https://doi.org/10.1186/s13663-015-0282-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13663-015-0282-9