4. Finite element problems: solvability and stability¶
A video recording of the following material is available here.
Imperial students can also watch this video on Panopto
In section 1, we saw the example of a finite element approximation for Poisson’s equation in the unit square, which we now recall below.
The finite element approximation \(u_h \in \mathring{V}_h\) to the solution \(u_h\) of Poisson’s equation is defined by
A fundamental question is whether the solution \(u_h\) exists and is unique. This question is of practical interest because if these conditions are not satisfied, then the matrix-vector system for the basis coefficients of \(u_h\) will not be solvable. To answer this question for this approximation (and others for related equations), we will use some general mathematical machinery about linear problems defined on Hilbert spaces. It will turn out that this machinery will also help us show that the approximation \(u_h\) converges to the exact solution \(u\) (and in what sense).
4.1. Finite element spaces and other Hilbert spaces¶
In the previous sections, we introduced the concept of finite element spaces, which contain certain functions defined on a domain \(\Omega\). Finite element spaces are examples of vector spaces (hence the use of the word “space”).
A vector space over the real numbers \(\mathbb{R}\) is a set \(V\), with an addition operator \(+:V\times V\to V\), plus a scalar multiplication operator \(\times:\mathbb{R}\times V \to V\), such that:
- There exists a unique zero element \(e\in V\) such that:
\(k\times e = e\) for all \(k\in \mathbb{R}\),
\(0\times v = e\) for all \(v \in V\),
\(e+v = v\) for all \(v \in V\).
- \(V\) is closed under addition and multiplication, i.e.,
\(a\times u + v\in V\) for all \(u,v\in V\), \(a\in \mathbb{R}\).
Let \(V\) be a finite element space. Then \(V\) is a vector space.
First, we note that the zero function \(u(x):=0\) is in \(V\), and satisfies the above properties. Further, let \(u,v\in V\), and \(a\in\mathbb{R}\). Then, when restricted to each triangle \(K_i\), \(u+av\in P_i\). Also, for each shared mesh entity, the shared nodal variables agree between triangles. Therefore, \(u+av\in V\).
We now introduce bilinear forms on vector spaces. Bilinear forms are important because they will represent the left hand side of finite element approximations of linear PDEs.
A bilinear form \(b(\cdot,\cdot)\) on a vector space \(V\) is a mapping \(b:V\times V\to \mathbb{R}\), such that
\(v\to b(v,w)\) is a linear map in \(v\) for all \(w\).
\(v\to b(w,v)\) is a linear map in \(v\) for all \(w\).
It is a symmetric bilinear form if in addition, \(b(v,w)=b(w,v)\), for all \(v,w\in V\).
Here are two important examples of bilinear forms on finite element spaces.
Let \(V_h\) be a finite element space. The following are bilinear forms on \(V_h\),
To turn a vector space into a Hilbert space, we need to select an inner product.
A real inner product, denoted by \((\cdot,\cdot)\), is a symmetric bilinear form on a vector space \(V\) with
\((v,v)\geq 0\) \(\forall v\in V\),
\((v,v)=0\iff v=0\).
This enables the following definition.
We call a vector space \((V, (\cdot,\cdot))\) equipped with an inner product an inner product space.
We now introduce two important examples of inner products for finite element spaces.
Let \(f\), \(g\) be two functions in \(L^2(\Omega)\). The \(L^2\) inner product between \(f\) and \(g\) is defined as
The \(L^2\) inner product satisfies condition 2 provided that we understand functions in \(L^2\) as being equivalence classes of functions under the relation \(f\equiv g \iff \int_\Omega (f-g)^2\, d x=0\).
Let \(f\), \(g\) be two \(C^0\) finite element functions. The \(H^1\) inner product between \(f\) and \(g\) is defined as
The \(H^1\) inner product satisfies condition 2 since
The Schwarz inequality is a useful tool for bounding the size of inner products.
If \((V,(\cdot,\cdot))\) is an inner product space, then
Equality holds if and only if \(u=\alpha v\) for some \(\alpha\in\mathbb{R}\).
See a course on vector spaces.
Our solvability conditions will make use of norms that measure the size of elements of a vector space (the size of finite element functions, in our case).
Given a vector space \(V\), a norm \(\|\cdot\|\) is a function from \(V\) to \(\mathbb{R}\), with
\(\|v\|\geq 0,\,\forall v \in V\),
\(\|v\| = 0 \iff v=0\),
\(\|cv\|=|c|\|v\| \,\forall c\in \mathbb{R}, v\in V\),
\(\|v+w\| \leq \|v\|+\|w\|\).
For inner product spaces, there is a natural choice of norm.
Let \((V,(\cdot,\cdot))\) be an inner product space. Then \(\|v\|=\sqrt{(v,v)}\) defines a norm on \(V\).
From bilinearity we have
hence property 3.
\(\|v\|=( v,v)^{1/2} \geq 0\), hence property 1.
If \(0=\|v\|=( v,v)^{1/2} \implies (v,v)=0 \implies v=0\), hence property 2.
We finally check the triangle inequality (property 4).
hence \(\|u+v\|\leq \|u\|+\|v\|\).
We introduce the following useful term.
A vector space \(V\) with a norm \(\|\cdot\|\) is called a normed vector space, written \((V,\|\cdot\|)\).
To finish our discussion of Hilbert spaces, we need to review the concept of completeness (which you might have encountered in an analysis course). This seems not so important since finite element spaces are finite dimensional, but later we shall consider sequences of finite element spaces with smaller and smaller triangles, where completeness becomes important.
Completeness depends on the notion of a Cauchy sequence.
A Cauchy sequence on a normed vector space \((V,\|\cdot\|)\) is a sequence \(\{v_i\}_{i=1}^{\infty}\) satisfying \(\|v_j-v_k\|\to 0\) as \(j,k\to \infty\).
This definition leads to the definition of completeness.
A normed vector space \((V,\|\cdot\|)\) is complete if all Cauchy sequences have a limit \(v\in V\) such that \(\|v-v_j\|\to 0\) as \(j\to\infty\).
Finally, we reach the definition of a Hilbert space.
An inner product space \((V,(\cdot,\cdot))\) is a Hilbert space if the corresponding normed space \((V,\|\cdot\|)\) is complete.
All finite dimensional normed vector spaces are complete. Hence, \(C^0\) finite element spaces equipped with \(L^2\) or \(H^1\) inner products are Hilbert spaces. Later we shall understand our finite element spaces as subspaces of infinite dimensional Hilbert spaces.
4.2. Linear forms on Hilbert spaces¶
A video recording of the following material is available here.
Imperial students can also watch this video on Panopto
We will now build some structures on Hilbert spaces that allow us to discuss variational problems on them, which includes finite element approximations such as the Poisson example discussed so far.
Linear functionals are important as they will represent the right-hand side of finite element approximations of PDEs.
Let \(H\) be a Hilbert space with norm \(|\cdot|_H\).
A functional \(L\) is a map from \(H\) to \(\mathbb{R}\).
A functional \(L:H\to \mathbb{R}\) is linear if \(u,v\in H\), \(\alpha\in \mathbb{R}\) \(\implies L(u+\alpha v)=L(u)+\alpha L(v)\).
A functional \(L:H\to\mathbb{R}\) is continuous if there exists \(C>0\) such that
\[|L(u)-L(v)| \leq C\|u-v\|_H \quad \forall u,v\in H.\]
It is important that linear functionals are “nice” in the following sense.
A functional \(L:H\to\mathbb{R}\) is bounded if there exists \(C>0\) such that
For linear functionals we have the following relationship between boundedness and continuity.
Let \(L:H\to\mathbb{R}\) be a linear functional. Then \(L\) is continuous if and only if it is bounded.
\(L\) bounded \(\implies L(u)\leq C\|u\|_{H} \implies |L(u)-L(v)| = |L(u-v)| \leq C\|u-v\|_{H} \, \forall u,v\in H,\) i.e. \(L\) is continuous.
On the other hand, \(L\) continuous \(\implies |L(u-v)| \leq C\|u-v\|_{H} \quad \forall u,v\in H\). Pick \(v=0\), then \(|L(u)| = |L(u-0)| \leq C\|u-0\|_H = C\|u\|_H\), i.e. \(L\) is bounded.
We can also interpret bounded linear functionals as elements of a vector space.
Let \(H\) be a Hilbert space. The dual space \(H'\) is the space of continuous (or bounded) linear functionals \(L:H\to \mathbb{R}\).
This dual space can also be equipped with a norm.
Let \(L\) be a continuous linear functional on \(H\), then
There is a simple mapping from \(H\) to \(H'\).
Let \(u\in H\). Then the functional \(L_u:H\to \mathbb{R}\) defined by
is linear and continuous.
For \(v,w\in H\), \(\alpha\in\mathbb{R}\) we have
Hence \(L_u\) is linear.
We see that \(L_u\) is bounded by Schwarz inequality,
The following famous theorem states that the converse is also true.
For any continuous linear functional \(L\) on \(H\) there exists \(u\in H\) such that
Further,
See a course or textbook on Hilbert spaces.
4.3. Variational problems on Hilbert spaces¶
A video recording of the following material is available here.
Imperial students can also watch this video on Panopto
We will consider finite element methods that can be formulated in the following way.
Let \(b(u,v)\) be a bilinear form on a Hilbert space \(V\), and \(F\) be a linear form on \(V\). This defines a linear variational problem: find \(u\in V\) such that
We now discuss some important examples from finite element discretisations of linear PDEs.
For some known function \(f\),
and \(V\) is the Pk continuous finite element space on a triangulation of \(\Omega\).
For some known function \(f\),
and \(V\) is the subspace of the Pk continuous finite element space on a triangulation of \(\Omega\) such that functions vanishes on \(\Gamma_0\subseteq \partial \Omega\).
For some known function \(f\),
and \(V\) is the subspace of the Pk continuous finite element space on a triangulation of \(\Omega\) such that functions satisfy
A video recording of the following material is available here.
Imperial students can also watch this video on Panopto
We now introduce two important properties of bilinear forms that determine whether a linear variational problem is solvable or not. The first is continuity.
A bilinear form is continuous on a Hilbert space \(V\) if there exists a constant \(0<M<\infty\) such that
The second is coercivity.
A bilinear form is coercive on a Hilbert space \(V\) if there exists a constant \(0<\gamma<\infty\) such that
These two properties combine in the following theorem providing sufficient conditions for existence and uniqueness for solutions of linear variational problems.
Let \(b\) be a bilinear form, \(F\) be a linear form, and \((V,\|\cdot\|)\) be a Hilbert space. If \(b\) is continuous and coercive, and \(F\) is continuous, then a unique solution \(u\in V\) to the linear variational problem exists, with
See a course or textbook on Hilbert spaces.
We are going to use this result to show solvability for finite element discretisations. In particular, we also want to know that our finite element discretisation continues to be solvable as the maximum triangle edge diameter \(h\) goes to zero. This motivates the following definition.
Consider a sequence of triangulations \(\mathcal{T}_h\) with corresponding finite element spaces \(V_h\) labelled by a maximum triangle diameter \(h\), applied to a variational problem with bilinear form \(b(u,v)\) and linear form \(L\). For each \(V_h\) we have a corresponding coercivity constant \(\gamma_h\).
If \(\gamma_h \to \gamma>0\), and \(\|F\|_{V'_h}\to c <\infty\), then we say that the finite element discretisation is stable.
With this in mind it is useful to consider \(h\)-independent definitions of \(\|\cdot\|_V\) (such as the \(L^2\) and \(H^1\) norms), which is why we introduced them.
4.4. Solvability and stability of some finite element discretisations¶
In this section we will introduce some tools for showing coercivity and continuity of bilinear forms, illustrated with finite element approximations of some linear PDEs where they may be applied.
A video recording of the following material is available here.
Imperial students can also watch this video on Panopto
We start with the simplest example, for which continuity and coercivity are immediate.
Let \(b\), \(L\) be the forms from the Helmholtz problem, with \(\|f\|_{L^2}<\infty\). Let \(V_h\) be a Pk continuous finite element space defined on a triangulation \(\mathcal{T}\). Then the finite element approximation \(u_h\) exists and the discretisation is stable in the \(H^1\) norm.
First we show continuity of \(F\). We have
since \(\|v\|_{L^2}\leq \|v\|_{H^1}\).
Next we show continuity of \(b\).
from the Schwarz inequality of the \(H^1\) inner product. Finally we show coercivity of \(b\).
The continuity and coercivity constants are both 1, independent of \(h\), so the discretisation is stable.
Let \(V\) be a \(C^0\) finite element space on \([0,1]\), defined on a one-dimensional mesh with vertices \(0=x_0<x_1<x_2<\ldots<x_{n-1}<x_n=1\). Show that \(u\in V\) satisfies the fundamental theorem of calculus, \(i.e.\)
\[\int_0^1 u' \, d x = u[1] - u[0],\]
where \(u'\) is the usual finite element derivative defined in \(L^2([0,1])\) by taking the usual derivative when restricting \(u\) to any subinterval \([x_k,x_{k+1}]\).
Let
Let \(V\) be a \(C^0\) finite element space on \([0,1]\) and let \(\mathring{V}\) be the subspace of functions that vanish at \(x=0\) and \(x=1\). Using the finite element version of the fundamental theorem of calculus above, prove that
Hence conclude that the bilinear form is coercive on \(\mathring{V}\).
Consider the variational problem with bilinear form
corresponding to the differential equation
Prove that \(a(\cdot,\cdot)\) is continuous and coercive on a \(C^0\) finite element space \(V\) defined on \([0,1]\), with respect to the \(H^1\) inner product.
Hints: for continuity, just use the triangle inequality and the relationship between \(L^2\) and \(H^1\) norms. For coercivity, try completing the square for the integrand in \(a\).
For the Helmholtz problem, we have
i.e. \(b(u,v)\) is the \(H^1\) inner product of \(u\) and \(v\), which makes the continuity and coercivity immediate.
For the Poisson problem, we have
where we recall the \(H^1\) seminorm from the interpolation section. Some additional results are required to show coercivity, as \(b(u,u)\) is not the \(H^1\) norm squared any more. A seminorm has all the properties of a norm except \(|u|= 0 \nRightarrow u=0\), which is precisely what is needed in the Lax-Milgram theorem.
Let \(\mathcal{T}_h\) be a triangulation on the \(1\times 1\) unit square domain \(\Omega\), and let \(V\) be a \(C^0\) Lagrange finite element space of degree \(k\) defined on \(\mathcal{T}_h\). A finite element discretisation for the Poisson equation with Neumann boundary conditions is given by: find \(u \in V\) such that
for some known function \(f\). Show that the bilinear form for this problem is not coercive in \(V\).
For the Poisson problem, coercivity comes instead from the following mean estimate.
A video recording of the following material is available here.
Imperial students can also watch this video on Panopto
Let \(u\) be a member of a \(C^0\) finite element space, and define
Then there exists a positive constant \(C\), independent of the triangulation but dependent on (convex) \(\Omega\), such that
A video recording of the first part of the following material is available here.
Imperial students can also watch this video on Panopto
A video recording of the second part of section is available here.
Imperial students can also watch this video on Panopto
(Very similar to the proof of the estimate for averaged Taylor polynomials.)
Let \(x\) and \(y\) be two points in \(\Omega\). We note that \(f(s)=u(y+s(x-y))\) is a \(C^0\), piecewise polynomial function of \(s\). Let \(s_0 = 0 < s_1 < s_2 < \ldots < s_{k-1} < s_k = 1\) denote the points where \(y+s(x-y)\) intersects a triangle edge or vertex. Then \(f\) is a continuous function when restricted to each interval \([s_i,s_{i+1}]\), \(i=0,\ldots,k-1\). This means that
where \(\nabla u\) is the finite element derivative of \(u\). Summing this up from \(i=0\) to \(i=k-1\), we obtain
Then
Therefore
We split this final quantity into two parts (to avoid singularities),
where
which we will now estimate separately.
To evaluate \(I\), change variables \(y \to y' = y + s(x-y)\), defining \(\Omega'_s\subset \Omega\) as the image of \(\Omega\) under this transformation. Then,
To evaluate \(II\), change variables \(x \to x' = y + s(x-y)\), defining \(\Omega'_s\subset \Omega\) as the image of \(\Omega\) under this transformation. Then,
Combining,
which has the required form.
A video recording of the following material is available here.
Imperial students can also watch this video on Panopto
The mean estimate can now be used to show solvability for the Poisson problem with pure Neumann conditions.
Let \(b\), \(L\), \(V\), be the forms for the pure Neumann Poisson problem, with \(\|f\|_{L^2}<\infty\). Let \(V_h\) be a Pk continuous finite element space defined on a triangulation \(\mathcal{T}\), and define
Then for \(\bar{V}_h\), the finite element approximation \(u_h\) exists and the discretisation is stable in the \(H^1\) norm.
Using the mean estimate, for \(u\in\bar{V}_h\), we have
Hence we obtain the coercivity result,
Continuity follows from Schwarz inequality,
The coercivity constant is independent of \(h\), so the approximation is stable.
A video recording of the following material is available here.
Imperial students can also watch this video on Panopto
Proving the coercivity for the Poisson problem with Dirichlet or partial Dirichlet boundary conditions requires some additional results. We start by showing that the divergence theorem also applies to finite element derivatives of \(C^0\) finite element functions.
Let \(\phi\) be a \(C^1\) vector-valued function. and \(u\in V\) be a member of a \(C^0\) finite element space. Then
where \(n\) is the outward pointing normal to \(\partial\Omega\).
This allows us to prove the finite element trace theorem, which relates the \(H^1\) norm of a \(C^0\) finite element function to the \(L^2\) norm of the function restricted to the boundary.
Let \(V_h\) be a continuous finite element space, defined on a triangulation \(\mathcal{T}\), on a polygonal domain \(\Omega\). Then
where \(C\) is a constant that depends only on the geometry of \(\Omega\).
The first step is to construct a \(C^1\) function \(\xi\) satisfying \(\xi\cdot n=1\) on \(\Omega\). We do this by finding a triangulation \(\mathcal{T}_0\) (unrelated to \(\mathcal{T}\)), and defining an \(C^1\) Argyris finite element space \(V_0\) on it. We then choose \(\xi\) so that both Cartesian components are in \(V_0\), satisfying the boundary condition.
Then,
So,
where we have used the geometric-arithmetic mean inequality \(2ab \leq a^2+b^2\).
A video recording of the following material is available here.
Imperial students can also watch this video on Panopto
We can now use the trace inequality to estabilish solvability for the Poisson problem with (full or partial) Dirichlet conditions.
Let \(b\), \(L\), \(V\), be the forms for the (partial) Dirichlet Poisson problem, with \(\|f\|_{L^2}<\infty\). Let \(V_h\) be a Pk continuous finite element space defined on a triangulation \(\mathcal{T}\), and define
Then for \(\mathring{V}_h\), the finite element approximation \(u_h\) exists and the discretisation is stable in the \(H^1\) norm.
[Proof taken from Brenner and Scott]. We have
We have
Combining, we get
and hence coercivity,
The coercivity constant is independent of \(h\), so the approximation is stable.
For \(f\in L^2(\Omega)\), \(\sigma\in C^1(\Omega)\), find a finite element formulation of the problem
If there exist \(0<a<b\) such that \(a<\sigma(x)<b\) for all \(x\in \Omega\), show continuity and coercive for your formulation with respect to the \(H^1\) norm.
Find a \(C^0\) finite element formulation for the Poisson equation
for a function \(g\) which is \(C^2\) and whose restriction to \(\partial\Omega\) is in \(L^2(\partial\Omega)\). Derive conditions under the discretisation has a unique solution.
In this section, We have developed some techniques for showing that variational problems arising from finite element discretisations for Helmholtz and Poisson problems have unique solutions, that are stable in the \(H^1\)-norm. This means that we can be confident that we can solve the problems on a computer and the solution won’t become singular as the mesh is refined. Now we would like to go further and ask what is happening to the numerical solutions as the mesh is refined. What are they converging to?
We will address these questions in the next section.