Multivariable Differential Operators
First, some preliminary definitions.
Let be any point in a domain of definition. Then we define a vector function whose values are vectors, that is,
that depends on points in space. A vector function depends only on the point not on the coordinate system chosen to represent its components.
Referenced by (7 direct, 13 transitive)
Direct references:
We say that a vector function defines a vector field in a domain of definition.
Referenced by (14 direct, 3 transitive)
Direct references:
Let be any point in a domain of definition. Then we define a scalar function whose values are scalars, that is,
that depends on
A scalar function depends only on the point not on the coordinate system chosen to represent it.
Referenced by (7 direct, 6 transitive)
Direct references:
Let be a function that maps an open set into Let and be the standard bases of and The components of are the real functions defined by
or, equivalently, by
Referenced by (6 direct, 9 transitive)
Direct references:
Transitive (depth 1):
- grad-div-curl-related
- Irrotational
- remark-36
- directional-derivative-is-inner-product-of-vector-and-grad
- Normal Derivative
- proof-of-theorem-19
- remark-45
- del
Transitive (depth 2):
Using the setup from the definition of component, for we define
provided the limit exists. Writing in place of we see that is the derivative of with respect to keeping the other variables fixed. The notation
is therefore often used in place of and is called a partial derivative.
Referenced by (4 direct)
For a space curve given parametrically by the tangent vector (or specifically, the unit tangent vector) at the point is the unit vector defined by:
Referenced by (1 direct)
Direct references:
Differentiation
If is a real function with domain of definition and if then is usually defined to be the real number
provided this limit exists. Thus,
where the "remainder" is small, that is,
Note that (8) expresses the difference as the sum of the linear function that takes to plus a small remainder. We can therefore view the derivative of at as the linear operator on that takes to
On linearity: every real number gives rise to a linear operator on
Conversely, every linear function from to is multiplication by some real number. Thus, we have a correspondence between and (the set of all linear transformations on .)
Now, consider a function that maps into Then is defined to be the vector (if one exists) for which
This can be rewritten as
where as Again, the right side is a linear function of Every gives a linear transformation of into
which gives us an identification of with (the set of all linear transformations from to ,) allowing us to say .
Therefore, if is a differentiable function of into and if then is the linear transformation of into that satisfies
or, equivalently,
We can now take on the general case.
Suppose is an open set in and If there exists a linear transformation such that
then we say that is differentiable at and we write
If is differentiable at every we say that is differentiable in
Note that in (14), If is small enough, then because is open. Therefore, is defined, and since Therefore,
The norm in the numerator of (14) is that of while the norm in the denominator is the -norm.
We can also rewrite (14) as
where the remainder satisfies
This means that for a fixed and a small the left side of (17) is approximately equal to that is, to the value of a linear transformation applied to
Referenced by (13 direct, 10 transitive)
Direct references:
Transitive (depth 1):
- grad-div-curl-related
- Gradient System
- poincare-bendixson
- theorem-19
- gravitational-potential-is-a-solution-to-laplaces-equation
- Tangent Plane
Transitive (depth 2):
Transitive (depth 3):
The derivative defined above in differentiable is called the total derivative of at or the differential of at
Referenced by (2 direct)
Suppose is an open set in and and that and are total derivatives of at Then,
A differentiable function of an open set into is said to be continuously differentiable in if is a continuous function of into More explicitly, it is required that to every and to every corresponds a such that
if and
If this is the case, we also say that is a -mapping or that
Referenced by (7 direct)
These are some differential operators that apply to multivariable and/or vector valued functions.
Vector Differential Operator
In Euclidean space with coordinates and standard basis del is a vector operator whose components are the partial derivative operators that is
Gradient
Given a scalar function , the gradient of , denoted as , is defined as the vector of its partial derivatives. Specifically, for a function , the gradient is given by
Referenced by (10 direct, 1 transitive)
Direct references:
Transitive (depth 1):
Directional Derivative
Using the setup from the definition of component, let us fix an (with ,) and let be a unit vector. Then,
is called the directional derivative of at in the direction of the unit vector and is denoted as
Referenced by (5 direct, 1 transitive)
Direct references:
Transitive (depth 1):
The directional derivative of in the direction of a unit vector is the inner product of and that is,
Referenced by (1 direct)
Direct references:
Let be a scalar function having continuous first partial derivatives in some domain in space. Then, exists in and is a vector, that is, its length and direction are independent of the particular choice of Cartesian coordinates. If at some point it has the direction of maximum increase of at
The directional derivative of in the direction of some unit vector is
where is the angle between and (see The directional derivative of in the... and The dot product of and ...). Note that is a scalar function, as is the directional derivative of Now, has its maximum value of whenever and since is a unit vector with magnitude of 1, (a) simplifies to
which tells us that that direction and magnitude of are independent of the coordinate system chosen. Now, since if and only if and are parallel, is the direction of maximum increase of at assuming at
Let be a surface represented by where is constant and is differentiable. Such a surface is called a level surface of and for different we get different level surfaces.
Referenced by (1 direct, 5 transitive)
Direct references:
Transitive (depth 1):
Transitive (depth 2):
Transitive (depth 3):
If is a level surface of a function and is a point of then the set of all tangent vectors of all curves passing through will generally form a plane, called the tangent plane of at
Referenced by (3 direct, 2 transitive)
Given a tangent plane to a surface at the normal to this plane (the straight line through perpendicular to the tangent plane) is called the surface normal to at
Referenced by (1 direct, 2 transitive)
Direct references:
Transitive (depth 1):
A vector in the direction of the surface normal of a surface at point is called a surface normal vector of at
Referenced by (2 direct)
Let be a differentiable scalar function in space. Let (with constant) represent a surface Then, if the gradient of at a point of is not the zero vector, it is a surface normal vector of at
Any curve lying in can be parameterized as such that
Now, if we differentiate (a) with respect to we get
Therefore, is orthogonal to all the vectors in the tangent plane of at and is therefore a surface normal vector of at
If is given by then at the tangent plane is
A potential function is a scalar function whose gradient is a vector field. They allow representing certain vector fields in a simpler, more fundamental form.
In other words, given a vector field a potential function is a scalar function such that
Referenced by (2 direct)
Direct references:
Normal Derivative
The normal derivative is the directional derivative in the direction of the @normal-vector.
Referenced by (1 direct)
Direct references:
The normal derivative tells us how the value of a function changes as we move in the direction normal (orthogonal) to a curve or surface.
Divergence
For a vector field defined in three-dimensional space , the divergence is defined as
Referenced by (6 direct, 1 transitive)
Direct references:
Transitive (depth 1):
The divergence of a vector field quantifies the extent to which the vector field behaves as a source or a sink at a given point.
Divergence gives a scalar value for each point, i.e., it is a scalar field. A positive value indicates a net flow away from the point, while a negative value indicates a net flow towards a point.
An important theorem related to divergence is the Divergence Theorem (also known as Gauss's theorem) which connects the flux of a vector field through a closed surface to the divergence of the field inside the volume bounded by the surface:
Let be the velocity vector of of the motion of particles in a fluid. If then the fluid has constant density and is said to be incompressible.
Curl
For a vector field defined in three-dimensional space , with each component function depending on the variables , , and , the curl of is defined as
Referenced by (4 direct)
Direct references:
The curl at a point in the field is represented by a vector whose length and direction denote the magnitude and axis of the maximum circulation. Circulation is the line integral of a vector field around a closed curve.
More intuitively, curl measures the rotation of the vector field at a given point.
Curl can also be expressed as the determinant of a 3x3 matrix involving the unit vectors, partial derivatives, and the components of the vector field:
If the curl of a vector field is i.e. if the field is said to be irrotational.
Referenced by (1 direct)
Direct references:
Laplacian
The Laplace operator is a second-order differential operator in the -dimensional Euclidean space, defined as the divergence of the gradient ). Thus, if is a twice differentiable real-valued function, then the Laplacian of is the real-valued function defined by
The Laplacian of is the sum of all the unmixed second partial derivatives in the Cartesian coordinates :
In two dimensions, using Cartesian coordinates, the Laplace operator is given by
and in three dimensions by
Referenced by (3 direct)
Solutions to Laplace's equation are called harmonic functions.
The force of attraction
between two particles at points and (as given by Newton's law of gravitation) has the potential function where is the distance between and
Thus, This potential function is a solution of Laplace's Equation
that is, has a Laplacian of
Hessian
Suppose is a function taking as input a vector and outputting a scalar If all second-order partial derivatives of exist, then the Hessian matrix of is a square @matrix, usually defined and arranged as
That is, the @entry of the th row and the th column is
For a function this is
Note that the Laplacian of is equal to the @trace of the Hessian of In this way, the Laplacian is to the Hessian what divergence is to the Jacobian.
Jacobian
Let be a function such that each of its first-order partial derivatives exists on This function takes a point as input and produces the vector as output. Then the Jacobian matrix of denoted is the @matrix whose @entry is explicitly
where is the @transpose (@row-vector) of the gradient of the -th component.
Referenced by (1 direct)
Direct references:
the Jacobian is the @linear-map that best @approximates near
At a point the directional derivative of in the direction of is
Jacobian Related to Gradient
Given a vector field
each component is itself a scalar field, and so we can take the gradient of each one:
Now, the Jacobian of is the @matrix that contains all of these gradients:
Here:
- The @columns tell how each @coordinate direction affects all components of
Thus the Jacobian tells us how each component of changes with every @coordinate. It can be viewed as the "gradient of a vector field."
Jacobian Related to Divergence
Given a vector field
with a Jacobian
divergence is the @sum of the @diagonal @entries of this @matrix:
So, algebraically, divergence is the @trace of the Jacobian.
The trace measures how much the @linear-transformation represented by stretches space along its coordinate axes - it's the infinitesimal "net expansion rate."
Geometrically, if we have a very small cube of points centered at with a side length of then each corner of that cube corresponds to a slightly different If we take all the points in the box and map them through the cube's image becomes a tiny, possibly deformed box in the -space. The way the box stretches, shears and rotates is determined by The change in volume of that box is determined by (the determinant of the Jacobian.)
For an infinitesimally small cube, the @determinant can be expanded as
for tiny Here, the @trace of
is exactly the divergence. Each of these terms tells us how much the points in an infinitesimally small box around are stretched/compressed in each coordinate direction.
Physically, for example, if represents a velocity field, says how much the -component of the velocity changes as you move along Note that if is constant with respect to this term is which means there is no stretch/compression along that axis, and if we think of the velocity being that of a fluid, the same amount of fluid will flow into any region in the direction as flows out in the direction.
Jacobian Related to Curl
Given a vector field
with a Jacobian
We can split into its @symmetric and @antisymmetric parts:
Now,
- encodes stretching/shearing.
- encodes local rotation.
The components of are:
If we let we can write as
Then,
so curl is twice the @axial-vector of the @antisymmetric part of the Jacobian.
Geometrically, if we linearize near some point
The matrix is acting on small displacements. When we apply to we get
Then,
- The direction of is the axis of rotation (via the right-hand rule).
More visually, if we take a small ball of points around
- The symmetric part of turns the ball into an @ellipsoid (by stretching/shearing it).
- The antisymmetric part spins the ball about the axis without changing its shape or volume.
Thus, divergence comes from the @trace of and curl comes from
Physically, if is a velocity field of a fluid, then:
means that the fluid near that point is rotating like a tiny rigid body, with @angular-velocity
So, if we dropped a tiny paddle wheel into the flow:
- The wheel's axis aligns with
- Its spin rate is
Jacobian Related to Directional Derivative
This is mostly covered above, so just note that the Jacobian is a sort of machine for producing directional derivatives:
where the multiplication on the right is matrix-vector multiplication, i.e. the image of when applied to
Jacobian Related to Laplacian
Algebraically,
To unpack that, we're saying that the Laplacian is the divergence of the gradient of Now, when we take the gradient of we get a vector field that has the first partial derivatives of Now, if we take the Jacobian of that gradient, we get which is the Hessian of Now, if we take the @trace of that Hessian, we get the Laplacian, which is the sum of the pure second @derivatives of
Geometrically, the Hessian is telling us how the gradient of curves near a point, and taking the trace of it tells us the total or average @curvature at that point.
If the gradient's inflow and outflow balance in every direction: the field is @harmonic and locally curvature-neutral.