Approximation in Physics
Physicists are not always concerned with exact solutions to problems. Oftentimes, an approximate solution to a problem or an approximate mathematical expression is good enough for practical purposes. Using approximations can also greatly simplify the appearance of a mathematical expression, so that the expression can be interpreted more easily. Furthermore, in many situations, it is impossible to write down an exact solution in "closed form." In this article, I introduce two of the most popular techniques that we use when making approximations. Examples are also provided.
Series Expansion and Truncation
The most common approximation technique relies on the fact that most functions of interest can be written in terms of an infinite series. Typically, a function is written as a Taylor series or a Laurent series and then the series is truncated so that only the first few terms remain. For example, the Taylor series expansion of the function
If (where the symbol means "much less than"), the function can be approximated quite well by the first few terms of the series expansion. This is because the condition, , implies that and higher powers of are even smaller. Oftentimes, is so small that it is essentially negligible; only constant terms and linear terms are included in the approximation. In this case, the approximation for is simply
In some cases, it may be better to keep the quadratic term or even the cubic term until near the end of the derivation. Typically, these situations arise when the approximated function will later be differentiated.
Of course, most situations are not so simple; you usually have to manipulate the expression algebraically before you can apply the approximation. More often, the expression looks something like this:
If , we can use the same method by first re-writing the expression as
Defining , this becomes
When , the quantity and this can be approximated as
The plot below compares the exact and approximate expressions when . The approximation is very good for , which corresponds to . This sort of approximation is typically first introduced in physics classes when the motion of a pendulum is being studied, but the general method is not explained in introductory courses. Instead, the textbook or instructor usually introduces something called the "small angle approximation for sine," which is just a particular case of the general technique described above. The derivation goes something like this:
Suppose a pendulum bob of mass hangs from a string of length . The gravitational potential energy of the pendulum bob is , where is the angle that the string makes with the vertical. The zero of potential energy is the lowest point in the pendulum bob's swing (corresponding to ). The net force on the pendulum bob is the tension force in the string plus the weight of the bob. This force points tangential to the arc of the pendulum and acts as restoring force, pulling the pendulum bob toward the equilibrium position. It can be written as the negative derivative of the potential energy with respect to the path length, , as
where , which means
This can be written as a differential equation, using the fact that , where ,
Cancelling and re-expressing gives us
Solving this is problematic. However, the right side of this equation can be expanded as a Taylor series. Notably,
For small values of , the cubic term and higher order terms are negligible. Thus, The differential equation can then be approximated by
This is a well-known differential equation; the solution is a sinusoid or a linear combination of sinusoids with two arbitrary constants. For instance, it can be written as
The constant, , is the maximum value of (the amplitude of the pendulum swing), and is a phase angle, which tells us the position of the pendulum at the time origin, .
Since this derivation relied upon the assumption that , the final expression is only a good approximation when .
Perturbative solution with
The other popular method of approximation is called perturbation theory. It can be applied in situations for which the problem that we are trying to solve is very similar to a simpler problem, except for a minor complicating factor, called a "perturbation." For instance, using Newtonian gravity, it is easy to compute the position of a planet orbiting a star if the stellar system consists of only one star and one planet in isolation. On the other hand, introducing a third body complicates the situation; the presence of a moon, another planet, or a companion star causes the orbits to no longer be strictly elliptical; it perturbs the orbit. Perturbation theory can be used to estimate the effect of the complicating factor (the perturbation) as long as this factor only changes the physical situation in a small way.
The general assumption is as follows: If a physical situation, , leads to a mathematical result, , then a similar situation,
gives rise to a similar result,
where is a small modification (perturbation) to the situation , and is a small modification to the result, . The physical situation could consist of the positions, velocities, and masses of a star and a planet, along with a force law. In this case, the result might be the position of the planet as a function of time. In other cases, the physical situation might involve the density, temperature, and pressure of a fluid or the positions and velocities of particles in a particular electromagnetic field configuration. The situation could be anything that leads to a computable result. There are several varieties of perturbation theory, but they all share this general assumption.
Suppose the abstract physical situation is represented mathematically by the equation,
such that all of the relevant physics (the laws and the description of the physical system) are included in this equation. The result, , is then the solution to this equation, which we have denoted abstractly by . In other words, is the quantity that you wish to compute. Equation (1) is oftentimes a differential equation, but it could also be an algebraic expression. Thus, is generally a function or a number.
The more complicated situation is represented mathematically by
where is a parameter between 0 and 1. The function, describes the perturbation being made to the exactly solvable situation. Clearly, setting yields the unperturbed case, Eq. (1). The solution to the perturbed equation is expressed as,
where is the solution to the exactly solvable situation in Eq. (1).
We proceed by substituting Eq. (3) into Eq. (2). We then collect the terms multiplying the same order of and treat terms multiplying each power of as a separate equation. For example, the result of substituting Eq. (3) into Eq. (2) might be
This would become the set of equations:
From which, we can deduce,
Thus, from Eq. (3), the result is
Typically, , so the only term that is not negligible is the term that is linear in .
Algebraic Equation Example:
Suppose you need to solve the following equation for :
This can be written as
Where The exponential term can be thought of as a perturbation to the trivial equation . This perturbation will cause the solution to differ slightly from the unperturbed solution (). Perturbation theory can be used to approximate the solution near ; any additional solutions will need to be determined using other methods.
First, recall that the solution is written as a series:
This is substituted into the equation, yielding
From the part of of the equation,
So, the equation becomes
Now, note that and use this to re-express the exponential term:
The equation is
This leaves us with the equation:
Thus, we have the result:
Substituting we get the approximation The exact solution, up to 9 decimal places, is -1.993186976. If we neglect the term, we still get a decent approximation:
Perturbation theory is useful only if you are looking for the root of the perturbed equation that falls near the root of the unperturbed equation (). There is another solution at , which would require the use of complex analysis or a root-finding scheme.
Differential Equation Example: Sound Waves in a Fluid
Consider a fluid of constant density, , temperature , and pressure, . Note that these three conditions imply that there is no gradient in the gravitational potential (the potential is uniform). Additionally, assume that the fluid is barotropic (pressure is uniquely determined by the density) and the velocity field within the fluid is ; there is no bulk flow anywhere within the volume of interest. The fluid trivially obeys the following relations...
Continuity / conservation of mass:
Euler's equation in terms of the specific enthalpy, , for a barotropic / isentropic fluid:
where is the gravitational potential and
Now, let's examine the effect of a very small perturbation in the fluid properties. This could be due to a small, sudden movement of an object in the fluid; perhaps an object begins vibrating and moving the fluid in its vicinity. The perturbations in the fluid properties can be expressed as
Substituting Eqns (7) into Eq. (4), Eq. (5), and Eq. (6) and neglecting terms multiplying yields
Differentiating the first equation in Eq. (8) with respect to time and using the other two equations to eliminate and , we get
This is a wave equation for the density, . The solution will consist of waves that travel with speed
The general solution to the wave equation is
where is a wave traveling in the positive direction and is a wave traveling in the negative direction. In this particular situation, the waves are called sound waves; the speed with which they travel is the speed of sound. Note that, since the fluid was assumed to be barotropic (), the existence of density waves implies the existence of corresponding pressure waves. One special solution to the equation is the plane wave,
where the wave vector points in the direction of wave propagation and has magnitude, (where is the wavelength of the wave). The angular frequency, , where is the ordinary frequency. The constants and determine the amplitude and phase of the wave, respectively.
Returning to the general solution of the density in our perturbed fluid, from Eqns. (7), we have
This says that sound waves represent a small perturbation (of order ) on the density (and pressure) of the fluid, which is what we generally expect from experience. If the value of was not very small, then this would be a poor approximation. In particular, the term
which is of order would not be negligible. From this, one might expect waves caused by violent explosions (or, generally, by very fast-moving objects) to behave in more complicated ways than the typical sounds that we encounter in everyday life. To study the problem in more detail, a quadratic term could be added to Eqns (7). The modified equations would then be substituted into Eq. (4), Eq. (5), and Eq. (6). Then, the terms would be collected and we would attempt to solve for . Upon attempting to do this, we would find that additional assumptions (or data) about the disturbance are needed in order to learn something new about the behavior of the system. This example is based on a derivation found in the appendix of Galactic Dynamics by Binney and Tremaine.
If you liked this, you might be interested in my other tutorials
Regarding the third line of Eq. (8), we begin with
Note that is simply . Since the remaining integral is taken over such a small density interval, the term is essentially a constant. The value of the constant is the derivative, evaluated at . This constant can be removed from the integral:
Evaluating the remaining integral yields
Now, we use the first type of approximation method, discussed above. We note that
The Taylor expansion of about is
The term that is linear in is the only term of interest:
Thus, we arrive at the result for the term: