Trying to predict a floating leaf: chaos and predictions

Originating author is César R. de Oliveira, Universidade Federal de São Carlos.

What path will a leaf follow floating down a turbulent stream? Is it even possible to make a mathematical model that will predict such motion? Is this the same sort of problem as predicting the path of planets as they move round the sun? Even when we know all the rules governing the motion of an object, and can determine precisely the initial conditions, it turns out that some motions can be predicted and some cannot. And it is not just a matter of complexity: we can model unpredictable systems with very simple equations. In this Vignette we illustrate mathematically the existence of chaotic dynamical systems using the decimal form of real numbers. You will see how the unpredictability can be simply generated. One of the main goals of theoretical models is to make (good) predictions. However, there are deterministic dynamical systems that in practice are unpredictable; they are the so-called chaotic systems. The aim of this text is to discuss how this unpredictability is generated, and the main tool here will be the decimal representation of real numbers.

By a deterministic dynamical system we understand a mathematical model with a well-defined (time) evolution rule, in such way that if it is known how the system is configured at the present time, then it is possible (theoretically, at least) to know how it will be configured in the future. A basic example of a deterministic system is given by a (unique) planet around a star; the mathematical model is Newton’s Second Law of Classical Mechanics, and the initial configuration is the position and velocity of the planet at a certain instant of time; from this it it possible to exactly predict its future configurations.

With respect to chaotic motions, there are different definitions spread in the specialized literature. At least in one point different authors agree: chaotic motions do exist. In the world of models the term chaos has been used as synonymous with erratic, turbulent, unpredictable, random, irregular, etc., and it has often been observed through numerical simulations and laboratory experiments. Such the term in deterministic systems was popularized by T. Li e J. A. Yorke in the title of a work published in 1975, but its meaning in this context was not the one presented in a dictionary. A familiar example of chaotic motion is given by a small leaf in turbulent water flow.

Complex behavior in dynamical systems does not require complicated equations! In the following this advantage is used in models based on the decimal representation of real numbers. Thus, the first step will be a short analysis of such representations, before the presentation of the models. The readers are invited to use pencil and paper to check some of the steps ahead.

Decimal representation

The real numbers in the interval $\mathcal I = [0,1)$ are classified as rationals and irrationals. The rationals are those that can be represented in the form $\frac{p}{q}$ , with natural numbers $p$ and $q$ , $q\ne0$ and $p < q$ . The rationals, when represented in the decimal form, are exactly those with a finite number of nonzero digits or with blocks that repeat indefinitely, the so-called repeating decimals. As examples consider $\frac14 = 0.25000 \cdots$ and $\frac{2}{11} = 0.18\,18\,18\,18 \cdots$ ; it is also possible to occur situations like $0.53129\,75\,75\,75\,75\,75 \cdots$ , which are called repeating as well.

The irrational numbers are those whose decimal representations present infinitely many nonzero digits but with no infinitely-repeated portion as in the repeating decimals; maybe the most famous irrational number is $\pi$ , so that $\pi/10 = 0.314159265 \cdots$ is also irrational and belongs to $\mathcal I$ .

Now, take a closer look at the meaning of writing $0.25$ . The first digit 0 means, clearly, that this number (point) is between $0$ and $1$ . Since the base is decimal, the digits $0, 1, 2, \cdots,9$ are used to represent the numbers, then the interval $\mathcal I$ is divided into ten subintervals

$[0,0.1),\, [0.1,0.2), \, [0.2,0.3),\cdots,\,[0.9,1);$

and the digit $2$ in $0.25$ means that in this first division of $\mathcal I$ the considered number is in the third one. Now we divide the third subinterval in another ten, that is,

$[0.20,0.21),\, [0.21,0.22),\cdots,\, [0.29,0.30),$

and the digit $5$ says that $0.25$ is, among such subintervals, in the sixth. Since all remaining digits are null, for all subsequent subdivisions this number is always in the first subinterval that starts at $0.25$ , and it is uniquely determined as the lengths of the subintervals in this process tend to zero.

Some numbers have more than one decimal representation, more precisely two. For instance: $1 = 0.99999 \cdots$ It is possible to be convinced of this by analyzing the closed subintervals that contain $0.9999 \cdots$ (i.e., always in the last subintervals – those ending with $1$ ), or reasoning as follows: if $x = 0.9999 \cdots$ , then $10x = 9.9999 \cdots = 9 + x$ and $10x - x = 9$ , so that $x = 1$ . These possible doubled decimal representations only occur with repetitions of $9$ from a certain position (this is not obvious and asks for a detailed proof that will not be discussed here); below such particular representations will not be considered, so that uniqueness of representation are then guaranteed for all real numbers.

By using these remarks about decimal representations, sometimes it is possible to construct numbers suitable to certain purposes; it is enough to choose successive subintervals in a convenient way. This will be fundamental in what follows, in particular in the description of the system with chaotic properties.

Deterministic systems and chaos

As already mentioned, in dynamics the term chaos refers to behaviors that in practice are unpredictable, although generated by deterministic systems. But how is this possible?

Let’s pass to the discussion of two dynamical systems that, at first glance, may seem similar. The two models are deterministic, the first one does not present chaotic motion and also serves as a warm up, whereas the second one has a richer dynamics. Even though such models are not necessarily directly related to physical situations, they are important by their simple evolution laws, so permitting that their dynamical characteristics may be easily understood.

Example of regular system

This first example does not present chaos, and will be referred to as regular. Its possible configurations are points in the interval $\mathcal I$ with a small modification: the end points $0$ and $1$ are identified and the interval becomes a circle (think of a rope with the ends glued together). The general rule for working under this identification is simple: if a number is not in $[0,1)$ , subtract its integer part, which corresponds to the number of full turns around the circle and then returning to the same point (see Figure 1); as an illustration, in case of $3.141592$ , the integer part $3$ means three full turns that do not modify the configuration of the system, that is, $0.141592$ . We also see that the numbers $0$ , $1$ , $32$ and $67$ represent the same configuration “ $0$ ”; $1$ says that stating at $0$ we have gone one full turn; $32$ that we have gone exactly $32$ full turns, and so on.

The temporal evolution is given by a deterministic law; if the initial configuration of the system (it is always supposed to be given at instant $0$ ) is $x_0\in \mathcal I$ , then at instant one the system will be at $x_1=\frac{x_0}{10}$ , at instant two in $x_2=\frac{x_0}{100}$ , and at a generic instant $n$ at $x_n=\frac{x_0}{10^n}$ .

Figure 1: Possible configurations in the examples.

It is expected that a deterministic system reaches some kind of equilibrium for large times, which in mathematical language corresponds to take the time $n$ “going to infinity”; in symbols $n\to\infty$ . In this example, for large $n$ its successive configurations approach zero, and for all initial conditions $x_0$ ; for example, if $x_0=0.314159\cdots$ , then $x_1=0.0314159\cdots$ , $x_6=0.000000314159\cdots$ , etc. The equilibrium is always described by the position zero. It is in fact a regular system.

Chaotic example

In this subsection a mathematical model with chaotic behavior will be presented. It is a simple adaptation of a well-known system among specialists.

The possible configurations of this system are the same $\mathcal I$ of the previous example, that is, an interval with ends identified. The temporal evolution is given by the following law: if $x_0$ is the initial configuration, then at instant $1$ the system is in $x_1 = 10 x_0$ , at instant $2$ in $x_2 = 100 x_0$ and, in a generic instant $n$ in $x_n = 10^n x_0$ . The identification of end points is assumed at each instant of time; thus, if $x_0 = 0.1234567$ , then $x_1 = 1.234567=0.234567$ and $x_5 = 0.67$ . Here we clearly have a deterministic system as well.

It is a good idea to doubly illustrate how to compute the orbit of a initial condition, say $x_0=0.31415926535897932384\cdots$ : $x_1=0.14159265358979323846\cdots$ , $x_2=0.41592653589793238462\cdots$ , $x_3=0.15926535897932384626\cdots$ , and so on.

Next some possibilities of equilibrium for this system as $n\to\infty$ are discussed.

If $x_0 = 0.1$ , or $0.2$ , we have $x_1 = x_2 = \cdots = x_n = 0$ , and the equilibrium is described by the position $0$ . If $x_0 =0.09$ we have $x_2 =x_3 =\cdots=x_n =0$ . Similarly, for $x_0 =0.1234567$ , it follows that $x_n =0$ for all $n\ge7$ . From such cases we see that if $x_0$ is any rational number in $\mathcal I$ whose decimal representation has a finite number of nonzero entries, then the equilibrium will always be described by the zero position.

In the case of rational numbers represented by repeating decimals, in general the equilibrium is represented by a periodic orbit. Some examples explain the meaning of a periodic orbit in this context. In case $x_0 = \frac{2}{11} = 0.18\,18\,18\,18\cdots$ we have $x_1 = 0.81\,81\,81\,81\cdots$ , $x_2 = 0.18\,18\,18\cdots = x_0$ ; hence, $x_0 = x_2 = x_4 = \cdots$ whereas $x_1 = x_3 = x_5 = \cdots$ , and the equilibrium is described by an orbit of period $2$ given by $\{x_0,x_1\}$ . If $x_0 = 200/297 = 0.673400\, 673400\, 673400 \cdots$ , the equilibrium is a periodic orbit of period $6$ , that is, $\{x_0,x_1,\cdots,x_5\}$ , for $x_0 = x_6$ (and $x_j\ne x_k$ if $j\ne k$ and in $\{0,1,2,3,4,5\}$ ). The same idea is applied to present examples of orbits of any period.

If the initial condition is an irrational number, the equilibrium may be more complicated, there are many possibilities and it may be difficult to describe in some cases; however, undoubtedly it will not be a periodic orbit (since its decimal representation is not repeating) and some possibilities will be discussed ahead.

An effective way of estimating the distance between two points in $\mathcal I$ , when given in decimal representation, is to count, from the decimal point, how many successive digits coincide. For example, if $y = 0.\underline{12146}39$ and $x = 0.\underline{12146}1722$ , their distance is less or equal to $10^{-5}$ .

Now, if $a_j$ represents a digit in $\{0, 1, 2, \cdots , 9\}$ and given an initial condition $x_0 = 0.a_1a_2a_3a_4a_5a_6 \cdots$ , there exist initial conditions that generate periodic orbits arbitrarily close to $x_0$ (it is the so-called density of periodic orbits). The new initial condition $z_0 = 0.a_1 a_2 a_3 a_4\, a_1 a_2 a_3 a_4\, a_1 a_2 a_3 a_4 \cdots$ corresponds to a periodic orbit of period $4$ whose distance to $x_0$ is less or equal to $10^{-4}$ (if necessary, use blocks $a_1a_2a_3a_4b$ , with $b\ne a_5$ ). Proceeding in this way, one gets periodic orbits with high periods whose initial conditions are arbitrarily close to $x_0$ . On the other hand, $y_0 = 0.a_1a_2a_3\,0000\cdots$ has zero as its equilibrium and its distance to $x_0$ is less than $10^{-3}$ , whereas $z_0 = 0.a_1a_2a_3a_4a_5a_6\, 314159265 \cdots$ corresponds to an irrational number whose distance to $x_0$ is less than $10^{-6}$ .

Figure 2: Illustration of the construction of the blocks of digits $a_1$ , $b_j$ , $c_k$ ,….

Now a particular equilibrium generated by some irrational numbers is considered. Let

$\bar{x}_0 = 0.a_1 b_1b_2 \cdots b_{10}\, c_1c_2c_3 \cdots c_{100} \,d_1d_2 \cdots d_{1000} \cdots,$

where $a_1,b_j,c_k,\cdots$ are blocks of finitely many digits between $0$ and $9$ , and they are chosen as follows:

$0.a_1 \cdots$ belongs to $[0,1)$ ; note that $a_1$ can be used to localize $\bar x_0$ close to any given number.
by dividing $[0,1)$ into ten subintervals as before, $0.b_1\cdots$ belongs to the first of these subintervals, $0.b_2 \cdots$ to the second, $\cdots$ , and $0.b_{10} \cdots$ to the last one. For example: $b_1 = \underline{0}53, b_{10} = \underline{9}621$ .
divide each of the above subintervals into ten, so getting one hundred subintervals. Chose $c_j$ so that $0.c_1\cdots$ belongs to the first of such subintervals, $0.c_2\cdots$ to the second, $\cdots$ , $0.c_{100}\cdots$ to the last one. For example: $c_1 = \underline{00}28$ , $c_{62} = \underline{61}9277$ and $c_{100} = \underline{99}0176$ .

Proceeding with subdivisions as above, it is possible to obtain initial conditions that, under time evolution, visit “all parts” of $\mathcal I$ . By all parts it is understood any subinterval of $\mathcal I$ ; the precise technical term is to say that the orbit is dense in $\mathcal I$ . This follows by observing the orbit of $\bar x_0$ ; for instance, it will visit $[0.50,0.51)$ when it reaches $0.c_{51}c_{52}c_{53} \cdots c_{100}\, d_1d_2 сссd_{1000}\cdots$ , and so on. This behavior (that is, to visit all parts of $\mathcal I$ ) would be the “equilibrium” of this orbit as $n\to\infty$ .

It is interesting to note that each one of the blocks $a_1,b_j,c_k,\cdots$ can be chosen among many possibilities, which shows that the orbits of infinitely many initial conditions visit all parts of $[0,1)$ through time evolution. There are other possibilities and the readers are invited to exercise their creativity! Think, for example, of initial conditions whose orbits visit all parts of just the interval $[0,1/2)$ .

With respect to the above initial condition $\bar x_0$ , recall that $a_1$ can be selected in such way that $\bar x_0$ is very close to any given point of $[0,1)$ . Thus, there are initial conditions whose orbits spread out all parts of $\mathcal I$ that are arbitrary close to any given periodic initial condition, and also close to initial conditions whose equilibria are described by the position zero. There are, then, at least three types of equilibria whose corresponding initial conditions are intertwined. It is also possible to consider periodic orbits with different periods as distinct types of equilibria; this is left to the taste of each author.

Hence, in this example, in contrast with the previous one, different initial conditions may present different kinds of equilibria. What is still missing to characterize the chaotic motion? Surely such different intertwined behaviors give a flavor of unpredictability to the dynamics, that is, very close to an initial condition there are infinitely many others with different equilibria. Here is another essential ingredient: in practice any initial configuration is known with limited precision, because there is always an experimental or truncation error. In physical systems, besides the limited accuracy of the initial data, there are also small external disturbances which may occur, such as variations in temperature, etc.

The picture is now complete: there are very distinct kinds of temporal evolution, whose initial conditions are arbitrarily close to each other, and with the limited accuracy of the initial data, no one knows what kind of equilibrium will be attained as $n \to \infty$ .

One of the ingredients for the chaotic behavior is the expansiveness, that is, near points are quickly separated by the temporal evolution (which does not occur in the first example above), and in this example, at each instant of time, the distance between two close points is multiplied by $10$ ; this is called sensitivity to initial conditions. As an illustration, suppose that the initial condition is $x_0$ with precision of a millionth, that is, assume that it can be anywhere from $x_0$ to $x_0 + 10^{- 6}$ . By the temporal evolution, at time $1$ this range of accuracy will be multiplied by ten and will have length $10 ^ {- 5}$ , at instant $2$ length $10 ^ {- 4}$ , and the instant $6$ length $1$ , but the latter is the length of the interval $\mathcal I$ . Thus, after only $6$ instants of time, every point of $\mathcal I$ could be describing the system. It is chaotic!

With more sophisticated mathematical tools, one sees that the temporal evolution of the “majority” (i.e., except in a set of “null length”) of initial conditions in this example behaves as $\bar x_0$ above, whose orbit is dense in the range $\mathcal I$ ; thus the ad hoc initial condition $\bar x_0$ , in fact, is far from being an exception.

The examples above were defined in terms of a sequence of symbols (in this case $\{0, 1, 2, \cdots, 9 \}$ ) associated with the decimal representation of real numbers, dynamics was postulated and the mechanism of dynamical chaos was apparent. It is interesting to note that with tools of current mathematical research, the chaotic behavior in some more sophisticated deterministic dynamical systems, modeling physical phenomena, can be visualized (this is usually not a simple task) in a way very similar to that described above. The basic principle is the same: existence of a region with (1) periodic orbits arbitrarily close to any initial condition, (2) the presence of dense orbits in the region, and (3) sensitivity to initial conditions. It is clear that the notion of visualization employed above should be given precisely, but the goal is to obtain dynamical properties based on symbols as illustrated above by the decimal representation.

There are several aspects of chaos that are not covered in this text, such as their links with fractals, noninteger dimensions and ergodic theory [2,6], but the goal here is not a detailed review of the subject and is strongly influenced by author’s preferences.

In some situations the presence of dynamical chaos is unfavorable: it can interfere with a good weather forecast, can be responsible for planetary instabilities, cause aerodynamic instabilities, among others. On the other hand, there are studies pointing to chaos as the mechanism responsible for the smooth running of various animal organs such as the heart and the brain. Thus, naturally one asks: how can chaotic features turn out to create some kind of stability responsible for the smooth running of something? And, particularly in the case of the brain, how is chaos is in charge of frequently produced original patterns? Certainly the situation is richer than predicting a floating leaf and there are still many applications to be detailed and understood.

Acknowledgement: I thank Prof. Mário J. D. Carneiro for providing his text on the subject, and CNPq.

References

[1] F. L. da Silveira, Deteminismo, previsibilidade e caos, Cad. Catar. Ens. Física 10 (2) (1993), 137–147. (http://www.if.ufrgs.br/∼lang/Textos/Determinismo−previsibilidade−caos.pdf)
[2] J.-P. Eckmann, D. Ruelle, Ergodic theory of chaos and strange attractors, Rev. Modern Phys. 57 (1985), 617–656.
[3] J. Ford, How random is a coin toss?, Physics Today 36 (4) (1983), 40–47.
[4] J. Gleick, Chaos: Making a New Science, Penguin Books, Revised edition, 2008.
[5] W. M. Hirsch, S. Smale, R. Devaney, Differential Equations, Dynamical Systems, and an Introduction to Chaos, Second edition, Academic Press, New York, 2003.
[6] D. Ruelle, Chaotic Evolution and Strange Attractors, Cambridge Univ. Press, Cambridge, 1989.
[7] S. Spezamiglio, W. F. Pereira, Ordem no caos de Devaney, Matemática Universitária 35 (2003), 31–40.

Trying to predict a floating leaf: chaos and predictions

Decimal representation

Deterministic systems and chaos

Related

Leave a Reply Cancel reply

Receive notice of every new vignette.

Search

Meta

Trying to predict a floating leaf: chaos and predictions

Decimal representation

Deterministic systems and chaos

Share this:

Related

Leave a Reply Cancel reply

Receive notice of every new vignette.

Search

Meta