Why intuitively, do we define symmetries as transformations that map solutions of the equations of motion into other solutions?

a symmetry is always a transformation that leaves a given object unchanged.

To reveal an analogy, consider a dodecahedron centered on the origin in flat Euclidean space. An isometry that permutes the dodecahedron's vertices with each other is a symmetry of the dodecahedron, according to the usual meaning of "symmetry." The symmetry transformation leaves the whole dodecahedron unchanged, even if it does not leave the individual vertices unchanged.

I'm curious why observable symmetries of physical systems are exactly those transformations that map solutions of the equation of motion into other solutions.

In physics we are often more concerned with a system's behavior than with an individual static object. The equations of motion are a concise way of describing which behaviors are allowed. A symmetry transformation leaves the whole set of solutions unchanged, even if it does not leave the individual solutions unchanged. A symmetry transformation may permute different solutions with each other, but it transforms each valid solution into another (possibly different) valid solution -- just like a symmetry of the dodecahedron transforms one vertex of the dodecahedron to another (possibly different) vertex of the dodecahedron.

Is there possibly a little thought experiments that motivates this definition?

The motivation was described above. To illustrate it, consider a simple example: Maxwell's equations in flat spacetime, in a classical world with no charges or currents. Maxwell's equations delineate the set of allowed behaviors of the electromagnetic field. Any behavior of the electromagnetic field, whether allowed or not, is described by giving the Faraday tensor $F_{ab}(x)$ as a smooth function of the spacetime coordinates $x$, with $F_{ab}(x)=-F_{ba}(x)$. (This antisymmetry condition is normally considered to be part of the definition of the Faraday tensor, not one of the equations of motion. More precisely, the quantities $F_{ab}$ are the components of a two-form.) A given behavior of the field $F_{ab}(x)$ is "physically allowed" (in this toy model) if and only if it satisfies Maxwell's equations $$ \partial^a F_{ab}=0 \hskip2cm \partial_a F_{bc}+ \partial_b F_{ca}+ \partial_c F_{ab} =0. \tag{1} $$ One way of transforming the field is to consider any diffeomorphism (smooth map) of the spacetime manifold to itself and its corresponding pullback to the set of tensors. The quantities $F_{ab}$ are the components of a tensor (specifically a two-form), so the pullback defines a permutation of the set of behaviors of the electromagnetic field. Most of these transformations don't preserve the set of allowed behaviors; instead, most of them convert solutions of the equations of motion (1) to non-solutions. Lorentz transformations are examples of transforms that do preserve the set of allowed behaviors, so we say that Lorentz transformations are symmetries of the equations of motion (1).

The OP used the expression "observable symmetries," and that introduces a host of interesting subtleties, because then we must distinguish between transformations whose effects are observable and transformations whose effects are not. For example, assuming as usual that spacetime manifold is $\mathbb{R}^4$, the second of equations (1) implies that any allowed $F_{ab}(x)$ can be written in terms of a gauge field $A_a(x)$ like this: $$ F_{ab}=\partial_a A_b - \partial_b A_a. \tag{2} $$ (This is Poincaré's lemma.) The gauge field provides a redundant description of the Faraday tensor, in the sense that any transformation of the form $$ A_a\to A_a+\partial_a\theta, \tag{3} $$ for any smooth function $\theta(x)$, leaves the Faraday tensor $F_{ab}$ invariant. The transformation (3) is a gauge transformation, and it obviously qualifies as a symmetry of the equations of motion (1), because it doesn't change the Faraday tensor $F_{ab}(x)$ at all. Physically, a gauge transformation is a trivial symmetry, because all of the model's observables can be expressed in terms of the Faraday tensor, so the gauge transformation doesn't change anything observable. (The assertion that all observables can be expressed in terms of $F_{ab}$ is part of this model's definition.)

Does a Lorentz transformation of (1) change anything observable? It generally does change the Faraday tensor $F_{ab}(x)$, of course, but with respect to what? A mathematical transform has observable effects only if it changes some relationship between physical entities; but in this toy model, the electromagnetic field is the only physical entity, isn't it? I won't try address that issue here, because I'm not sure it's within the intended scope of the OP and because this answer is already long, but I mentioned it as another example of how including the word "observable" in the question introduces some interesting subtleties.


Following the OP's notations, let $\mathcal{D}(\Lambda)=0$ be a differential equation or system of differential equations about some function(s) $\Lambda=\Lambda(x)$. Let $T$ be a transformation which turns an object $\Lambda$ into an object of the same kind $T\Lambda$.

Definition 1: A transformation $T$ is a symmetry of the equation if, $$ \forall \Lambda,\ \mathcal{D}(\Lambda)=0\Rightarrow\mathcal{D}(T\Lambda)=0\ . $$

Definition 2: A transformation $T$ is a symmetry of the object/physical system $\Lambda$ if $T\Lambda=\Lambda$.

There are at least two motivations for Definition 1.

1st motivation:

In good cases one has an existence and uniqueness theorem for the equation. So if $\Lambda$ is a solution and $T$ is a symmetry of the equation, then $T\Lambda$ is also a solution. By uniqueness, we conclude that $\Lambda=T\Lambda$ so the solution has that symmetry. The point is that when such reasoning is applicable we get to know a property of the solution $\Lambda$ for cheap. We don't need an explicit formula for $\Lambda$ which often is out of reach.

2nd motivation:

One may be interested in the question: of all differential equations $\mathcal{D}(\Lambda)=0$ one could think of, which ones have a chance of being a law of physics? This involves the relation between the passive versus active points of view for a symmetry transformation like $T$. In the passive view, you have two observers watching the same object and $T$ is the transformation from the numbers (e.g., coordinates) recorded by the first observer to the similar set of numbers recorded by the second observer. However in the active view, one can imagine there being only one observer and think of the object as being "rotated" from position $\Lambda$ to $T\Lambda$. The requirement that all physics textbooks should be the same for everybody, then translate into equations $\mathcal{D}(\Lambda)=0$ from these textbooks having as symmetry $T$, in the sense of Definition 1, any transformation corresponding to an allowed change of observer. This is the relativity principle. Thus for each group $G$ of allowed transformations (Galilean, special relativistic, diffeomorphisms,...) one can try to classify equations $\mathcal{D}(\Lambda)=0$ which have $T$ as a symmetry for all $T\in G$. This is a problem of classical differential invariant theory. Such classification may produce a long and complicated list of equations. One could then use Occam's razor (or a renormalization group argument) to pick the simplest nontrivial equation, and one should in principle be able to rediscover Newton's law, Maxwell's equations, and Einstein's equation for general relativity...