I will first take a generic view-point and then quote some examples in condensed matter & materials modeling. Time-reversal symmetry is one of two discrete symmetries usually discussed in the context of condensed-matter, the other being Parity(Inversion). The simplest way in which this concept is presented is a transformation :
$ t \rightarrow -t $ . Think of it as a motion reversal - If you go back in time, does the system look the same?
Take a video clip for example. And let us say you start to rewind the video. Your observation will basically be the same, but in reverse. Such a system is Time-reversal invariant, meaning it has T.R. symmetry. Now try to think of cases (not just systems) where such a reversal breaks a fundamental law of nature - The simplest example being, the 2$^{nd}$ law of thermodynamics which effectively states that the total entropy in a system can only increase or stay constant. You will immediately conclude that winding back the clock (so to speak) breaks a fundamental law since you cannot remove entropy that has already been created.
In condensed matter, a variety of systems break T.R. symmetry - Ferromagnets, Anti-ferromagnets, Chiral spin liquids, some Superconductors etc. The simplest case is the ferromagnet - There are two ways to reconcile this:
a) If you relate the origin of magnetism to circulating current loops: Reversing the motion results in a current that flows in the opposite sense, giving you a magnetic field with the opposite sign. This clearly breaks T.R. symmetry.
b) A more generic viewpoint: Spontaneous magnetization. Take a virgin sample of Iron. When you apply a magnetic field, it becomes magnetized. Can you remove the magnetic ordering ('demagnetize') the sample just by removal of the magnetic field?
In the context of materials modeling, T.R. symmetry can often lead to degeneracies that improve the computational speed greatly. The simplest example is Kramer's rule, which can be proved trivially from by taking a conjugate of the time-dependent Schrodinger equation:
$ E _n (\vec k) = E _n (-\vec k) $ where $n$ is the band index and $\vec k $ runs over the brillouin zone
As far as spin-orbit coupling is concerned, it does not break time-reversal symmetry by itself. Think of SO-coupling as $(coeffiecent)* L.S $. Since both L (angular momentum) and S (spin operator) change sign, their product retains the sign.
I have not delved much into the math in my answer, but I would recommend Sakurai's Quantum Mechanics, a classic. For an insight into systems with non-trivial T.R. breaking,here's an excellent answer on physics stack exchange.