As a Washingtonian these pics always make me sad. Thankfully there's more preservation these days, but I would have loved to see these majestic trees still standing.
They do visibly pump with each car when the ties aren't tamped well on clean rock. I doubt their hand-laid tracks were as easy to get right as we can with extra rock and a modern surfacing gang.
Also rail weight has gone up an astonishing amount over time. Rail used to be puny compared to what is used now.
The members of timber dynasties (e.g. wheeler, as well many others) would have deserved it. These laborers rarely had other options but to starve. Ethics under capitalism or whatever.