Yes, but over time, as observed by Asimov, the errors are smaller and fewer.
Gravity is not going to be found to be a vastly tragic error… just as Newtonian physics are not going to be found to be irrelevant in the collision of two trucks.
Einstein’s calculations regarding the trucks might be more precise … but not so much that anyone is going to notice the differences.
The sensible development of the idea of a firmament was an important position to take in the ancient world. But over time, it became increasingly easy to see that it was a big error.
Even before we got into space, humans could verify that there was no firmament. They used sophisticated balloons with cameras. They used radar. What was a “probability” became an “impossibility”.