@jerry Servers can detect when you are using curl like this and serve you different content on the fly.
I’m assuming most of the thread already knows that, but there are tools to help with this issue. Here’s a random one I found: https://github.com/mplewis/shed
So it’s not a great default, but it can be worked with.