How we invalidate cache for resource-heavy & long-running requests

Cache refresh for popular API requests that are long-running and resource-heavy used to result in system unstability during the refresh-window. This post details this problem and the various solutions we evaluated. It also explains the solution we chose and the considerations while making our choice.