There isn’t a caching layer on the Custom environment. The only thing is standard browser caching with nginx/Apache.
If your browser is hard-caching assets you can hard-refresh by holding Shift then clicking the Refresh button.
Or, you can use the keyboard shortcut for your operating system: Cmd + Shift + R for macOS and Shift + F5 on Windows.