I had an x86 binary of Local installed, and for some reason, it was working and updating itself properly even though I am on Apple Silicon. I replaced it with an ARM64 binary from the releases page.
I had PHP versions installed by both Homebrew and Laravel Herd. Had to uninstall them all to get Local shell to work properly.