Unable to import database when pulling from WP Engine

So it sounds like this has been an ongoing issue for you all rather than something that just happened recently after an update?

Yes, we noticed that it was happening a few weeks ago. Then we updated to 7.1.0, but ran into a different now-fixed issue. Updating to 7.1.2 restored the original issue we were experiencing.

When your team is running into this issue is it intermittent across various sites or is it happening with a single specific site?

It’s happening with a specific site. The site is very large, but that isn’t a new development, and we never had trouble using Local with it until recently. It also happens even if we’re only syncing the database (no files).

Are there any particular steps to replicate the error for example or does it just seem to be random?

It happens consistently when syncing the database. Files sync just fine. We can see in Adminer that most of the database syncs, it just seems to be choking at a certain point.

While we don’t have a hard limit on the size of a site that can be pulled or pushed with Local, sites that are 5GB or larger can occasionally struggle due to some timeout limitations.

This is a large site, but it’s odd that the error always happens when processing the /app/public/_wpeprivate/autoload.sql SQL file, and persists even if we’re only syncing the database, which is far below 5GB in size.

Here’s the specific error encountered in the log I passed along earlier:

{"thread":"main","class":"ImporterWPE","stack":"Error: ERROR 1062 (23000) at line 1966: Duplicate entry '?' for key 'token'\n    at %%appPath%%/main/_helpers/importSQLFile.js:1:2560\n    at Generator.next (<anonymous>)\n    at a (%%appPath%%/main/_helpers/importSQLFile.js:1:742)","level":"error","message":"Unable to import /Users/HOMEDIR/Local Sites/SITENAME/app/public/_wpeprivate/autoload.sql","timestamp":"2023-08-08T22:30:34.670Z"}

I’d love to know what’s on line 2560 of main/_helpers/importSQLFile.js, but I’m not sure where %%appPath%% is or if its viewable.

Also, following up on your earlier question:

Does downloading a backup and direct importing work?

I tried downloading a full site backup and importing it to see if this would also work, but it did not. Local reports that the process “succeeded,” but the resulting site displays various “missing file” errors and the like.

So right now, the only method that works for us is:

  1. Create a partial backup in WP Engine that only includes the site’s database.
  2. Use Local Connect to sync the site.
  3. Once it displays the “Uh-oh!” message mentioning /app/public/_wpeprivate/autoload.sql, open the site shell and import the WPE database backup using the command mysql -u root -proot local < path/to/file.sql.

If you’re able to replicate it again, can you go to the Help Center in your Local App, Scroll Down, and click the Download Local Log button? This bundles up several logs and provides us with a lot more diagnostic information for troubleshooting.

If/when we replicate it again, I will reach out to WP Engine support with these details (the log contains customer details I’m not able to share on a public forum).