Getting 404 on 'Hello World' of any fresh install using Apache

I’m getting a 404 when trying to view the ‘Hello World’ post of a fresh install, whenever Apache is chosen as the server in Custom configuration. Have tried with variation combinations of different PHP and MySQL versions. Same goes for creating any new posts or pages. Sometimes the post/page’s Preview will display, although never the permalink once it’s published (most of the time the preview does not work at all, though).

The “Preferred” config with nginx works fine.