Google cannot index my Next.js app hosted on Vercel

[duckception]

Summary

I'm hosting my Next.js app on Vercel, which cannot be indexed by Google for some reason. I get the "Page cannot be indexed: Server error (5xx)" error in the Google console even though the app is accessible normally through the browser. Google support hinted it might be an issue with the hosting (Vercel).

Example

No response

Steps to Reproduce

My app had no changes whatsoever when it suddenly, out of nowhere, stopped being indexed by Google:

All tries to index it end up with the 500 error even though the app is fully working and accessible through the browser:

The robots.txt file allows for all crawlers:

# Allow all crawlers
User-agent: *
Allow: /

The app runs on Next.js version 14.0.3 with the App Router.

At this point, I'm not really sure what to do, and I'd appreciate any help 🙏

[bouia]

Ran into the same issue, have you had any luck solving this?

[jeromverschoote]

Same issue here. Am I doing something wrong?

[jeromverschoote]

Solved the issue by fixing a bug in the middleware file of the project 👍

[duckception]

In my case, I had a few bugs in my code that appeared in the console and during compilation. These bugs were not so critical cause the website worked without an issue for the users. However, it was crashing the website for Google bots, and thus, the indexing wasn't working and giving me the 500 error in the Google dashboard. Once I fixed them, everything started to work. Hope this helps anyone that encounters this issue 🫡

[github-actions[bot]]

This discussion was automatically locked because the community moved to a new site. Please join us at vercel.community