Redirection issue in Build version

[utkarshsaraogi-zolve]

Hello Everyone, First time posting here.
I'm facing an issue with website redirection in build version, on development version it works fine.
If I access a certain route directly, it redirects back to index page. Also if a wrong path is accessed 404 page doesn't show up.

All these paths mentioned below redirects to index (https://mywebsite.com/) if opened directly, but if I navigate using the navbar the page can be accessed.
Valid Path:
https://mywebsite.com/scholarship/
https://mywebsite.com/internship/

Invalid Path:
https://mywebsite.com/wrong-path/

This path should ideally redirect to 404 page, but instead redirects to index.

On the other hand this route works for me. It doesn't redirect back to index route, and renders the page.
https://mywebsite.com/credit-card/signature/

Not sure what can be the problem here. Can anyone point me in the right direction?
I've gone through the Gatsby docs and have done the setup accordingly.

I've added the screenshot for project structure and the logs.