A web crawler using Go and Svelte. The Go backend handles the web crawling and data extraction quickly and efficiently using concurrency. The Svelte frontend provides a simple and interactive interface.
Click on the "Fork" button.
By forking the repository, you will have your version of the repository under your GitHub username.
Once you have forked your repository, go to your profile inside the repository section, and you will find your forked repository.
- Clone the repository
git clone https://github.com/YOUR_GITHUB_USERNAME/web-crawler.git
- In Visual Studio Code in root directory run:
go run .
- Change directory and install dependencies
cd web-crawler/ui
npm install
- Run the app
npm run dev
You can view the project in working here.
For any queries, please feel free to reach out to me at mail or Twitter - @jatiin_yadav.