- Multithreading for increased speed
- Technically for such problems, multi-threading would serve us well since its an io-bound (network) task.
- However, we will not utilise it here so as to avoid the risk of being banned e.g. making too many requests within a short period of time
- Potential for monetisation
- LinkedIn does not have official APIs and API-key mechanisms (temporary authentication) that supports this
- Due to security reason(s) and concern(s), it is not preferred for users to submit their credentials to their own LinkedIn accounts
- Reusing our same/ few different accounts for scraping jobs submitted by many users will also likely get the account(s) banned; and is therefore not scalable.
-
Notifications
You must be signed in to change notification settings - Fork 0
kelvinxuande/job-scrapers
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
Scrapes job posts from LinkedIn and Indeed using Selenium. Also includes some further analysis and simple explorations with langchain
Topics
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published