Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

IAFD no longer working #347

Open
slappy2 opened this issue Apr 3, 2021 · 3 comments
Open

IAFD no longer working #347

slappy2 opened this issue Apr 3, 2021 · 3 comments
Labels

Comments

@slappy2
Copy link

slappy2 commented Apr 3, 2021

IAFD only return the Year all others field are left blank. as of April 03 2021.

@slappy2 slappy2 added the bug label Apr 3, 2021
@CodyBerenson
Copy link

IAFD implemented CloudFlare, which broke all scraping "robots". Their FAQ is extremely aggressive. From their terms of service:

Use of robots (Teleport Pro, WGet, etc.) that do not comply with our robots.txt (and cloak themselves to boot) will result in the blocking of your IP address or possibly your entire subnet. If we catch you, we will ruin it for you :-). Use the database online... please don't archive it for your personal use.

Doubt the Java scraper will ever work with IAFD again. :(

@lukewoodau
Copy link

If anyone was able to help create a alternate version to iafd happy to help and have it open so can then add as a scraping option on here

@CodyBerenson
Copy link

@lukewoodau Our developer was able to get around CloudFlare. Here is our IAFD Plex Agent. Hope this helps. https://github.com/CodyBerenson/PGMA-Modernized/tree/master/IAFD.bundle

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants