Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a !monitor command to follow changes on a webpage #18

Closed
34 tasks done
RouxRC opened this issue Sep 28, 2015 · 1 comment
Closed
34 tasks done

Add a !monitor command to follow changes on a webpage #18

RouxRC opened this issue Sep 28, 2015 · 1 comment

Comments

@RouxRC
Copy link
Owner

RouxRC commented Sep 28, 2015

Back:

  • Add monitor/unmonitor commands
  • Handle list pages
  • Handle newsurl for pages
  • Add feeder to collect html of pages
  • handle page errors : warn once when 404 or 503 ? irrelevant
  • Save html data to filesystem
  • apply url_rewrite for relative links
  • extract rawtext
  • extract ordered links
  • check if exists, store if not, else check diff and warn
  • store screenshot via manet
  • generate screenshot thumbnails
  • adjust timer of feeder
  • display url with version arguments for better backlog
  • no warn if back and forth
  • handle pdfs cf [WebMonitor] Handle diffs on PDF source #42

Front:

RouxRC added a commit that referenced this issue Jan 5, 2016
RouxRC added a commit that referenced this issue Jan 5, 2016
RouxRC added a commit that referenced this issue Jan 5, 2016
RouxRC added a commit that referenced this issue Jan 5, 2016
RouxRC added a commit that referenced this issue Apr 30, 2017
RouxRC added a commit that referenced this issue Apr 30, 2017
RouxRC added a commit that referenced this issue Apr 30, 2017
RouxRC added a commit that referenced this issue Apr 30, 2017
RouxRC added a commit that referenced this issue Apr 30, 2017
RouxRC added a commit that referenced this issue Apr 30, 2017
RouxRC added a commit that referenced this issue Apr 30, 2017
RouxRC added a commit that referenced this issue Apr 30, 2017
RouxRC added a commit that referenced this issue May 1, 2017
RouxRC added a commit that referenced this issue May 1, 2017
RouxRC added a commit that referenced this issue May 1, 2017
RouxRC added a commit that referenced this issue May 1, 2017
RouxRC added a commit that referenced this issue May 5, 2017
RouxRC added a commit that referenced this issue May 5, 2017
RouxRC added a commit that referenced this issue May 5, 2017
RouxRC added a commit that referenced this issue May 5, 2017
RouxRC added a commit that referenced this issue May 5, 2017
RouxRC added a commit that referenced this issue May 7, 2017
RouxRC added a commit that referenced this issue May 7, 2017
RouxRC added a commit that referenced this issue May 7, 2017
RouxRC added a commit that referenced this issue May 8, 2017
RouxRC added a commit that referenced this issue May 8, 2017
RouxRC added a commit that referenced this issue May 8, 2017
@RouxRC RouxRC closed this as completed Jul 30, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant