City Scrapers Template

Template repo for running a City Scrapers project in your area.

Data Link

• The data collected by this project is posted to:
• https://city-scrapers-pittsburgh.github.io/city-scrapers-events/

Setup

• Fork this repo to your GitHub account or organization account. Feel free to change the name to something specific to your area (i.e. city-scrapers-il for scrapers in Illinois).
• Fill out this form to join our Slack channel
• Update LICENSE, CODE_OF_CONDUCT.md, CONTRIBUTING.md, README.md with your organization's information.
• Enable Travis CI for running automated tests and builds
• Setup deployment
  • Setup a daily cronjob on Travis CI to run the scrapers nightly see instructions
  • Setup Azure or S3, on own or with us (give contact)
  • Enable settings, configure in Travis depending on provider used
• Setup Sentry for error tracking and notifications
• Refer to our documentation on getting started with development