Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Future topics #138

Open
kordwarshuis opened this issue Apr 4, 2024 · 6 comments
Open

Future topics #138

kordwarshuis opened this issue Apr 4, 2024 · 6 comments
Assignees
Labels
maintenance A maintenance issue to be picked up at regular maintenance weeks

Comments

@kordwarshuis
Copy link
Collaborator

kordwarshuis commented Apr 4, 2024

Future topics. One topic per comment.

@kordwarshuis
Copy link
Collaborator Author

Scraping feature

  • Per category we’d like to present “Next scraping ”
  • Find out how to introduce a human step to push the By hand - button
  • GitHub secrets is involved too because a random visitor who hits the ‘scrape now’ button should invoke the result being integrated in the general Typesets engine

@kordwarshuis
Copy link
Collaborator Author

Test scenario's : Mocha / Puppeteer / Jest

(Kor added:) Example / reference:
https://www.digitalocean.com/community/tutorials/how-to-write-end-to-end-tests-in-node-js-using-puppeteer-and-jest

@kordwarshuis
Copy link
Collaborator Author

Starting from InstantSearch.js v4.46.0, string-based and Hogan.js templates are deprecated. https://www.algolia.com/doc/guides/building-search-ui/upgrade-guides/js/#upgrade-templates

@kordwarshuis
Copy link
Collaborator Author

Find alternative to dwarshuis.com for hosting proxies etc

@kordwarshuis
Copy link
Collaborator Author

Kor: improve scraping of container elements like

and main. element.textContent concatenates child nodes without spaces. This impacts search results

@henkvancann
Copy link
Collaborator

Find alternative to dwarshuis.com for hosting proxies etc

Would be possible with Heroku (with the 7 euro/month)

@kordwarshuis kordwarshuis self-assigned this Aug 26, 2024
@henkvancann henkvancann added the maintenance A maintenance issue to be picked up at regular maintenance weeks label Aug 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
maintenance A maintenance issue to be picked up at regular maintenance weeks
Projects
None yet
Development

No branches or pull requests

2 participants