Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Collect and archive RSS posts based on workflow periodicity #71

Merged
merged 5 commits into from
Nov 14, 2023

Conversation

hyponet
Copy link
Contributor

@hyponet hyponet commented Nov 14, 2023

  • Introduced API support for configuring Source Plugin in the Controller layer.
  • Implemented periodic querying and triggering of workflows based on plugin labels.
  • Expanded support for collecting additional metadata during RSS collection, aiming to retain as much data as possible. Workflow-collected metadata can now be stored in database.
  • Added hidden plugin JSON files in the source folder to provide supplementary context.
  • When collecting RSS feeds, the collection records are saved in the supplementary context. Only new articles that have not been collected before are targeted for collection.
  • Enhanced workflow target rules to support filtering by file extensions (triggering for any format supported by docloader).
  • The request in a workflow can pass down properties from the parent entry (only if the parent contains specific fields, AI will be triggered).
  • Added support for enabling/disabling feed through xattr: a label is added to Group Entry.
  • Enabled cron support in workflows and re-register with the cron handler after starting.
  • Added an "encoded" flag to the extend field behind xattr to differentiate between whether it has been base64 encoded. Auto decode when performing a match.
  • Remove aliyun driver support

@hyponet hyponet merged commit 331765c into main Nov 14, 2023
1 of 2 checks passed
@hyponet hyponet deleted the feature/rss-input branch November 14, 2023 14:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant