v3.8.0

Changed

• Migrates from yarn to npm as dependency manager
• Updates @polkadot/js dependency (included in @joystream/js) version to be compatible with Nara runtime
• Updates @graphql-codegen/cli dependency version

Changelog

https://github.com/Joystream/youtube-synch/blob/main/CHANGELOG.md#380

v3.7.0

Added

• Adjust sync limits for different YPP tiers

Changelog

https://github.com/Joystream/youtube-synch/blob/main/CHANGELOG.md#370

v3.6.0

Changed

• Replace Query-Node with Orion for graphql queries, and remove all unused graphql query definitions.

Fixed

• FIX: use GraphQLWsLink instead of deprecated WebSocketLink for graphql subscription, as WebSocketLink based subscription does not work with Orion API.
• FIX: Properly handle error when failing to download removed/deleted videos from Youtube.

Changelog

https://github.com/Joystream/youtube-synch/blob/main/CHANGELOG.md#360

v3.5.0

Added

• Add support for setting isShort field in the video metadata (indicating whether video is a short format, vertical video or not) when creating the video.
• Support connecting to chisel server proxy ec2 instance using Private IP address.

Fixed

• FIX: Properly handle error when failing to download the members-only content from Youtube.

Changelog

https://github.com/Joystream/youtube-synch/blob/main/CHANGELOG.md#350

v3.4.0

Added

• Enable OpenTelemetry integration for tracing
• Support running httpApi and sync as separate services

Fixed

• FIX: Added timeout in ContentMetadataService to avoid infinite waiting for the video to be processed
• FIX: Restarting the chisel client container from inside the yt-synch container
• FIX: Skip uploading the object to the storage node if it already exists
• FIX: ytdlpClient.getVideos method

Changelog

https://github.com/Joystream/youtube-synch/blob/main/CHANGELOG.md#340

v3.3.0

Added

• Added chisel proxy setup with automated IP rotation mechanism to circumvent youtube IP blockage, also integrated proxy setup with yt-synch server. See docs for more details
• Optimizes Youtube API quota usage by using yt-dlp instead of youtubeApi to fetch the channel details
• Added processedAt in channels schema to track the timestamp when channel was processed (Verified/Suspended)
• Removed unused method from video repository
• Added YPP InductionRequirement of CHANNEL_CRITERIA_UNMET_CREATION_DATE
• Update video processing priority calculation to prioritize Silver+ tier channels

Fixed

• FIX: Update referral reward values
• FIX: Added error handling for winston logger
• FIX: Remove stale downloaded videos
• FIX: Avoid updating some channel properties e.g. createdAt, email, userId on re-signup

Changelog

https://github.com/Joystream/youtube-synch/blob/main/CHANGELOG.md#330

v3.2.0

Added

• Optimizes Youtube API quota usage by using yt-dlp instead of youtubeApi to fetch the video details
• add pendingDownloadTimeoutSec config option to manage timeout for youtube downloads
• Add multiple variants to YtVideo.state.VideoUnavailable

Fixed

• FIX: add optional locking feature for Dynamodb tables
• FIX: Only calculate priority for sync-able videos

Changelog

https://github.com/Joystream/youtube-synch/blob/main/CHANGELOG.md#320

v3.1.0

Added

• bump @bull-board npm dependency
• Add new referrers/top-referrers endpoint to return top referrers by cumulative reward
• Updates channels/induction/requirements endpoint to return both the requirements as well as error messages if the signup fails

Fixed

• FIX: lock bullmq jobs processing when recalculating the priorities
• FIX: skip stall check & add auto-renewal of locks for batch jobs
• FIX: remove joystreamChannelId field from video type + add optional locking feature for Dynamodb tables
• FIX: add timeout for 'pWaitFor' in storage-node/api.ts

Changelog

https://github.com/Joystream/youtube-synch/blob/main/CHANGELOG.md#310

v2.1.0

Added

• return syncBacklog field in GET /status endpoint

Fixed

• FIX: Adds fix for premiere videos not syncing bug

Changelog

https://github.com/Joystream/youtube-synch/blob/main/CHANGELOG.md#210

PR

#253

v2.0.0

Added

• Updates minimum required NodeJS version to v18.
• Adds referredChannels field in GET /channels/{joystreamChannelId} endpoint's response.
• Adds configuration option to enable/disable syncing by operators.
• Introduced feature to sync videos of only Verified channels.
• Introduced feature for per channel based sync limits.

Fixed

• FIX: Adds validation against multiple signups by same Joystream channel.
• FIX: Hide elasticsearch credentials in the logs.
• FIX: Make avatar optional in create membership (POST /membership) request.
• FIX: Youtube Quota usage query endpoint.

Changelog

https://github.com/Joystream/youtube-synch/blob/main/CHANGELOG.md#200

PR

#235