v0.13.0

This release introduces several new ComfyUI pipelines, including Florence 2, LivePortrait, and Sam2, alongside significant performance optimizations and bug fixes for both the realtime AI stack and non-realtime pipelines like A2T and LLM. These updates enhance processing efficiency, stability, and functionality across the platform.

What's Changed

• Add nvidia-ml-py to requirements by @eliteprox in #305
• runner/live: Refactor pipeline streamer and add some docs by @victorges in #306
• Fix missing nvidia-ml-py by @leszko in #310
• runner/lv2v: Always exit main process when infer.py finishes by @victorges in #312
• (chore) fix startup with asyncio.create_task by @eliteprox in #314
• change github build action to run on oxford for live-pipeline builds by @pschroedl in #318
• runner/live: Ignore keepalive messages from control subscriber by @j0sh in #313
• Live video to video/comfyui sam2 by @pschroedl in #316
• ci(runner): add runner test ci by @rickstaa in #295
• ci(runner): add runner test ci by @rickstaa in #296
• ci(runner): change live pipelines docker runner by @rickstaa in #320
• feat: add flash_attention_2 to audio_to_text pipeline's attn_implementation by @RUFFY-369 in #308
• ci(worker): update go version by @rickstaa in #321
• ci(worker): fix worker test ci go version error by @rickstaa in #322
• runner/req: Add pynvml dependency by @victorges in #323
• Revert "(chore) fix startup with asyncio.create_task" by @eliteprox in #317
• fix: slow resize by @varshith15 in #315
• runner/live/trickle: Fix publisher/subscribe lifecycle by @victorges in #324
• (chore) remove cleanup-runner for self-hosted runners by @eliteprox in #328
• ci(runner): temporarily disable pipeline concurrency cancellation by @rickstaa in #329
• worker: Fix typo breaking build by @victorges in #332
• Init prompt from params by @pschroedl in #327
• ci(runner): remove cancel in context comment by @rickstaa in #333
• ci(runner): prevent pipeline docker CI from running on mac by @rickstaa in #331
• ci(runner): add amd64 runner label to pipeline docker ci by @rickstaa in #336
• ci(runner): disable fail fast for batch docker ci by @rickstaa in #337
• runner/docker: Fix streamdiffusion base image by @victorges in #340
• runner/docker: Install pynvml on noop by @victorges in #341
• Fix dl_checkpoints.sh: don use -it flag when running docker containers by @pwilczynskiclearcode in #339
• bump commit hash for streamdiffusion node, update dl_checkpoints.sh by @pschroedl in #344
• feat: Add florence 2 to comfyui container by @ad-astra-video in #343
• runner/live: Report pipeline status on trickle channel by @victorges in #309
• Update dl_checkpoints.sh for ComfyUI pipeline by @leszko in #346
• runner/docker: add cv2 to noop by @victorges in #348
• runner: Fix Awaitable import by @victorges in #350
• streamer: Fix remaining typos by @victorges in #351
• Update Sam2 ComfyUI Node by @pschroedl in #335
• feat: update florence 2 to add run mode by @ad-astra-video in #347
• ci(runner): enable docker build cancel-in-progress on feature branches by @rickstaa in #338
• dl_checkpoints.sh --tensorrt - exit if previous build is still running by @pwilczynskiclearcode in #357
• dl_checkpoints.sh new --batch flag to install only sam2-hiera-large model by @pwilczynskiclearcode in #358
• hotfix/resize_bug by @varshith15 in #360
• runner/pipelines: Accept ComfyUI prompt as a string by @victorges in #353
• streamer: Improve timestamp logic on status reporting by @victorges in #354
• runner/streamer: Fix nested process restart by @victorges in #361
• Fix model cache directory by @leszko in #365
• chore: update CODEOWNERS by @rickstaa in #366
• runner/docker: integrate ComfyUI LivePortrait by @emranemran in #342
• runner/live: Improve pipeline status schema by @victorges in #362
• update: Florence 2 commit for optimizations by @ad-astra-video in #363
• update: florence 2 node commit hash for bug fixes by @ad-astra-video in #369
• update comfui_stablediffusion, add checkpoints and lora by @pschroedl in #364
• streamer: Fix timestamp serialization as int ms by @victorges in #370
• Pull runner images by @leszko in #372
• dl_checkpoints.sh run correct docker image based on envs or default by @pwilczynskiclearcode in #374
• dl_checkpoints.sh - restore docker pull for mutable docker tags by @pwilczynskiclearcode in #375
• trickle: Add reconnects in subscriber. by @j0sh in #376
• Add a notification step after docker build succeeds for ai-runner:latest by @hjpotter92 in #377
• runner: Improve live video-to-video runner stability by @victorges in #371
• update florence2 models download by @ad-astra-video in #379
• live/streamer: Fix streamer shutdown logic by @victorges in #380
• docs: Add general documentation on realtime architecture by @victorges in #381
• Use vLLM to load LLMs by @kyriediculous in #230
• runner: fix openapi gen, add llm to workflows and container list by @ad-astra-video in #384

New Contributors

• @RUFFY-369 made their first contribution in #308
• @varshith15 made their first contribution in #315
• @pwilczynskiclearcode made their first contribution in #339

Full Changelog: v0.12.6...v0.13.0

v0.12.6

What's Changed

• live/runner: Increase liveportrait restart threshold by @victorges in #294
• Allow running worker on non-GPU machine by @leszko in #291
• fix: prevents nvml runtime error by @rickstaa in #292
• api: Fix startup of control API by @victorges in #300
• Add error handling to control message handler task by @eliteprox in #302
• runner: add events url to live video to video by @gioelecerati in #303
• runner: Make control_url and events_url optional by @victorges in #304
• SAM2 video-to-video real-time pipeline by @eliteprox in #280
• fix: managed containers return after inference completed by @ad-astra-video in #301

New Contributors

• @gioelecerati made their first contribution in #303

Full Changelog: v0.12.5...v0.12.6

v0.12.5

What's Changed

• feat: add hardware info reporting by @ad-astra-video in #273
• feat(worker): auto pull images if not found by @rickstaa in #200

Full Changelog: v0.12.4...v0.12.5

v0.12.4

What's Changed

• docker: ComfyUI model downloading/caching by @victorges in #284
• worker,runner: Fix lifecycle management of realtime containers by @victorges in #288
• test: add b64 functions tests by @rickstaa in #285
• worker: Add noop image to map by @victorges in #289
• Fix control_url task runner by @eliteprox in #290

Full Changelog: v0.12.3...v0.12.4

v0.12.3

What's Changed

• runner: Create liveportrait pipeline container by @victorges in #278
• worker+runner: Dynamically start live inference runners by @victorges in #275
• .github: Create CI for live pipelines docker images by @victorges in #282

Full Changelog: v0.12.2...v0.12.3

v0.12.2

What's Changed

• runner/live: Cleanup dockerfiles by @victorges in #265
• runner/live: Rename StreamKohaku to StreamDiffusion by @victorges in #266
• live/infer: Allow running with zeromq protocol by @victorges in #267
• live/streamdiffusion: Allow configuring all params by @victorges in #268
• (lv2v) remove unsupported parameters by @eliteprox in #270
• live/trickle: Updates for go-livepeer by @j0sh in #271
• runner/live: Make sure to resize images outside of infer process by @victorges in #272
• Add ComfyUI pipeline by @leszko in #269
• runner/docker: Fix streamdiffusion deps installation by @victorges in #277
• Add Noop pipeline for local testing by @leszko in #276
• runner/live: Fix image resize logic to always set width,heiht by @victorges in #281
• Add Control API by @leszko in #279

New Contributors

• @leszko made their first contribution in #269

Full Changelog: v0.12.1...v0.12.2

v0.12.1

What's Changed

• fix: ensure SDK generation succeeds by @rickstaa in #260
• fix: cuda OOM error handling by @rickstaa in #262
• refactor: simplify ModelName class by @rickstaa in #264
• chore: fix dev container build by @rickstaa in #261
• chore: apply formatter suggestions by @rickstaa in #263

Full Changelog: v0.12.0...v0.12.1

v0.12.0

What's Changed

• Add response params for live-video-to-video by @j0sh in #256
• live/infer: Improve process restart logic for stale pipeline by @victorges in #259
• Add SD3.5 by @ad-astra-video in #258
• live/infer: Add trickle input and output by @j0sh in #253
• Enable new models in audio-to-text by @eliteprox in #163

Full Changelog: v0.11.0...v0.12.0

v0.11.0

What's Changed

• refactor(runner): apply small code improvements by @rickstaa in #246
• chore: update OpenAPI spec and client bindings by @rickstaa in #247
• runner/live: Fix params API params piping by @victorges in #249
• Remove gstreamer from live-multimedia Dockerfile by @j0sh in #251
• Add publish / subscribe params for live video-to-video by @j0sh in #252
• Fix logging in live subprocess. by @j0sh in #254
• [AI] Parler Text to Speech by @pschroedl in #219
• refactor(runner): improve SAM2 container dev experience by @rickstaa in #257

New Contributors

• @victorges made their first contribution in #249
• @j0sh made their first contribution in #251

Full Changelog: v0.10.0...v0.11.0

v0.10.0

What's Changed

• fix torch device comparison by @yaodingyd in #227
• ci: make pipeline docker ci more generic by @rickstaa in #240
• Add live_video_to_video pipeline by @emranemran in #233
• fix(runner): handle empty prompt in T2I input by @rickstaa in #244

New Contributors

• @yaodingyd made their first contribution in #227

Full Changelog: v0.9.2...v0.10.0