v0.13.0

This release introduces several new ComfyUI pipelines, including Florence 2, LivePortrait, and Sam2, alongside significant performance optimizations and bug fixes for both the realtime AI stack and non-realtime pipelines like A2T and LLM. These updates enhance processing efficiency, stability, and functionality across the platform.

What's Changed

• Add nvidia-ml-py to requirements by @eliteprox in #305
• runner/live: Refactor pipeline streamer and add some docs by @victorges in #306
• Fix missing nvidia-ml-py by @leszko in #310
• runner/lv2v: Always exit main process when infer.py finishes by @victorges in #312
• (chore) fix startup with asyncio.create_task by @eliteprox in #314
• change github build action to run on oxford for live-pipeline builds by @pschroedl in #318
• runner/live: Ignore keepalive messages from control subscriber by @j0sh in #313
• Live video to video/comfyui sam2 by @pschroedl in #316
• ci(runner): add runner test ci by @rickstaa in #295
• ci(runner): add runner test ci by @rickstaa in #296
• ci(runner): change live pipelines docker runner by @rickstaa in #320
• feat: add flash_attention_2 to audio_to_text pipeline's attn_implementation by @RUFFY-369 in #308
• ci(worker): update go version by @rickstaa in #321
• ci(worker): fix worker test ci go version error by @rickstaa in #322
• runner/req: Add pynvml dependency by @victorges in #323
• Revert "(chore) fix startup with asyncio.create_task" by @eliteprox in #317
• fix: slow resize by @varshith15 in #315
• runner/live/trickle: Fix publisher/subscribe lifecycle by @victorges in #324
• (chore) remove cleanup-runner for self-hosted runners by @eliteprox in #328
• ci(runner): temporarily disable pipeline concurrency cancellation by @rickstaa in #329
• worker: Fix typo breaking build by @victorges in #332
• Init prompt from params by @pschroedl in #327
• ci(runner): remove cancel in context comment by @rickstaa in #333
• ci(runner): prevent pipeline docker CI from running on mac by @rickstaa in #331
• ci(runner): add amd64 runner label to pipeline docker ci by @rickstaa in #336
• ci(runner): disable fail fast for batch docker ci by @rickstaa in #337
• runner/docker: Fix streamdiffusion base image by @victorges in #340
• runner/docker: Install pynvml on noop by @victorges in #341
• Fix dl_checkpoints.sh: don use -it flag when running docker containers by @pwilczynskiclearcode in #339
• bump commit hash for streamdiffusion node, update dl_checkpoints.sh by @pschroedl in #344
• feat: Add florence 2 to comfyui container by @ad-astra-video in #343
• runner/live: Report pipeline status on trickle channel by @victorges in #309
• Update dl_checkpoints.sh for ComfyUI pipeline by @leszko in #346
• runner/docker: add cv2 to noop by @victorges in #348
• runner: Fix Awaitable import by @victorges in #350
• streamer: Fix remaining typos by @victorges in #351
• Update Sam2 ComfyUI Node by @pschroedl in #335
• feat: update florence 2 to add run mode by @ad-astra-video in #347
• ci(runner): enable docker build cancel-in-progress on feature branches by @rickstaa in #338
• dl_checkpoints.sh --tensorrt - exit if previous build is still running by @pwilczynskiclearcode in #357
• dl_checkpoints.sh new --batch flag to install only sam2-hiera-large model by @pwilczynskiclearcode in #358
• hotfix/resize_bug by @varshith15 in #360
• runner/pipelines: Accept ComfyUI prompt as a string by @victorges in #353
• streamer: Improve timestamp logic on status reporting by @victorges in #354
• runner/streamer: Fix nested process restart by @victorges in #361
• Fix model cache directory by @leszko in #365
• chore: update CODEOWNERS by @rickstaa in #366
• runner/docker: integrate ComfyUI LivePortrait by @emranemran in #342
• runner/live: Improve pipeline status schema by @victorges in #362
• update: Florence 2 commit for optimizations by @ad-astra-video in #363
• update: florence 2 node commit hash for bug fixes by @ad-astra-video in #369
• update comfui_stablediffusion, add checkpoints and lora by @pschroedl in #364
• streamer: Fix timestamp serialization as int ms by @victorges in #370
• Pull runner images by @leszko in #372
• dl_checkpoints.sh run correct docker image based on envs or default by @pwilczynskiclearcode in #374
• dl_checkpoints.sh - restore docker pull for mutable docker tags by @pwilczynskiclearcode in #375
• trickle: Add reconnects in subscriber. by @j0sh in #376
• Add a notification step after docker build succeeds for ai-runner:latest by @hjpotter92 in #377
• runner: Improve live video-to-video runner stability by @victorges in #371
• update florence2 models download by @ad-astra-video in #379
• live/streamer: Fix streamer shutdown logic by @victorges in #380
• docs: Add general documentation on realtime architecture by @victorges in #381
• Use vLLM to load LLMs by @kyriediculous in #230
• runner: fix openapi gen, add llm to workflows and container list by @ad-astra-video in #384

New Contributors

• @RUFFY-369 made their first contribution in #308
• @varshith15 made their first contribution in #315
• @pwilczynskiclearcode made their first contribution in #339

Full Changelog: v0.12.6...v0.13.0