diff --git a/.github/workflows/deploy-docs.yml b/.github/workflows/deploy-docs.yml index 1037fb58..d04069f5 100644 --- a/.github/workflows/deploy-docs.yml +++ b/.github/workflows/deploy-docs.yml @@ -42,15 +42,15 @@ jobs: github_token: ${{ secrets.UPDATE_GH_PAGES }} publish_dir: ./docs/site - - name: Remove existing files on remote server - uses: appleboy/ssh-action@master - with: - host: ${{ secrets.REMOTE_HOST }} - username: ${{ secrets.REMOTE_USER }} - key: ${{ secrets.SSH_PRIVATE_KEY }} - port: ${{ secrets.REMOTE_PORT }} - script: | - rm -rf ${{ secrets.REMOTE_DEST_PATH }}/../../docs + # - name: Remove existing files on remote server + # uses: appleboy/ssh-action@master + # with: + # host: ${{ secrets.REMOTE_HOST }} + # username: ${{ secrets.REMOTE_USER }} + # key: ${{ secrets.SSH_PRIVATE_KEY }} + # port: ${{ secrets.REMOTE_PORT }} + # script: | + # rm -rf ${{ secrets.REMOTE_DEST_PATH }}/../../docs - name: Deploy via scp uses: appleboy/scp-action@master diff --git a/README.md b/README.md index 3aede9cb..2df9b5e3 100644 --- a/README.md +++ b/README.md @@ -1,8 +1,8 @@ # BizyAir - +- [2024/07/11] 🌩️ We release new nodes that can perform ControlNet preprocessing. [BizyAir Controlnet Auxiliary Preprocessors](https://siliconflow.github.io/BizyAir/controlnet-preprocessor/introduce.html) - [2024/07/11] 🌩️ We release new nodes, featuring removing image background, photo-quality image generation, and animation super-resolution capabilities. -- [2024/07/10] 🌩️ We release nodes that support Kolors and LLM(large language models). +- [2024/07/10] 🌩️ We release nodes that support Kolors and LLM(large language models). [Kolors](https://siliconflow.github.io/BizyAir/kolors/introduce.html) BizyAir is a collection of [ComfyUI](https://github.com/comfyanonymous/ComfyUI) nodes that help you overcome environmental and hardware limitations, allowing you to more easily generate high-quality content with ComfyUI. @@ -13,15 +13,23 @@ BizyAir is a collection of [ComfyUI](https://github.com/comfyanonymous/ComfyUI) ## Table of Contents - [Features](#features) +- [Usage](#usage) - [Installation](#installation) - [Examples](#examples) -- [Usage](#usage) ## Features Run ComfyUI anywhere, anytime, without worrying about the environment or hardware requirements. +## Usage + +Please see the [Quick Start](https://siliconflow.github.io/BizyAir/getting-started/quick-start.html) page to set up BizyAir. + +Make sure to **set your API KEY** for the **first time** use! + +![](./docs/docs/getting-started/imgs/how-to-set-key.gif) + ## Installation You can install BizyAir through several methods: using the ComfyUI Manager, the Comfy CLI, downloading the standalone package for Windows, or by cloning the BizyAir repository into the custom_nodes subdirectory of ComfyUI. @@ -70,8 +78,3 @@ https://bizy-air.oss-cn-beijing.aliyuncs.com/new_ComfyUI_windows_portable_nvidia ## Examples There are some workflow examples in the [examples](./examples) directory. - - -## Usage - -Please see the [Quick Start](https://siliconflow.github.io/BizyAir/getting-started/quick-start.html) page to set up BizyAir. diff --git a/docs/docs/controlnet-preprocessor/imgs/bizyair_controlnet_preprocessors.png b/docs/docs/controlnet-preprocessor/imgs/bizyair_controlnet_preprocessors.png new file mode 100644 index 00000000..61348dce Binary files /dev/null and b/docs/docs/controlnet-preprocessor/imgs/bizyair_controlnet_preprocessors.png differ diff --git a/docs/docs/controlnet-preprocessor/introduce.md b/docs/docs/controlnet-preprocessor/introduce.md new file mode 100644 index 00000000..4139118e --- /dev/null +++ b/docs/docs/controlnet-preprocessor/introduce.md @@ -0,0 +1,56 @@ +# BizyAir ControlNet Auxiliary Preprocessors + +In the workflow of ControlNet, it is usually necessary to have image preprocessing nodes to convert images into Image Prompt that the ControlNet network can use. + +BizyAir offers more than 20 ControlNet preprocessing nodes. + +![](./imgs/bizyair_controlnet_preprocessors.png) + + They have the following categories. + + +## Line Extractors + +- ☁️BizyAir PiDiNet Soft-Edge Lines +- ☁️BizyAir Canny Edge +- ☁️BizyAir Binary Lines +- ☁️BizyAir Scribble Lines +- ☁️BizyAir M-LSD Lines +- ☁️BizyAir HED Soft-Edge Lines +- ☁️BizyAir Fake Scribble Lines (aka scribble_hed) +- ☁️BizyAir Realistic Lineart" + + +## T2I-Adapter Only + +- ☁️BizyAir Color Pallete + +## Semantic Segmentation + +- ☁️BizyAir UniFormer Segmentor +- ☁️BizyAir OneFormer COCO Segmentor +- ☁️BizyAir OneFormer ADE20K Segmentor +- ☁️BizyAir SAM Segmentor + +## Normal and Depth Estimators + +- ☁️BizyAir Zoe Depth Map +- ☁️BizyAir MiDaS Normal Map +- ☁️BizyAir MiDaS Depth Map +- ☁️BizyAir LeReS Depth Map (enable boost for leres++) +- ☁️BizyAir BAE Normal Map +- ☁️BizyAir Depth Anything V2 - Relative +- ☁️BizyAir Metric3D Depth Map +- ☁️BizyAir Metric3D Normal Map + +## Face and Pose Estimators + +- ☁️BizyAir OpenPose Pose +- ☁️BizyAir DWPose Estimator + + +## Tile + +- ☁️BizyAir Tile + + diff --git a/docs/docs/getting-started/quick-start.md b/docs/docs/getting-started/quick-start.md index d9942a21..b4e174b5 100644 --- a/docs/docs/getting-started/quick-start.md +++ b/docs/docs/getting-started/quick-start.md @@ -2,6 +2,9 @@ ## 1. Setting API Key +!!! note + You can get your API KEY from [SiliconCloud](https://cloud.siliconflow.cn/) for free. + For the first use, you need to set your API key using "Set SiliconCloud API Key". Add the "Set SiliconCloud API Key" node and run it(click "Queue Prompt" button). The key changes to "**********", indicating successful operation. ![](./imgs/how-to-set-key.gif) diff --git a/docs/docs/kolors/introduce.md b/docs/docs/kolors/introduce.md index 43a3a419..66e6b4c1 100644 --- a/docs/docs/kolors/introduce.md +++ b/docs/docs/kolors/introduce.md @@ -20,6 +20,6 @@ Here is an example of a image-to-image workflow using Kolors: ![](./imgs/bizyair_kolors_img2img.png) - The nodes provided by BizyAir are compatible with the nodes provided by (ComfyUI-KwaiKolorsWrapper)[https://github.com/kijai/ComfyUI-KwaiKolorsWrapper], allowing you to freely combine them. + The nodes provided by BizyAir are compatible with the nodes provided by [ComfyUI-KwaiKolorsWrapper](https://github.com/kijai/ComfyUI-KwaiKolorsWrapper) , allowing you to freely combine them. Enjoy. diff --git a/docs/mkdocs.yml b/docs/mkdocs.yml index dce8ee94..fe45af43 100644 --- a/docs/mkdocs.yml +++ b/docs/mkdocs.yml @@ -103,11 +103,6 @@ nav: - Installation: getting-started/installation.md - Quick Start: getting-started/quick-start.md - Kolors: kolors/introduce.md + - Controlnet Preprocessing: controlnet-preprocessor/introduce.md - Others: others/index.md - # - Controlnet Preprocessing: - # - Line Extraction: controlnet-preprocessing/line-extraction.md - # - T2I Adapter: controlnet-preprocessing/t2i-adapter.md - # - Semantic Segmentation: controlnet-preprocessing/semantic-segmentation.md - # - Normal and Depth Estimation: controlnet-preprocessing/normal-and-depth-estimation.md - # - Face and Pose Detection: controlnet-preprocessing/face-and-pose-detection.md - # - Others: controlnet-preprocessing/others.md + diff --git a/examples/bizyair_controlnet_preprocessor_workflow.json b/examples/bizyair_controlnet_preprocessor_workflow.json new file mode 100644 index 00000000..52a2ff02 --- /dev/null +++ b/examples/bizyair_controlnet_preprocessor_workflow.json @@ -0,0 +1,2022 @@ +{ + "last_node_id": 57, + "last_link_id": 48, + "nodes": [ + { + "id": 4, + "type": "BizyAirCannyEdgePreprocessor", + "pos": [ + 515, + 530 + ], + "size": { + "0": 315, + "1": 106 + }, + "flags": {}, + "order": 3, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 3 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 21 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirCannyEdgePreprocessor" + }, + "widgets_values": [ + 100, + 200, + 512 + ] + }, + { + "id": 5, + "type": "BizyAirSAMPreprocessor", + "pos": [ + 515, + 766 + ], + "size": { + "0": 315, + "1": 58 + }, + "flags": {}, + "order": 4, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 4 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 22 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirSAMPreprocessor" + }, + "widgets_values": [ + 512 + ] + }, + { + "id": 8, + "type": "BizyAirBinaryPreprocessor", + "pos": [ + 515, + 954 + ], + "size": { + "0": 315, + "1": 82 + }, + "flags": {}, + "order": 5, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 5 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 23 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirBinaryPreprocessor" + }, + "widgets_values": [ + 100, + 512 + ] + }, + { + "id": 9, + "type": "BizyAirScribblePreprocessor", + "pos": [ + 515, + 1166 + ], + "size": { + "0": 315, + "1": 82 + }, + "flags": {}, + "order": 6, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 6 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 24 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirScribblePreprocessor" + }, + "widgets_values": [ + "enable", + 512 + ] + }, + { + "id": 10, + "type": "BizyAirM_LSDPreprocessor", + "pos": [ + 515, + 1378 + ], + "size": { + "0": 315, + "1": 106 + }, + "flags": {}, + "order": 7, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 7 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 25 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirM_LSDPreprocessor" + }, + "widgets_values": [ + 0.1, + 0.1, + 512 + ] + }, + { + "id": 11, + "type": "BizyAirUniFormer_SemSegPreprocessor", + "pos": [ + 515, + 1614 + ], + "size": { + "0": 315, + "1": 58 + }, + "flags": {}, + "order": 8, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 8 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 26 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirUniFormer_SemSegPreprocessor" + }, + "widgets_values": [ + 512 + ] + }, + { + "id": 12, + "type": "BizyAirZoe_DepthMapPreprocessor", + "pos": [ + 515, + 1802 + ], + "size": { + "0": 315, + "1": 58 + }, + "flags": {}, + "order": 9, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 9 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 27 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirZoe_DepthMapPreprocessor" + }, + "widgets_values": [ + 512 + ] + }, + { + "id": 26, + "type": "PreviewImage", + "pos": [ + 1043.3999938964844, + 882 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 27, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 21 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 27, + "type": "PreviewImage", + "pos": [ + 1043.3999938964844, + 1258 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 28, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 22 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 24, + "type": "PreviewImage", + "pos": [ + 1043.3999938964844, + 130 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 25, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 19 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 3, + "type": "BizyAirColorPreprocessor", + "pos": [ + 515, + 342 + ], + "size": { + "0": 315, + "1": 58 + }, + "flags": {}, + "order": 2, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 2 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 20 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirColorPreprocessor" + }, + "widgets_values": [ + 512 + ] + }, + { + "id": 2, + "type": "BizyAirPiDiNetPreprocessor", + "pos": [ + 515, + 130 + ], + "size": { + "0": 315, + "1": 82 + }, + "flags": {}, + "order": 1, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 1 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 19 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirPiDiNetPreprocessor" + }, + "widgets_values": [ + "enable", + 512 + ] + }, + { + "id": 25, + "type": "PreviewImage", + "pos": [ + 1043.3999938964844, + 506 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 26, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 20 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 1, + "type": "LoadImage", + "pos": [ + 100, + 130 + ], + "size": { + "0": 315, + "1": 314 + }, + "flags": {}, + "order": 0, + "mode": 0, + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 38, + 40, + 42, + 44, + 46, + 48 + ], + "shape": 3 + }, + { + "name": "MASK", + "type": "MASK", + "links": null, + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "LoadImage" + }, + "widgets_values": [ + "welcome_to_siliconflow.webp", + "image" + ] + }, + { + "id": 29, + "type": "PreviewImage", + "pos": [ + 1380, + 125 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 29, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 23 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 30, + "type": "PreviewImage", + "pos": [ + 1385, + 514 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 30, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 24 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 31, + "type": "PreviewImage", + "pos": [ + 1393, + 885 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 31, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 25 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 32, + "type": "PreviewImage", + "pos": [ + 1375, + 1263 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 32, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 26 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 33, + "type": "PreviewImage", + "pos": [ + 1719, + 120 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 33, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 27 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 34, + "type": "PreviewImage", + "pos": [ + 1727, + 519 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 34, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 28 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 35, + "type": "PreviewImage", + "pos": [ + 1732, + 890 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 35, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 29 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 37, + "type": "PreviewImage", + "pos": [ + 1737, + 1269 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 36, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 31 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 38, + "type": "PreviewImage", + "pos": [ + 2094, + 118 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 37, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 32 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 39, + "type": "PreviewImage", + "pos": [ + 2094, + 542 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 38, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 33 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 40, + "type": "PreviewImage", + "pos": [ + 2093, + 910 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 39, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 34 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 41, + "type": "PreviewImage", + "pos": [ + 2088, + 1292 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 40, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 35 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 42, + "type": "PreviewImage", + "pos": [ + 2450, + 130 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 41, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 36 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 43, + "type": "PreviewImage", + "pos": [ + 2450, + 565 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 42, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 37 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 45, + "type": "PreviewImage", + "pos": [ + 2455, + 938 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 43, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 39 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 47, + "type": "PreviewImage", + "pos": [ + 2452, + 1298 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 44, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 41 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 49, + "type": "PreviewImage", + "pos": [ + 2806, + 134 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 45, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 43 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 54, + "type": "PreviewImage", + "pos": [ + 2801, + 588 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 46, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 45 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 36, + "type": "PreviewImage", + "pos": [ + 2806, + 977 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 48, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 30 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 56, + "type": "PreviewImage", + "pos": [ + 2813, + 1320 + ], + "size": { + "0": 210, + "1": 246 + }, + "flags": {}, + "order": 47, + "mode": 0, + "inputs": [ + { + "name": "images", + "type": "IMAGE", + "link": 47 + } + ], + "properties": { + "Node name for S&R": "PreviewImage" + } + }, + { + "id": 13, + "type": "BizyAirMiDaS_NormalMapPreprocessor", + "pos": [ + 86, + 531 + ], + "size": { + "0": 315, + "1": 106 + }, + "flags": {}, + "order": 10, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 10 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 28 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirMiDaS_NormalMapPreprocessor" + }, + "widgets_values": [ + 6.28, + 0.1, + 512 + ] + }, + { + "id": 14, + "type": "BizyAirMiDaS_DepthMapPreprocessor", + "pos": [ + 86, + 742 + ], + "size": { + "0": 315, + "1": 106 + }, + "flags": {}, + "order": 11, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 11 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 29 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirMiDaS_DepthMapPreprocessor" + }, + "widgets_values": [ + 6.15, + 1, + 512 + ] + }, + { + "id": 16, + "type": "BizyAirLineArtPreprocessor", + "pos": [ + 67, + 958 + ], + "size": { + "0": 315, + "1": 82 + }, + "flags": {}, + "order": 12, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 12 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 31 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirLineArtPreprocessor" + }, + "widgets_values": [ + "enable", + 512 + ] + }, + { + "id": 17, + "type": "BizyAirLeReS_DepthMapPreprocessor", + "pos": [ + 14, + 1156 + ], + "size": { + "0": 436.79998779296875, + "1": 130 + }, + "flags": {}, + "order": 13, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 13 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 32 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirLeReS_DepthMapPreprocessor" + }, + "widgets_values": [ + 0, + 0, + "enable", + 512 + ] + }, + { + "id": 18, + "type": "BizyAirBAE_NormalMapPreprocessor", + "pos": [ + 72, + 1374 + ], + "size": { + "0": 315, + "1": 58 + }, + "flags": {}, + "order": 14, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 14 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 33 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirBAE_NormalMapPreprocessor" + }, + "widgets_values": [ + 512 + ] + }, + { + "id": 19, + "type": "BizyAirOneFormer_COCO_SemSegPreprocessor", + "pos": [ + 43, + 1587 + ], + "size": { + "0": 315, + "1": 58 + }, + "flags": {}, + "order": 15, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 15 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 34 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirOneFormer_COCO_SemSegPreprocessor" + }, + "widgets_values": [ + 512 + ] + }, + { + "id": 20, + "type": "BizyAirOneFormer_ADE20K_SemSegPreprocessor", + "pos": [ + 26, + 1788 + ], + "size": { + "0": 315, + "1": 58 + }, + "flags": {}, + "order": 16, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 16 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 35 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirOneFormer_ADE20K_SemSegPreprocessor" + }, + "widgets_values": [ + 512 + ] + }, + { + "id": 21, + "type": "BizyAirHEDPreprocessor", + "pos": [ + 966, + 1801 + ], + "size": { + "0": 315, + "1": 82 + }, + "flags": {}, + "order": 17, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 17 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 36 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirHEDPreprocessor" + }, + "widgets_values": [ + "enable", + 512 + ] + }, + { + "id": 22, + "type": "BizyAirFakeScribblePreprocessor", + "pos": [ + 1320, + 1798 + ], + "size": { + "0": 403.20001220703125, + "1": 82 + }, + "flags": {}, + "order": 18, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 18 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 37 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirFakeScribblePreprocessor" + }, + "widgets_values": [ + "enable", + 512 + ] + }, + { + "id": 44, + "type": "BizyAirTilePreprocessor", + "pos": [ + -14, + 1976 + ], + "size": { + "0": 315, + "1": 82 + }, + "flags": {}, + "order": 19, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 38 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 39 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirTilePreprocessor" + }, + "widgets_values": [ + 3, + 512 + ] + }, + { + "id": 46, + "type": "BizyAirDepthAnythingV2Preprocessor", + "pos": [ + 532, + 1990 + ], + "size": { + "0": 319.20001220703125, + "1": 82 + }, + "flags": {}, + "order": 20, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 40 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 41 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirDepthAnythingV2Preprocessor" + }, + "widgets_values": [ + "depth_anything_v2_vitl.pth", + 512 + ] + }, + { + "id": 48, + "type": "BizyAirMetric3D_DepthMapPreprocessor", + "pos": [ + 956, + 1987 + ], + "size": { + "0": 315, + "1": 130 + }, + "flags": {}, + "order": 21, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 42 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 43 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirMetric3D_DepthMapPreprocessor" + }, + "widgets_values": [ + "vit-small", + 1000, + 1000, + 512 + ] + }, + { + "id": 53, + "type": "BizyAirMetric3D_NormalMapPreprocessor", + "pos": [ + 1380, + 1994 + ], + "size": { + "0": 315, + "1": 130 + }, + "flags": {}, + "order": 22, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 44 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 45 + ], + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirMetric3D_NormalMapPreprocessor" + }, + "widgets_values": [ + "vit-small", + 1000, + 1000, + 512 + ] + }, + { + "id": 55, + "type": "BizyAirDWPreprocessor", + "pos": [ + 1843, + 1729 + ], + "size": { + "0": 315, + "1": 198 + }, + "flags": {}, + "order": 23, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 46 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 47 + ], + "shape": 3 + }, + { + "name": "POSE_KEYPOINT", + "type": "POSE_KEYPOINT", + "links": null, + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirDWPreprocessor" + }, + "widgets_values": [ + "enable", + "enable", + "enable", + 512, + "yolox_l.onnx", + "dw-ll_ucoco_384_bs5.torchscript.pt" + ] + }, + { + "id": 57, + "type": "BizyAirOpenposePreprocessor", + "pos": [ + 1810, + 2004 + ], + "size": { + "0": 315, + "1": 150 + }, + "flags": {}, + "order": 24, + "mode": 0, + "inputs": [ + { + "name": "image", + "type": "IMAGE", + "link": 48 + } + ], + "outputs": [ + { + "name": "IMAGE", + "type": "IMAGE", + "links": [ + 30 + ], + "shape": 3 + }, + { + "name": "POSE_KEYPOINT", + "type": "POSE_KEYPOINT", + "links": null, + "shape": 3 + } + ], + "properties": { + "Node name for S&R": "BizyAirOpenposePreprocessor" + }, + "widgets_values": [ + "enable", + "enable", + "enable", + 512 + ] + } + ], + "links": [ + [ + 1, + 1, + 0, + 2, + 0, + "IMAGE" + ], + [ + 2, + 1, + 0, + 3, + 0, + "IMAGE" + ], + [ + 3, + 1, + 0, + 4, + 0, + "IMAGE" + ], + [ + 4, + 1, + 0, + 5, + 0, + "IMAGE" + ], + [ + 5, + 1, + 0, + 8, + 0, + "IMAGE" + ], + [ + 6, + 1, + 0, + 9, + 0, + "IMAGE" + ], + [ + 7, + 1, + 0, + 10, + 0, + "IMAGE" + ], + [ + 8, + 1, + 0, + 11, + 0, + "IMAGE" + ], + [ + 9, + 1, + 0, + 12, + 0, + "IMAGE" + ], + [ + 10, + 1, + 0, + 13, + 0, + "IMAGE" + ], + [ + 11, + 1, + 0, + 14, + 0, + "IMAGE" + ], + [ + 12, + 1, + 0, + 16, + 0, + "IMAGE" + ], + [ + 13, + 1, + 0, + 17, + 0, + "IMAGE" + ], + [ + 14, + 1, + 0, + 18, + 0, + "IMAGE" + ], + [ + 15, + 1, + 0, + 19, + 0, + "IMAGE" + ], + [ + 16, + 1, + 0, + 20, + 0, + "IMAGE" + ], + [ + 17, + 1, + 0, + 21, + 0, + "IMAGE" + ], + [ + 18, + 1, + 0, + 22, + 0, + "IMAGE" + ], + [ + 19, + 2, + 0, + 24, + 0, + "IMAGE" + ], + [ + 20, + 3, + 0, + 25, + 0, + "IMAGE" + ], + [ + 21, + 4, + 0, + 26, + 0, + "IMAGE" + ], + [ + 22, + 5, + 0, + 27, + 0, + "IMAGE" + ], + [ + 23, + 8, + 0, + 29, + 0, + "IMAGE" + ], + [ + 24, + 9, + 0, + 30, + 0, + "IMAGE" + ], + [ + 25, + 10, + 0, + 31, + 0, + "IMAGE" + ], + [ + 26, + 11, + 0, + 32, + 0, + "IMAGE" + ], + [ + 27, + 12, + 0, + 33, + 0, + "IMAGE" + ], + [ + 28, + 13, + 0, + 34, + 0, + "IMAGE" + ], + [ + 29, + 14, + 0, + 35, + 0, + "IMAGE" + ], + [ + 30, + 57, + 0, + 36, + 0, + "IMAGE" + ], + [ + 31, + 16, + 0, + 37, + 0, + "IMAGE" + ], + [ + 32, + 17, + 0, + 38, + 0, + "IMAGE" + ], + [ + 33, + 18, + 0, + 39, + 0, + "IMAGE" + ], + [ + 34, + 19, + 0, + 40, + 0, + "IMAGE" + ], + [ + 35, + 20, + 0, + 41, + 0, + "IMAGE" + ], + [ + 36, + 21, + 0, + 42, + 0, + "IMAGE" + ], + [ + 37, + 22, + 0, + 43, + 0, + "IMAGE" + ], + [ + 38, + 1, + 0, + 44, + 0, + "IMAGE" + ], + [ + 39, + 44, + 0, + 45, + 0, + "IMAGE" + ], + [ + 40, + 1, + 0, + 46, + 0, + "IMAGE" + ], + [ + 41, + 46, + 0, + 47, + 0, + "IMAGE" + ], + [ + 42, + 1, + 0, + 48, + 0, + "IMAGE" + ], + [ + 43, + 48, + 0, + 49, + 0, + "IMAGE" + ], + [ + 44, + 1, + 0, + 53, + 0, + "IMAGE" + ], + [ + 45, + 53, + 0, + 54, + 0, + "IMAGE" + ], + [ + 46, + 1, + 0, + 55, + 0, + "IMAGE" + ], + [ + 47, + 55, + 0, + 56, + 0, + "IMAGE" + ], + [ + 48, + 1, + 0, + 57, + 0, + "IMAGE" + ] + ], + "groups": [], + "config": {}, + "extra": { + "ds": { + "scale": 0.35049389948139265, + "offset": { + "0": 985.8424682617188, + "1": 830.5345458984375 + } + } + }, + "version": 0.4 +} \ No newline at end of file diff --git a/nodes_controlnet_aux.py b/nodes_controlnet_aux.py index 56a1b9a4..a375dfc0 100644 --- a/nodes_controlnet_aux.py +++ b/nodes_controlnet_aux.py @@ -25,7 +25,7 @@ def __init_subclass__(cls, **kwargs): if not hasattr(cls, "model_name"): raise TypeError("Subclass must define 'model_name'") cls.API_URL = f"{BIZYAIR_SERVER_ADDRESS}{cls.model_name}" - cls.CATEGORY = f"BizyAir/{cls.CATEGORY}" + cls.CATEGORY = f"☁️BizyAir/{cls.CATEGORY}" @staticmethod def get_headers(): @@ -119,7 +119,7 @@ class SAMPreprocessor(BasePreprocessor): def INPUT_TYPES(s): return create_node_input_types() - CATEGORY = "ControlNet Preprocessors/others" + CATEGORY = "ControlNet Preprocessors/Semantic Segmentation" class BinaryPreprocessor(BasePreprocessor): @@ -467,28 +467,28 @@ def INPUT_TYPES(s): } NODE_DISPLAY_NAME_MAPPINGS = { - "BizyAirPiDiNetPreprocessor": "BizyAir PiDiNet Soft-Edge Lines", - "BizyAirColorPreprocessor": "BizyAir Color Pallete", - "BizyAirCannyEdgePreprocessor": "BizyAir Canny Edge", - "BizyAirSAMPreprocessor": "BizyAir SAM Segmentor", - "BizyAirBinaryPreprocessor": "BizyAir Binary Lines", - "BizyAirScribblePreprocessor": "BizyAir Scribble Lines", - "BizyAirM_LSDPreprocessor": "BizyAir M-LSD Lines", - "BizyAirUniFormer_SemSegPreprocessor": "BizyAir UniFormer Segmentor", - "BizyAirZoe_DepthMapPreprocessor": "BizyAir Zoe Depth Map", - "BizyAirMiDaS_NormalMapPreprocessor": "BizyAir MiDaS Normal Map", - "BizyAirMiDaS_DepthMapPreprocessor": "BizyAir MiDaS Depth Map", - "BizyAirOpenposePreprocessor": "BizyAir OpenPose Pose", - "BizyAirLineArtPreprocessor": "BizyAir Realistic Lineart", - "BizyAirLeReS_DepthMapPreprocessor": "BizyAir LeReS Depth Map (enable boost for leres++)", - "BizyAirBAE_NormalMapPreprocessor": "BizyAir BAE Normal Map", - "BizyAirOneFormer_COCO_SemSegPreprocessor": "BizyAir OneFormer COCO Segmentor", - "BizyAirOneFormer_ADE20K_SemSegPreprocessor": "BizyAir OneFormer ADE20K Segmentor", - "BizyAirHEDPreprocessor": "BizyAir HED Soft-Edge Lines", - "BizyAirFakeScribblePreprocessor": "BizyAir Fake Scribble Lines (aka scribble_hed)", - "BizyAirTilePreprocessor": "BizyAir Tile", - "BizyAirDepthAnythingV2Preprocessor": "BizyAir Depth Anything V2 - Relative", - "BizyAirMetric3D_DepthMapPreprocessor": "BizyAir Metric3D Depth Map", - "BizyAirMetric3D_NormalMapPreprocessor": "BizyAir Metric3D Normal Map", - "BizyAirDWPreprocessor": "BizyAir DWPose Estimator", + "BizyAirPiDiNetPreprocessor": "☁️BizyAir PiDiNet Soft-Edge Lines", + "BizyAirColorPreprocessor": "☁️BizyAir Color Pallete", + "BizyAirCannyEdgePreprocessor": "☁️BizyAir Canny Edge", + "BizyAirSAMPreprocessor": "☁️BizyAir SAM Segmentor", + "BizyAirBinaryPreprocessor": "☁️BizyAir Binary Lines", + "BizyAirScribblePreprocessor": "☁️BizyAir Scribble Lines", + "BizyAirM_LSDPreprocessor": "☁️BizyAir M-LSD Lines", + "BizyAirUniFormer_SemSegPreprocessor": "☁️BizyAir UniFormer Segmentor", + "BizyAirZoe_DepthMapPreprocessor": "☁️BizyAir Zoe Depth Map", + "BizyAirMiDaS_NormalMapPreprocessor": "☁️BizyAir MiDaS Normal Map", + "BizyAirMiDaS_DepthMapPreprocessor": "☁️BizyAir MiDaS Depth Map", + "BizyAirOpenposePreprocessor": "☁️BizyAir OpenPose Pose", + "BizyAirLineArtPreprocessor": "☁️BizyAir Realistic Lineart", + "BizyAirLeReS_DepthMapPreprocessor": "☁️BizyAir LeReS Depth Map (enable boost for leres++)", + "BizyAirBAE_NormalMapPreprocessor": "☁️BizyAir BAE Normal Map", + "BizyAirOneFormer_COCO_SemSegPreprocessor": "☁️BizyAir OneFormer COCO Segmentor", + "BizyAirOneFormer_ADE20K_SemSegPreprocessor": "☁️BizyAir OneFormer ADE20K Segmentor", + "BizyAirHEDPreprocessor": "☁️BizyAir HED Soft-Edge Lines", + "BizyAirFakeScribblePreprocessor": "☁️BizyAir Fake Scribble Lines (aka scribble_hed)", + "BizyAirTilePreprocessor": "☁️BizyAir Tile", + "BizyAirDepthAnythingV2Preprocessor": "☁️BizyAir Depth Anything V2 - Relative", + "BizyAirMetric3D_DepthMapPreprocessor": "☁️BizyAir Metric3D Depth Map", + "BizyAirMetric3D_NormalMapPreprocessor": "☁️BizyAir Metric3D Normal Map", + "BizyAirDWPreprocessor": "☁️BizyAir DWPose Estimator", }