AnimaLLLite Controlnet and Inpaint Implementation

[Sen-sou]

Implemented controlnet and inpaint support (Anima-lllite inpaint) for Anima model.

Download
controlnet model: https://huggingface.co/kohya-ss/Anima-LLLite/resolve/main/anima-lllite-any-test-like-v2.safetensors?download=true
and
inpaint model: https://huggingface.co/kohya-ss/Anima-LLLite/resolve/main/anima-lllite-inpainting-v2.safetensors?download=true

Both models in the controlnet folder
Requires https://github.com/kohya-ss/ComfyUI-Anima-LLLite node to be installed in comfyui to work.

(Codex helped with the code)

[Acly]

I'd like to add support, and the PR looks mostly fine (apart from listing some models that don't exist).

But only supporting it for external ComfyUI users who've set up the custom nodes will just cause a lot of confusion, for many users it won't work. There are two ways to resolve:

1. Install the original custom node by kohya with the managed installer
2. Pull the custom node code into comfyui-tooling-nodes (which is already installed)

I prefer (2) since it makes it easier for me to maintain, and fewer things to install for custom ComfyUI setups. Can also improve the node a bit by caching the weights, since in Krita workflows it may be applied many times (especially tiled upscale). I'll probably have time to do that over the weekend.

[Sen-sou]

Sounds good. And yeah currently only "HED scribble, PiDiNet scribble, Grayscale A, Grayscale B, and lineart" are supported by the 'anima-lllite-any-test-like-v2' model which is trained on anima v1.
If people in case want to use anima prev3 models "lineart / depth / pose / fake scribble" should be kept, and the rest can be removed.

[AutisticEevee]

The 'anima-lllite-any-test-like-v2' model could be used in place of a tile ControlNet for refining small details and tiled upscaling.

[Acly]

Added the nodes in Acly/comfyui-tooling-nodes@ffa1302

Node ids are ETN_ControlLoad and ETN_ControlApply. I split them so weights are cached.

[Sen-sou]

I've addressed the required changes in the new commit.
@Acly pleases check

[Acly]

Hm did you mean to remove pose/depth?
And there are no actual weights for blur control mode, I just wanted to keep it in the universal list, so anytest can substitute for the blur mode.

[Sen-sou]

Pose didnt really work with the final Anima model, and depth worked somewhat, If people want to use it with the prev3 version of Anima, so added them back in the new commit. @Acly

[dukefishroom2-droid]

I just tried this, it works like a charm, it's beautiful. Both ControlNet and Inpaint work flawlessly in Krita.

[Acly]

Tried the depth with V1 anima and yes it doesn't really work. There's a chance it will be trained in the future I guess.

The tiled upscale worked quite well, any-test helps in most cases. Allows to go to 4k+ with Anima without those nasty grid artifacts. It completely screwed the eyes of the characters though, have to redo those afterwards. But really nice control models overall (and so lightweight).

Thanks for the PR!