wanx-troopers

LLM Nodes

Various nodes interacting with or running LLM models are used by AI artists to enhance prompts during image and video generation. This page collections information on some of them.

btw, I fired Josie as my prompt editor, and hired Mistral 7b Q4 running on ComfyUI_Searge_LLM

Apparently unlike LMStudio, VLLM can do parallel queries.

Notes On LLM Models