Images, music and video
Make pictures, songs, speech and short videos on your Mac. In beta.
Pallm can ask the image, music and video tools on your Mac to make things for you, and shows the result right in the chat. This is in beta.
What you need
One or more of these on your Mac. Pallm finds them on their usual ports:
| Tool | Makes | Notes |
|---|---|---|
| ComfyUI | images, video | Import your own workflows (below). |
| Draw Things | images | Turn on its API server in Draw Things’ settings. Uses whichever model is open. |
| mlx-serve | images, music, speech, video | Video needs ffmpeg (brew install ffmpeg). |
| ACE-Step | music | Songs with lyrics, or instrumentals. |
They’re listed in Settings › Advanced › Generators, each with an on switch. Add generator… adds one on another Mac or an unusual port.
Two ways to make something
Ask in a chat. “Draw a lighthouse in a storm, as a woodcut.” The chat’s model writes the prompt and sends it to the right tool. You can keep talking about the result: “Make it night”, “Now a song about it”.
Pick a recipe. In the chat’s model picker, under Create, choose a recipe directly. Your message then goes to the tool as the prompt, with no chat model in between, and a strip above the message box lets you set options such as the shape.
For songs, write lyrics with [verse], [chorus] and [bridge]. Leave them out for an instrumental.
The result
Images, audio and video appear in the chat with a progress bar while they’re made. From there: Save to Photos, Use in Message, Copy Prompt, or Stop a long one. In a project, results also land on the project’s shelf.
ComfyUI workflows
In ComfyUI, export a workflow in API format. Then in Settings › Advanced › Generators, choose Import ComfyUI workflow…. Pallm reads its inputs and lets you name it and set its defaults, and warns about custom nodes it needs.
From the Terminal
pallm recipes # what can be made right now
pallm chat -recipe comfyui/flux -out ~/Desktop "a lighthouse in a storm"
pallm generators # what was found