Taming ComfyUI Custom Nodes Version Hell

Version management is painful with ComfyUI. It is an open source project with lots of different people contributing different custom nodes and models you can add to your installation, which is both fantastic (so much is out there!) and painful because as people make changes they are not always backwards compatible. This means when someone … More Taming ComfyUI Custom Nodes Version Hell

Can AI ‘Save the Cat’? Exploring Predictability in Scriptwriting

Can AI write formulaic screenplays as well as humans? There are many formulaic structures around: Save the Cat, the Three Act structure, and the heroic journey, to name just a few. These predefined templates have a recommended structure to follow based on previous experience of what has worked well. As a result, the structures are … More Can AI ‘Save the Cat’? Exploring Predictability in Scriptwriting

OpenUSD Floor Design using Adobe Illustrator and NVIDIA Omniverse

SyncTwin.ai has a cool feature where you can take a PowerPoint visual and an Excel spreadsheet to assemble a factory scene in OpenUSD. Very nice! I was wondering how to create something similar using Adobe Illustrator. I thought Illustrator might make it easier to do larger floor plans without worrying about the size of a … More OpenUSD Floor Design using Adobe Illustrator and NVIDIA Omniverse

Designing Enterprise Applications leveraging OpenUSD

Omniverse have announced Omniverse Cloud, “a fully managed platform-as-a-service offering for developing generative AI-enabled OpenUSD applications.” While full details are yet to be published, browsing the Omniverse documentation, they describe how to build microservices using Omniverse Kit (their application building framework) with support for cross service API calls and a message bus. Omniverse Enterprise is … More Designing Enterprise Applications leveraging OpenUSD

AI Agents, Animation, and Minecraft

I have been exploring using Generative AI (LLMs specifically) to assist with going from a screenplay to an animated video, learning about relevant technologies along the way. (No, I have not got that far, but it’s fun trying and learning!) For example, at the recent GTC 2024 there were some interesting sessions on Robotics from Google and Disney. It reminded me of an older paper on Voyager – getting AI to play Minecraft. The GTC videos are just being published now, so I also just got to view Jim Fan’s presentation on “Generally Capable Agents in Open-Ended Worlds”, which also mentioned Voyager. This blog summarizes the highlights from this work that interest me. … More AI Agents, Animation, and Minecraft