OpenUSD Floor Design using Adobe Illustrator and NVIDIA Omniverse

SyncTwin.ai has a cool feature where you can take a PowerPoint visual and an Excel spreadsheet to assemble a factory scene in OpenUSD. Very nice! I was wondering how to create something similar using Adobe Illustrator. I thought Illustrator might make it easier to do larger floor plans without worrying about the size of a … More OpenUSD Floor Design using Adobe Illustrator and NVIDIA Omniverse

Designing Enterprise Applications leveraging OpenUSD

Omniverse have announced Omniverse Cloud, “a fully managed platform-as-a-service offering for developing generative AI-enabled OpenUSD applications.” While full details are yet to be published, browsing the Omniverse documentation, they describe how to build microservices using Omniverse Kit (their application building framework) with support for cross service API calls and a message bus. Omniverse Enterprise is … More Designing Enterprise Applications leveraging OpenUSD

AI Agents, Animation, and Minecraft

I have been exploring using Generative AI (LLMs specifically) to assist with going from a screenplay to an animated video, learning about relevant technologies along the way. (No, I have not got that far, but it’s fun trying and learning!) For example, at the recent GTC 2024 there were some interesting sessions on Robotics from Google and Disney. It reminded me of an older paper on Voyager – getting AI to play Minecraft. The GTC videos are just being published now, so I also just got to view Jim Fan’s presentation on “Generally Capable Agents in Open-Ended Worlds”, which also mentioned Voyager. This blog summarizes the highlights from this work that interest me. … More AI Agents, Animation, and Minecraft

Accessing the Omniverse Message Bus from Python

In this blog post I explore sending and receiving message bus events using the NVIDIA Omniverse framework in Python. I create two extensions: one to publish messages, and another to receive them. In an Omniverse Cloud project, the message bus will span microservices (using Redis I think read somewhere). In this blog, I use it … More Accessing the Omniverse Message Bus from Python

3D Product Rendering in Web Pages with Omniverse Cloud

Interested in high quality 3D product configurators for your ecommerce site? The Omniverse team livestream today recapped the recent GTC conference, and over half the video was talking about product configurators including web delivery! What is Omniverse? Sometimes it’s hard to keep up with everything that is happening with just Omniverse, let alone the rest … More 3D Product Rendering in Web Pages with Omniverse Cloud

Audio2Face + Audio2Gesture – Merging the Streams with OpenUSD

NVIDIA Omniverse includes a number of AI based tools, including Audio2Face and Audio2Gesture. Audio2Face takes an audio file and generates facial blend shape animations. Audio2Gesture can take the same audio file and instead generate upper or full body animation clips. But it’s not easy at first blush to combine the two results. In this blog … More Audio2Face + Audio2Gesture – Merging the Streams with OpenUSD