Generative AI can be great for background images in animated videos. Want a single shot walking along a path? Creating a background image can take some time to assemble, so generative AI for creating 2D images with Stable Diffusion, Midjourney, DALL-E, etc. can be a real time saver. The following image was created using the … More Generative AI for 3D Scene Backgrounds
I am working on a project where I want to manipulate Skeletal Animation clips (for 3D computer animation) in JavaScript, then export to USD. Depressingly it’s not that hard. Why depressingly? Because I spent a LONG time working out what turns out to be pretty simple code. Luckily I am not BITTER about that at … More Retargeting Skeletal Animation to USD
I have been exploring NVIDIA Omniverse and the standard it is built on, OpenUSD (aka USD). It provides a number of ways to animate objects in a 3D scene. My personal interest in animation is I am trying to build a tool to simplify assembling your own animated video where the final result is exported … More Options for representing Animation in OpenUSD
I am trying to work out how to do various cinematic effects in Omniverse. This post is one step on that journey, particularly for “God Rays” (sunbeams) through the clouds. Here is an extreme example (generated by DALL-E) of the sort of effect I am after. The challenge I have had is to get the … More Sunbeams via Fog in Omniverse
At SIGGRAPH 2023, Jensen Huang (founder and CEO of NVIDIA) described Omniverse as more of a connector of tools, rather than the only tool you need. For example, over 50 tools now have direct OpenUSD support. I like this model, but is it reality today? TL;DR: Almost – I think one more step is required. … More Making the Omniverse Hub Vision Reality
SIGGRAPH 2023 kicked off this week and the keynote was from Jensen Huang, NVIDIA founder and CEO. I have been using NVIDIA Omniverse, so I was curious to see what news would be dropped. The following is a mix of summary of the presentation (not necessarily in the same order presented) and personal opinions and … More NVIDIA Omniverse and the SIGGRAPH 2023 Keynote
I created a scene using NVIDIA Omniverse standard assets. No movement in the trees or grass. Ideally want some wind to give the feeling of movement. Here is the final video. This is for the current Omniverse #StartToFinish community challenge. My process I wanted to animate models (trees, grass, bushes, etc) to get a bit … More Omniverse Start to Finish – Wind Animation
I am trying to identify a good solution for dangling hair bounces and cloth (e.g., a skirt) in NVIDIA Omniverse for characters/avatars. The recently released Omniverse USD Composer (Kit 105) now uses “Omnijoint” intead of “SkelJoint” for skeleton bones in characters. These are real prims, so you can add children prims and they will track … More Omniverse 105 (beta) Colliders for Particle Mesh Hair and Clothes
In NVIDIA Omniverse (and OpenUSD in general), animation clips are tied to a specific set of skeletal bone names. This is fine if you create your own animation clips per character, but there are many libraries/stores of animation clips available, and they use different bone names in the animation clips. Example Stores Actor Core store … More Animation Retargeting in Omniverse
NVIDIA Omniverse includes Audio2Face, an AI powered audio clip to facial animation tool. Give it a voice track, and it can animate the face of a character. It even has emotional expression support. Very nice! But how to use this tool as part of a pipeline to create a Pixar-like animated movie? In this blog … More Using Omniverse Audio2Face in Animated Film Production
Extra Ordinary, the Series 