I am working on a web based 3D animation project where you can create an animated video using 3D character models, like a cut scene in a video game. Facial expressions in 3D are frequently animated using “blend shapes” (aka “morphs”, “shape keys”, or “facial landmarks”). Google MediaPipe can be used to live capture a … More Getting Google MediaPipe to control VRM Characters
Generative AI can be great for background images in animated videos. Want a single shot walking along a path? Creating a background image can take some time to assemble, so generative AI for creating 2D images with Stable Diffusion, Midjourney, DALL-E, etc. can be a real time saver. The following image was created using the … More Generative AI for 3D Scene Backgrounds
I am working on a project where I want to manipulate Skeletal Animation clips (for 3D computer animation) in JavaScript, then export to USD. Depressingly it’s not that hard. Why depressingly? Because I spent a LONG time working out what turns out to be pretty simple code. Luckily I am not BITTER about that at … More Retargeting Skeletal Animation to USD
Generative text to image AI is pretty amazing. If you can write, you can create an image. Generative AI for video is also making great progress. But AI is also being used in more traditional animation flows, such as creating an animation clip for a character, or for creating a 3D model to put in … More AI and Animation – the path ahead
TL;DR: In this post I explore the pros and cons of using OpenUSD directly in web applications. What is OpenUSD? “Developed by Pixar, Universal Scene Description (USD) is the first open-source software that can robustly and scalably interchange 3D scenes that may be composed of many different assets, sources, and animations, while fostering highly collaborative … More OpenUSD on the Web – October ’23 Musings
I have been exploring NVIDIA Omniverse and the standard it is built on, OpenUSD (aka USD). It provides a number of ways to animate objects in a 3D scene. My personal interest in animation is I am trying to build a tool to simplify assembling your own animated video where the final result is exported … More Options for representing Animation in OpenUSD
I am trying to work out how to do various cinematic effects in Omniverse. This post is one step on that journey, particularly for “God Rays” (sunbeams) through the clouds. Here is an extreme example (generated by DALL-E) of the sort of effect I am after. The challenge I have had is to get the … More Sunbeams via Fog in Omniverse
At SIGGRAPH 2023, Jensen Huang (founder and CEO of NVIDIA) described Omniverse as more of a connector of tools, rather than the only tool you need. For example, over 50 tools now have direct OpenUSD support. I like this model, but is it reality today? TL;DR: Almost – I think one more step is required. … More Making the Omniverse Hub Vision Reality
SIGGRAPH 2023 kicked off this week and the keynote was from Jensen Huang, NVIDIA founder and CEO. I have been using NVIDIA Omniverse, so I was curious to see what news would be dropped. The following is a mix of summary of the presentation (not necessarily in the same order presented) and personal opinions and … More NVIDIA Omniverse and the SIGGRAPH 2023 Keynote
I created a scene using NVIDIA Omniverse standard assets. No movement in the trees or grass. Ideally want some wind to give the feeling of movement. Here is the final video. This is for the current Omniverse #StartToFinish community challenge. My process I wanted to animate models (trees, grass, bushes, etc) to get a bit … More Omniverse Start to Finish – Wind Animation
Extra Ordinary, the Series 