Research and Development

【RAD JAM2025】Sony Spatial Reality Display × 3D Idol Live Video & 3D Avatar Exhibition!

Production Time: One month
Request Details: 3D avatar creation & motion creation, video production, application development
Tools Used: Blender / Photoshop / Illustrator / Unity / Rokoko / mocopi

A few years ago, we developed two avatar characters: Diva and If.
To create an animation for this year's RADJAM, we conducted several body and facial motion capture sessions this month.
It was an incredible experience to breathe life into these two characters once again.
We also took this opportunity to update their facial expressions and hair rigging.

Before Motion Adjustment

After Motion Adjustment

About Body and Facial Motion

For this body and facial animation project, we collaborated with an actor and used motion capture tools, Rokoko and mocopi, to record various motion patterns in our office.
As shown in the image on the left, we were able to significantly save time by only needing to adjust small details such as joint angles, minor calibration offsets, and fine hand movements that couldn’t be captured due to the environment.

Facial Expression

For the avatar models, we created 52 facial expression patterns using Blender's shape keys, carefully refining them to achieve natural and realistic expressions.
A key focus was ensuring that when multiple shape keys are activated simultaneously, they blend smoothly without causing inconsistencies in the character's expression.

Hair Rigging and Physics Simulation

There are two characters, and for the girl with long hair, simply moving her would cause the hair to behave like flat planes and clip through the body. To address this, I added rigging to the hair and created collision boxes shaped to fit the body model. Using physics simulation, I aimed for more realistic hair movement.

Before Hair Adjustment

After Hair Adjustment