Animatronic head drives realistic lip sync in three languages

Oct 31, 2026 Last reply: 2 days ago 4 Replies
Jump to replies (4)

When the demo runs, Éloi speaks in three different languages while the lips and jaw keep pace with the audio, and the mouth shapes read as a promising match for natural human articulation. That is the heart of the project: the system is built to copy the way a person's mouth moves while talking, and the 17 degrees of freedom spread across the lips and jaw are what allow each sound to get its own shape. English words such as 'Achieve,' 'Core,' and 'Miracle' come out with distinct articulation, and Korean and Japanese lines get the same treatment, since the speech synthesis is designed to work across multiple languages.



Construction-wise, the head mixes hard structure with soft surfaces. A perforated metallic cranial plate sits above articulated purple eyeball assemblies fitted with mechanical eyelids and eyebrows, while the lower face and mouth are covered in flexible light purple skin. The whole head rides on a multi-axis motorized neck mechanism that includes internal wiring and metal linkage rods.



What stands out to me is how the flexible mouth area and the rigid plate above it are treated as one expressive system rather than two separate parts. The open question is also worth respecting: the maker plans to show the robot's expressive flexibility next and wonders whether a non-human character can still offer meaningful interaction. That seems like the right thing to be unsure about at this stage.


Curious about the mechanics behind the mouth. Does anyone know how many independent moving points are actually driving the lips and jaw, and whether that count is separate from whatever the neck mechanism uses?

I think building the lip-sync system to work across languages from the start is the cleverest choice here. A mouth rig tuned only for English would likely fall apart on Korean or Japanese, where the shaping differs. The trade-off is that every added language means more testing, but getting convincing results in all three already says a lot about the 17 degrees of freedom.

A variation I would love to see: adding tongue and airflow control to the mouth. Real speech gets voiced by air pushed through shaped lips plus a moving tongue, so pairing that with the existing lip and jaw rig could push the synchronization accuracy even further than it already is.

On the mouth mechanics: the build has 17 degrees of freedom across the lips and jaw. How those are divided among individual actuators has not been said, and the neck is only described as multi-axis and motorized, with no axis count broken out either.

Join the Discussion

Have something to add? Share your thoughts — no account required.

Didn't find your answer?

Ask the community — no account required