Ynnk Voice Lipsync 1.0 适配UE5.3数字人语音口型同步插件
This plugin uses voice recognition engine to generate lip-sync animation from SoundWave assets or PCM audio data. Animation is saved as curves in data assets and can be played in runtime together with audio. This approach allows to achieve well-looking lip-sync animation easily without subtitles.
Additional feature: recognize input from microphone (speech-to-text) in runtime.
Technical Details
Features:
subtitles aren't needed;
completely offline;
can generate lip-sync in runtime for loaded/TTS audio;
can generate Anim Sequence assets with lip-sync in curves;
lip-sync for animation curves (universal) or morph targets (when possible);
asynchronous audio recognition and building lip-sync;
(beta!) create lip-sync in runtime on PC and Android using remote server;
additional feature: recognize microphone input (Speech-to-text) in runtime (Windows only).
Code Modules:
YnnkVoiceLipsync (Runtime)
YnnkVoiceLipsyncUncooked (UncookedOnly)
Number of Blueprints: 0
Number of C++ Classes: 8
Network Replicated: No
Supported Development Platforms: Windows x64
Supported Target Build Platforms: Windows x64, Android
Documentation:
Example Project: 5.3 | 5.2 | MetaHuman 5.1 with Enhancer Plugin
Executable Demo:
Enhancer Plugin:
该插件使用语音识别引擎从 SoundWave 资产或 PCM 音频数据生成唇部同步动画。动画以曲线形式保存在数据资产中，可在运行时与音频一起播放。这种方法可以在没有字幕的情况下轻松实现美观的唇部同步动画。
附加功能：在运行时识别麦克风输入（语音转文字）。
技术细节
特点
无需字幕；
完全离线
可在运行时为加载/TTS 音频生成唇部同步；
可在曲线中生成带有唇部同步的动画序列资产；
为动画曲线（通用）或变形目标（可能时）提供唇部同步；
异步音频识别和建立唇部同步；
(测试版！）使用远程服务器在 PC 和 Android 上运行时创建唇部同步；
附加功能：在运行时识别麦克风输入（语音转文字）（仅限 Windows）。
代码模块：
YnnkVoiceLipsync (Runtime)
YnnkVoiceLipsyncUncooked (UncookedOnly)
蓝图数量： 0
C++ 类的数量: 8
网络复制： 无
支持的开发平台：Windows x64 Windows x64
支持的目标构建平台：Windows x64、Android Windows x64、安卓
文档 文档
示例项目： 5.3 | 5.2 | 带增强插件的 MetaHuman 5.1
可执行演示： [ZIP］
增强插件
页:
[1]