代码插件 Ynnk Voice Lipsync 1.0 适配UE5.3数字人语音口型同步插件

Unreal插件信息
插件名称: Ynnk Voice Lipsync
官网地址: https://www.unrealengine.com/marketplace/en-US/product/ynnk-voice-lipsync
版本: 1.0
解压密码:
引擎版本: UE5 
素材类型: 代码插件










This plugin uses voice recognition engine to generate lip-sync animation from SoundWave assets or PCM audio data. Animation is saved as curves in data assets and can be played in runtime together with audio. This approach allows to achieve well-looking lip-sync animation easily without subtitles.

Additional feature: recognize input from microphone (speech-to-text) in runtime.

Technical Details
Features:
subtitles aren't needed;
completely offline;
can generate lip-sync in runtime for loaded/TTS audio;
can generate Anim Sequence assets with lip-sync in curves;
lip-sync for animation curves (universal) or morph targets (when possible);
asynchronous audio recognition and building lip-sync;
(beta!) create lip-sync in runtime on PC and Android using remote server;
additional feature: recognize microphone input (Speech-to-text) in runtime (Windows only).
Code Modules:
YnnkVoiceLipsync (Runtime)
YnnkVoiceLipsyncUncooked (UncookedOnly)
Number of Blueprints: 0
Number of C++ Classes: 8
Network Replicated: No
Supported Development Platforms: Windows x64
Supported Target Build Platforms: Windows x64, Android
Documentation: [Doc]
Example Project: 5.3 | 5.2 | MetaHuman 5.1 with Enhancer Plugin
Executable Demo: [ZIP]
Enhancer Plugin: [5.1 - 5.3]


该插件使用语音识别引擎从 SoundWave 资产或 PCM 音频数据生成唇部同步动画。动画以曲线形式保存在数据资产中,可在运行时与音频一起播放。这种方法可以在没有字幕的情况下轻松实现美观的唇部同步动画。

附加功能:在运行时识别麦克风输入(语音转文字)。

技术细节
特点
无需字幕;
完全离线
可在运行时为加载/TTS 音频生成唇部同步;
可在曲线中生成带有唇部同步的动画序列资产;
为动画曲线(通用)或变形目标(可能时)提供唇部同步;
异步音频识别和建立唇部同步;
(测试版!)使用远程服务器在 PC 和 Android 上运行时创建唇部同步;
附加功能:在运行时识别麦克风输入(语音转文字)(仅限 Windows)。
代码模块:
YnnkVoiceLipsync (Runtime)
YnnkVoiceLipsyncUncooked (UncookedOnly)
蓝图数量: 0
C++ 类的数量: 8
网络复制: 无
支持的开发平台:Windows x64 Windows x64
支持的目标构建平台:Windows x64、Android Windows x64、安卓
文档 文档
示例项目: 5.3 | 5.2 | 带增强插件的 MetaHuman 5.1
可执行演示: [ZIP]
增强插件 [5.1 - 5.3]





作者 cg小白兔 发表于 2024-9-19 14:07:56
您需要登录后才可以回帖 登录 | 立即注册
cg小白兔

关注0

粉丝0

发布7795

热门作品推荐
glow
Matrix Rain of Symbols - VFX 适配UE5.0+
glow
Post Process Shader - Scan Effect 适配UE
glow
Post Process Shader - World Effect 适配U
glow
Inventory System 适配UE5.0,5.1
glow
Restaurant Kitchen Props v.01 适配UE4.26
glow
Dungeon Catacomb Modular 适配UE5.1+中世
glow
【更新】Analogical Flight Instruments -
glow
【更新】Multi-Input First Person Control
glow
【更新】Realistic Waterfall Prefab 1.5写
glow
【更新】VR FPS Kit [Multiplayer Addon] 9