Use real-world captures as photo-realistic 3D environments
3D Gaussian Splatting is a technique for reconstructing scenes from multiple photos, whose accuracy is equivalent or better than NeRF, and whose rendering load is lower than NeRF.
Anyone can create 3D Gaussian Splatting data by using the official implementation.
This plugin is a importer and a renderer of the training results of 3D Gaussian Splatting.
Just a few clicks on the UE editor to import.
Real-time rendering at about 30-100 FPS with RTX3070, depending on the data
Fully implemented in Niagara and Material, without relying on Python, CUDA, or custom HLSL node
Demo project is available for free.
System Requirement
GPU which supports DirectX 12 is required.
Limitations
This plugin renders 3D Gaussian Splatting data using Niagara particles. Because there is a limit to the number of particles in a Niagara system, this plugin imports 3D Gaussian Splatting data into multiple blocks. The seams between the blocks can be seen if one looks carefully.
Lighting support is EXPERIMENTAL. You can use Lit/Translucent material for rendering of 3D Gaussian Splatting data, but problems occurs under certain conditions. See the details.
Lumen is not supported. You can receive the light from Lumen Global Illumination, but the brightness may be unstable over time. Also, it cannot emit GI light.
Shadow is not supported.
Ray Traced Translucency is not supported.
3D Gaussian Splatting data are rendered by translucent material. When used with other transparent objects, problems can occur when deciding which objects to render in front of or behind other transparent objects; if multiple 3D Gaussian Splatting actors are placed, they will not intersect with each other correctly.
Technical Details
Features:
Import training results of the official implementation of 3D Gaussian Splatting
Render the imported results in Unreal Engine
Code Modules:
ThreeDGaussians (Runtime)
ThreeDGaussiansImporter (Editor)
Number of Blueprints: 1
Number of C++ Classes: 1+
Number of Materials: 1+
Network Replicated: No
Supported Development Platforms: Windows 64bit
Supported Target Build Platforms: Windows 64bit
Documentation: Link
Example Project: Link, GitHub
Important/Additional Notes: GPU which supports DirectX 12 is required
使用真实世界的捕捉作为照片般逼真的3D环境
3D高斯散点是一种从多张照片重建场景的技术,其精度与NeRF相当或更好,渲染负载低于NeRF。
任何人都可以使用官方实现创建3D高斯散斑数据。
此插件是3D高斯散斑训练结果的导入器和渲染器。
只需在UE编辑器上点击几下即可导入。
RTX3070的实时渲染速度约为30-100FPS,具体取决于数据
完全在Niagara和Material中实现,无需依赖Python、CUDA或自定义HLSL节点
演示项目是免费的。
系统要求
需要支持DirectX 12的GPU。
局限性
此插件使用Niagara粒子渲染3D高斯飞溅数据。由于Niagara系统中的粒子数量有限,因此此插件将3D高斯散斑数据导入到多个块中。如果仔细看,可以看到砌块之间的接缝。
照明支持是实验性的。您可以使用“亮/半透明”材质来渲染3D高斯散斑数据,但在某些情况下会出现问题。查看详细信息。
不支持Lumen。您可以从流明全局照明接收光线,但随着时间的推移,亮度可能会不稳定。此外,它不能发出GI光。
影子不受支持。
不支持光线追踪半透明。
3D高斯散斑数据由半透明材质渲染。当与其他透明对象一起使用时,在决定在其他透明对象的前面或后面渲染哪些对象时可能会出现问题;如果放置多个3D高斯散斑演员,它们将不会正确相交。
技术细节
特征:
导入3D高斯喷涂正式实施的培训结果
在虚幻引擎中渲染导入的结果
代码模块:
三高斯(运行时)
三高斯导入器(编辑)
蓝图数量:1
C++类数量:1+
材料数量:1+
网络已复制:否
支持的开发平台:Windows 64位
支持的目标构建平台:Windows 64位
文档:链接
示例项目:链接,GitHub
重要/附加说明:需要支持DirectX 12的GPU
|