Some suggestions

[FangSen9000]

In fact, if the package or repository to be cloned is placed in the local extensions folder, you can use the installation command in the regular requirements file to install it. This will make the environment more clean, eg:

And, @francisengelmann

Is there a way to voxelize the entire world and then create a world VAE that can reconstruct a self-recursive point cloud (with infinite resolution) from the voxels? (Or, more fundamentally, voxels are essentially something that encodes shapes (corresponding to SQ), even if we don't reduce the number of voxels, it might still be possible. Then each voxel corresponds to the color of one or n point clouds, where n is the compression rate) In this way, perhaps we can create a native editing system for the point cloud world.

TRELLIS is just 3D assets. However, if we can upgrade TRELLIS and link the voxels with the 3D scene point clouds. Transform the reconstruction of 3D asset editing into the reconstruction of 3D world point clouds, perhaps this approach can complete the last puzzle of AIGC (I'm currently occupied with other similar but distinct projects. I won't be able to try this out within the next two months.)

[yonhdee]

is it possible to generate(maybe batch convert pointcloud into) the superquadrics npz file this project use, and send the file into spacecontrol pipeline to do the work reconstruction?

[FangSen9000]

is it possible to generate(maybe batch convert pointcloud into) the superquadrics npz file this project use, and send the file into spacecontrol pipeline to do the work reconstruction?

@yonhdee SpaceControl mainly adjusts and controls the potential representation of the scene through voxels. If TRELLIS supports unbounded point clouds, it theoretically works. We can cut a certain scene of the world or the space. To save computing power, point clouds should preferably be in some kind of autoregressive form. I heard that version 2 of TRELLIS has been released. Then we can combine it with an RF video + Depth generation model to achieve generating and editing a 4D world. This is the idea I mentioned above. Maybe I can try it when I have time. Or someone else can implement this, it should also be very good.

[dacy0803]

when I replicate this project, I find this problem: z_s after sample become NAN, I wanna know this reason, and how to fix it