A VQ variant of Vythia plus a 3d transformer. Needs scale... Oh well, Sora is better in every way... My ideas suck and are old.
Ideas for future expansion:
Implement diffusion-like method, ala idempotent generative nets, https://arxiv.org/abs/2311.01462. RLHF etc.
Future me: Don't be so hard on yourself.