Rudolf Laine on The First Scattering

Re video models: the standard against which they’re very good is humans not distinguishing them from videos of the world, which is quite different from simulating the world. Also note we know from physics that the fundamental laws seem simple. But we don’t do video models by simulating physics. Inference is clearly not cheap re the world. Rather, it seems there is so much detail in the world that a data heavy heuristic capturing approach beats actually dealing with the object level detail. Re a few terabytes: that’s a lot! Genomes are tiny compared to that - O(1GB), and most of that irrelevant to the actual body - and our bodies or those of many other animals sure are very complex.