Really interesting. Upshot: a well trained multimodal video generation model has a world representation model trained inside it. Theyâve done some work lifting this world model out and deploying it to robots, where it seems to work well.
On the one hand, this isnât a new idea, and the quality video models certainly have understanding of materials, light, the world (at least in an Occamâs razor sense of understanding). Iâm not aware of a video lab thatâs turned itself into a robot lab yet, though; perhaps this would be a first, or a new sort of obvious-in-retrospect business path: train video model, sell video generation, scale, use scale to train robot things: profit.
I found their hands very interesting - looks like a bunch of stuff hidden in gloves - Xiamiâs Robotics-1 foundation model just released videos of users training on some pretty standard looking grippers; to the point that there are demo videos of people putting on gripper type gloves to make video to train that model.
The BFL model looks like it doesnât need that at all. Given the difficulty of the hardware side, Iâll be curious to see what they do with this.
I think this tactic is standard, no? Nvidia has demoed robots being trained using video generation models, and Waymo has been doing that for a while too.
The video at around 3.30min, where the robot arm took 3 attempts to reseat the window trim, was quite unnerving - I have not seen such resolving before. Is it new or am I way out of the loop?
You are indeed out of the loop. Google did something arguably more impressive more than a year ago, with a VLA based bot replacing a tensioned timing belt: https://www.youtube.com/watch?v=2AAFiuEP7iE
if you want to catch up, i would say Generalist is the state of the art in dexterous manipulation tasks, you can learn more here https://generalistai.com/blog/gen-1
What's sad to me is that we have all this awesome technology, but movies are worse than ever.
I usually watch movies from decades ago just to find something decent and it's amazing how with goofy-looking puppets the storytelling was 1000 times better.
I regularly stream movies from Screambox, FilmRise and Alter as background music while I work from home. I love cheesy horror, but they're just bad enough to keep me company without distracting me
OP replied but Iâm chipping in too, Iâve also been watching a lot of older movies specifically the more B list and C list which werenât successful cult classics and theyâre still better than anything new. The low production and low talent C list ones are still cheesy and the performances donât land anywhere near as well as they could but they feel more genuine and creative than what passes for a movie these days.
would you refuse to invest in BFL because Robin Rombach doesn't know anything about making movies?
sora is done. can you find me one person brave enough to say, "Bill Peebles, a nice guy, doesn't know anything about making movies?" this isn't just a VC problem, this is why it is called the Hollywood No, but that said: maybe the hollywood no is the problem? in video games it has been called Toxic Positivity. are you getting it now?
> However, compared to more specialized approaches for representation learning they produce less disentangled representations, which puts a ceiling on their usefulness for tasks that require world understanding.
Only an LLM would use a less disentangled representation of the concept âmore entangledâ when trying to explain to people in the real world why less disentangled representations are not as useful for modeling the real world.
Weâre just pulling signs of LLM touched writing out of our ass now. Might be time to move on from the accusations, assume all writing is at least LLM assisted and judge it purely on the quality.
Bad news, humans write silly things all the time. If anything, LLMs are less likely to make awkward phrasings than people, because they arenât found in the training data very often.
Perhaps.. Mistral seems to be focussing more on LLM application rather than foundation models. Seeing that the latter may be becoming commodities, Mistral may come out ahead.
BFL resides in the same region as BMW and Audi. Quite wealthy and pretty fierce to protect their car industry. If Audi or any other german car maker sees BFL as the future of automation, it will be rather hard to buy them out.
Really interesting. Upshot: a well trained multimodal video generation model has a world representation model trained inside it. Theyâve done some work lifting this world model out and deploying it to robots, where it seems to work well.
On the one hand, this isnât a new idea, and the quality video models certainly have understanding of materials, light, the world (at least in an Occamâs razor sense of understanding). Iâm not aware of a video lab thatâs turned itself into a robot lab yet, though; perhaps this would be a first, or a new sort of obvious-in-retrospect business path: train video model, sell video generation, scale, use scale to train robot things: profit.
I found their hands very interesting - looks like a bunch of stuff hidden in gloves - Xiamiâs Robotics-1 foundation model just released videos of users training on some pretty standard looking grippers; to the point that there are demo videos of people putting on gripper type gloves to make video to train that model.
The BFL model looks like it doesnât need that at all. Given the difficulty of the hardware side, Iâll be curious to see what they do with this.
I think this tactic is standard, no? Nvidia has demoed robots being trained using video generation models, and Waymo has been doing that for a while too.
https://waymo.com/blog/2026/02/the-waymo-world-model-a-new-f...
FYI several other video labs are getting into robotics
Luma Labs https://lumalabs.ai/news/luma-open-physical-ai-lab
Runway https://runway.com/product/robotics
The video at around 3.30min, where the robot arm took 3 attempts to reseat the window trim, was quite unnerving - I have not seen such resolving before. Is it new or am I way out of the loop?
You are indeed out of the loop. Google did something arguably more impressive more than a year ago, with a VLA based bot replacing a tensioned timing belt: https://www.youtube.com/watch?v=2AAFiuEP7iE
if you want to catch up, i would say Generalist is the state of the art in dexterous manipulation tasks, you can learn more here https://generalistai.com/blog/gen-1
Yes that was impressive.
This is awesome.
What's sad to me is that we have all this awesome technology, but movies are worse than ever.
I usually watch movies from decades ago just to find something decent and it's amazing how with goofy-looking puppets the storytelling was 1000 times better.
This is probably an unrelated rant, sorry
Survivorship bias, possible that you just arenât watching all the shitty ones that nobody remembers.
That's exactly the ones I like! On Saturdays I watch cheesy horror movies from the 80s.
But with my GF I watch whatever is rated >= 8 on Imdb and the 8s from years ago are ALWAYS much, much better than the recent ones.
Maybe I just don't like the style. All the over explaining, etc.
I regularly stream movies from Screambox, FilmRise and Alter as background music while I work from home. I love cheesy horror, but they're just bad enough to keep me company without distracting me
I think most movies drop a bit in IMDb score over their first few years. That might (partly) explain it. Or you just prefer older movies . :-)
Interesting! I didn't know that. Could be both, too :-)
OP replied but Iâm chipping in too, Iâve also been watching a lot of older movies specifically the more B list and C list which werenât successful cult classics and theyâre still better than anything new. The low production and low talent C list ones are still cheesy and the performances donât land anywhere near as well as they could but they feel more genuine and creative than what passes for a movie these days.
time is the great filter
What's a good recent movie I could watch? Today is Friday
Odyssey is supposed to be pretty good. Main complaint I've seen is that it's not as horny as the source material.
Thank you! I'll take a look
Was going to pull out my default recommendation of Oldboy but then I realized itâs 23 years old, which just aged me greatly
No Other Choice (by the same director) is incredible, and even relevant to this post.
Welcome to the club! :-)
The sheep detectives is pretty good
https://www.imdb.com/title/tt32565993/
Thanks! I'll take a look
Do you like horror? That's the only genre where risky projects are getting consistent funding. Obsession and Backrooms are both really good.
would you refuse to invest in BFL because Robin Rombach doesn't know anything about making movies?
sora is done. can you find me one person brave enough to say, "Bill Peebles, a nice guy, doesn't know anything about making movies?" this isn't just a VC problem, this is why it is called the Hollywood No, but that said: maybe the hollywood no is the problem? in video games it has been called Toxic Positivity. are you getting it now?
Ok the phrasing here, itâs, itâs just -
> However, compared to more specialized approaches for representation learning they produce less disentangled representations, which puts a ceiling on their usefulness for tasks that require world understanding.
Only an LLM would use a less disentangled representation of the concept âmore entangledâ when trying to explain to people in the real world why less disentangled representations are not as useful for modeling the real world.
Weâre just pulling signs of LLM touched writing out of our ass now. Might be time to move on from the accusations, assume all writing is at least LLM assisted and judge it purely on the quality.
Yeah, as if people haven't used words like "irregardless" way before LLM's already
After all, the LLM's learned it from somewhere
I really hope this is how we are going to adapt to LLM era.
Bad news, humans write silly things all the time. If anything, LLMs are less likely to make awkward phrasings than people, because they arenât found in the training data very often.
goddamn people itâs a joke
> Ok the phrasing here, itâs, itâs just -
That dash definitely means an LLM wrote this comment. /s
Nah, that was an n-dash, which is widely respected as humans-only.
It's nice to see partnerships between European startups.
Wasnât Flux purchased by Meta?
No. Just a partnership: https://www.bloomberg.com/news/articles/2025-09-09/meta-to-p...
this is the future. but also the present.
if you know some one out of the software development/engineering worlds, please forward this to them
OpenAi cries in sora
Amazing work.
u.i. ZuglĂł robot mikor?
We're barreling head-on into a crisis where humans have even less value unless they own the means of production. Dark days ahead, friends.
If Amazon does not buy them, the CEO should be fired...
Are you American? We would prefer it to stay a European company. I personally hope Mistral buys them or somehow they unite to make a stand.
Mistral is much worse in its respective field than Flux in their own so I hope not.
Perhaps.. Mistral seems to be focussing more on LLM application rather than foundation models. Seeing that the latter may be becoming commodities, Mistral may come out ahead.
BFL resides in the same region as BMW and Audi. Quite wealthy and pretty fierce to protect their car industry. If Audi or any other german car maker sees BFL as the future of automation, it will be rather hard to buy them out.
I think you meant to type "promoted".