This is cool and all but all these AI hype demos always show something extremely simple and overdone in the training data. Reminds me of those ChatGPT videos where someone writes "make me Pong in javascript" and gets surprised that it does despite the fact that it probably trained on 100,000+ Pong in Javascript scripts.
Yes, it made Breakout, very cool. Now ask it to do something new or make a game that's more complicated than a game that's been remade a million times. LLMs are very far away from making real games.
In order to get good results out of an LLM, you need to be very precise in what you want. Even if it can spit out an entire game, you will have to describe it so well, you are basically creating the entire game yourself. But instead of using a standard programming language, you are using something understood by the LLM.
Exactly haha, we were joking about this exactly thing at work when all the hype started (I’m a software engineer). We were like, “to make a whole app you’ll have to tell an AI super specifically every little behavior you want the app to do. Do you know what telling a computer very specifically what you want it to do is called? Programming.” lol
I’m excited about the potential for LLMs as coding tools (and I already use them to help with various programming related things), but I’m not worried about my job being replaced any time soon.
Make up some new game - doesn't have to be good or terribly unique, just novel enough to have negligible prior art - and see if the robot does the thing.