Friday, November 1st 2024

Etched Introduces AI-Powered Games Without GPUs, Displays Minecraft Replica

The gaming industry is about to get massively disrupted. Instead of using game engines to power games, we are now witnessing an entirely new and crazy concept. A startup specializing in designing ASICs specifically for Transformer architecture, the foundation behind generative AI models like GPT/Claude/Stable Diffusion, has showcased a demo in partnership with Decart of a Minecraft clone being entirely generated and operated by AI instead of the traditional game engine. While we use AI to create images and videos based on specific descriptions and output pretty realistic content, having an AI model spit out an entire playable game is something different. Oasis is the first playable, real-time, real-time, open-world AI model that takes users' input and generates real-time gameplay, including physics, game rules, and graphics.

An interesting thing to point out is the hardware that powers this setup. Using a single NVIDIA H100 GPU, this 500-million parameter Oasis model can run at 720p resolution at 20 generated frames per second. Due to limitations of accelerators like NVIDIA's H100/B200, gameplay at 4K is almost impossible. However, Etched has its own accelerator called Sohu, which is specialized in accelerating transformer architectures. Eight NVIDIA H100 GPUs can power five Oasis models to five users, while the eight Sohu cards are capable of serving 65 Oasis runs to 65 users. This is more than a 10x increase in inference capability compared to NVIDIA's hardware on a single-use case alone. The accelerator is designed to run much larger models like future 100 billion-parameter generative AI video game models that can output 4K 30 FPS, all thanks to 144 GB of HBM3E memory, yielding 1,152 GB in eight-accelerator server configuration.
Regarding the Oasis design (shown below), it is vastly different than something like OpenAI Sora. While most current AI video generators create pre-rendered segments, a newly developed system enables real-time interaction by processing each frame individually. At its core, the technology leverages advanced machine learning architectures, including specialized neural networks and attention mechanisms that process spatial and temporal data simultaneously. This approach allows the AI to maintain consistency while responding to user input in real-time, demonstrating an understanding of physics that enables natural object manipulation and construction within virtual spaces. The research team implemented several technical enhancements to ensure smooth performance, such as adaptive noise processing and specialized computational optimizations. Looking ahead, developers plan to expand the system's capabilities to handle longer sequences and more complex simulations, allowing for much smoother gameplay, just in time for 4K model. Oasis is available for users to try here with a queue system (as AI nerds play games, too).
Source: Etched
Add your own comment

34 Comments on Etched Introduces AI-Powered Games Without GPUs, Displays Minecraft Replica

#26
ZoneDymo
Its cool as a concept but it does not even work, apart from looking just like a vague mess, it does not hold the data of what you were looking at when you turn around, so the world changes every time you just look around.....
Posted on Reply
#27
Shihab
AleksandarKan AI model spit out an entire playable game
You know what we call something that spits out an entire playable game given some specifications?
A game engine. We call it a game engine...

(Slightly-obscure plagiarism aside, a "game engine" is much, much more than just what you use to draw your game)
Posted on Reply
#28
JWNoctis
Interesting how it is very often Minecraft, when it comes to these kinds of proof-of-concepts. Simple concept and ready availability of training footage, maybe?

If it would one day improvise any game on user prompt like an electronic (and even fancier) version of what Gene Roddenberry imagined for the holodeck, then it might work. This is not it. Not yet.

LLM-powered text adventures, roleplays, and writing companions are closer to usefulness, but also not quite there yet.
Posted on Reply
#29
Shihab
JWNoctisLLM-powered text adventures, roleplays, and writing companions are closer to usefulness, but also not quite there yet.
It would be interesting to have some lighweight LLMs and speech generators implemented for non-essential NPC design (like GTA's pedestrians). I suppose it would still be too expensive for such a secondery aspect of a video game, but the unavoidable "contraversies" that would follow (as is the case with every "AI" chatbot use thusfar) would, by itself, be worth it.
Posted on Reply
#30
Ruru
S.T.A.R.S.
But can it run Crysis?

sorry, couldn't resist.
Posted on Reply
#31
mb194dc
Still searching for a decent use case...
Posted on Reply
#32
Vayra86
SRB151I can see it now...a game with a simple story, no rules until you start, every restart after death all new, but somehow keeps everything interesting and not frustrating. Somehow, I don't see it except for candy crush, tetris, and other simpler games. Even the original Rogue would be beyond frustrating if the rules, monsters, etc. were randomly plucked from an endless supply.
Games like this, basically

store.steampowered.com/app/881100/Noita/

If an AI can make this calibre of game, I'm sold on the technology. So far though... :D
SOAREVERSORExcept none of us have a choice or a vote in that. If the economics point to game streaming being the solution, and they do, then gaming streaming will be gaming. And the only choice you will have is to stream or give up gaming.

So, you have just said you are giving up gaming.
Economics are determined by the inhabitants of countries, dear friend. And since gaming is consumer facing, economics are determined by the consumer. What's popular today, doesn't have to be tomorrow, and another few thousand influential factors apply here to what we buy, don't buy, and do or don't stream.

You're making a major mistake if you think that whatever corporate chooses to pursue is initially an economically good thing to pursue. That's not how business works. If you want to have a market, you create a demand, or you buy a company. And one big way demand is created right now is by taking things away from you. Streaming won't survive on that form of extortion. People aren't that stupid, and reality simply gets in the way. The requirements for streamed games to work properly are immense, and certainly not 'economically sound' either. The reality that needs to exist for streaming to be the end-all-other entertainment thing, is lightyears away.

If you want a live example of all this, look at the 'emerging market' that was grocery courier services (get a Snickers brought to your door in 10 minutes). Popped out one after another during covid, and now they're all gone again. The market was never profitable, but going by your ideas, we should've all been using them full time at this point, because 'companies did it'.
Posted on Reply
#33
Prima.Vera
xorbeThere is an AI version of DOOM but the "game play" is incoherent, you turn around and everything is different, etc. It's like a hallucination nightmare.
Wow, that's so bad!!
Where can I download it??
Posted on Reply
#34
xorbe
Prima.VeraWow, that's so bad!!
Where can I download it??
I doubt it was publicly released (for legal reasons).
Posted on Reply
Add your own comment
Nov 23rd, 2024 07:39 EST change timezone

New Forum Posts

Popular Reviews

Controversial News Posts