A brave man has built a conversational AI chatbot using Minecraft's redstone

In the sandbox game 'Minecraft,' you can build various circuits using the in-game material redstone, and so far, we have succeeded in recreating
I built ChatGPT with Minecraft redstone! - YouTube
Sammyuri, who released the movie this time, is the person who previously designed a 1Hz CPU in Minecraft.
A man who created a 1Hz CPU in Minecraft has appeared, and Tetris and function graphing are also possible - GIGAZINE

Asking ChatGPT: 'Can I build you in Minecraft?'

'Yes, you can definitely do that!' answers ChatGPT.

And Sammyuri has actually built it.

In front of Sammyuri was a huge laptop-type device.
And the circuit body that built the AI chatbot looks like this.

Looking inside, you can see that the blocks are meticulously assembled.

I can see that it uses redstone circuits, but it's so complicated that I can't understand how it works just by looking at it.

The AI chatbot built by sammyuri is called 'CraftGPT'

A tokenizer that divides input text into tokens

Positional Encoding: Representing token position information as a vector

Token Embedding: Creating token features

Layer

Matrix Multiplier

Multi-Head Attention

KV Cache, which manages short-term memory for AI models

And then there's LayerNorm.

960x240 Matrix Multiplier

ReLU, which performs

240x960 Matrix Multiplier. This is one set.

There are six of these layers.

Unembedding Matrix Multiplier

Next token selection

And output the token.

The text will appear on the device screen.

CraftGPT allows for basic conversations, but the video is fast-forwarded, so it takes a considerable amount of time to actually answer.

It's not just a string of words, it also has the underlying knowledge.

The same question will have different answers depending on the seed value.

sammyuri can run CraftGPT The server, which speeds up redstone circuit execution, and the MCHPRs version of the world data are available on Google Drive, and the CraftGPT emulator is available on GitHub. 'To load the server, you'll need a machine with at least 32GB of RAM, but ideally 64GB or more,' says Sammyuri.
GitHub - sammyuri/craftgpt: Small language model built in Minecraft.
https://github.com/sammyuri/craftgpt
In addition, the Windows PC version of 'Minecraft' can be purchased online at Amazon.co.jp for 3,564 yen including tax.
Amazon.co.jp: Windows Version | Minecraft: Java & Bedrock Edition | Online Code Version: Games

Related Posts: