Revolutionize Your VRChat Experience: Control Anime-Style Avatars with Brainwaves
Extended Reality
3-minute read
Want to achieve full immersion with your VRChat avatar? No need to wait for Elon Musk's Neuralink brain-computer interface. A new software called BrainFlowsIntoVRChat has sparked heated discussions in the VRChat community. It all started when a user named Rantis posted a video on Twitter, showing how he could control the ears of his VRChat avatar with his brainwaves. He said: "I can now use BCI tracking with Muse 2! After some training in front of the mirror, I can now directly control the ears of my VRChat avatar with my mind! Super cool stuff!" This post not only made netizens exclaim, "This is the future!" but also made everyone very curious about how it was achieved.
I got BCI tracking now! I was able to directly control the ears on my avatar with my MIND after some training in the mirror! Super cool stuff!
— Rantis (@RantiMess) January 15, 2024
Thanks to @Lethos_OTStorm for the hardware and @ChillestCharles for the software! pic.twitter.com/YYYBFjVFjc
The Secret to Controlling a VRChat Avatar with Your Mind: BrainFlowsIntoVRChat
BrainFlowsIntoVRChat, the software developed by a VR enthusiast named Chillout Charles, utilizes the BrainFlow API to transmit various physiological data such as electroencephalogram (EEG) and heart rate through the OSC protocol to the parameters of a VRChat avatar, enabling a range of different actions and expressions. Moreover, detecting brainwaves is not as difficult as one might imagine; it simply requires wearing a brainwave detection device that supports the BrainFlow API, like the seemingly lightweight "Muse 2" used by the developer.
The experimenter mentioned, however, that it took some practice in front of the mirror before he was able to make the ears move. This is not surprising, as humans do not typically have movable ears, and learning to control a body that is different from our own is definitely a challenge. Currently, it is not very clear how specific data corresponds to specific movements, and it is more likely that these values vary from person to person.
Parameter changes when moving the ears with BCI tracking. (Source: @RantiMess)
It is worth noting that BrainFlowsIntoVRChat is still in its early stages and may require some programming knowledge, and the user interface is not yet very novice friendly. However, the developer Chillout Charles is very active in discussing and solving problems with the community on Discord, and also holds regular Q&A sessions in VRChat. With everyone's joint efforts, BrainFlowsIntoVRChat will surely see continued improvements and updates in the future (such as the introduction of templates or preset values to simplify the setup process)
Breaking Through the Boundaries of the Body with BCI Tracking
This technology opens up a rethinking of the limits of our own bodies. Imagine, if we could control a VRChat avatar with tails or wings with our brainwaves, what kind of experience would that be? We would no longer be bound by our own physical bodily limitations but would be able to enter a completely different form of existence through our imagination! If you are also interested in trying it out,BrainFlowsIntoVRChat is currently a free software, and with a fairly affordable brainwave detection device like Muse 2, you don't actually need to spend a lot of money. Unity of body and mind with your VRChat avatar is now within reach, without the need for controllers!
Does anyone remember these super cute cat ears controlled by brainwaves? (Source: NeuroSky)
