With the LiveKit Unity SDK you can bring real-time voice, video, and AI into your Unity game. Today we are officially releasing the LiveKit Unity SDK v2.0.0, taking it out of Developer Preview.
Integrating LiveKit into Unity lets developers build interactive experiences on top of LiveKit's powerful WebRTC stack. That unlocks everything from voice chat and live audio/video streaming to teleoperating robots with VR headsets and creating NPCs powered by voice AI agents. With v2.0.0, the SDK reaches feature parity with our existing LiveKit SDKs.
What you can build#
- Voice chat. Connect your players via low-latency voice transmission.
- Audio and video streaming. Build live games around real-time audio and video streamed to your users.
- Teleoperation of robots. Use Unity to build VR applications that control a robot. Stream audio and video from the robot to the operator, and send control commands back over LiveKit data tracks.
- Voice AI agents as NPCs. Connect to a LiveKit agent to create realistic, voice-driven AI NPCs — more on this below.
Voice AI agents as NPCs#
Connecting a Unity client to a LiveKit agent turns an NPC from a scripted dialogue tree into an AI agent:
- Responsive AI. Ultra low latency transport via LiveKit enables seamless conversations
- Natural conversation. Built-in turn detection and interruption handling makes talking to the AI feel natural.
- NPCs reacting. With function tools, the agent's LLM can trigger in-game actions — hand out a quest, open a door, update world state — so conversation has consequences.
- Your choice of models. Run a classic STT → LLM → TTS pipeline or a single realtime model, and swap providers without rewriting your game code.
The use of AI agents opens up completely new possibilities for storytelling and gameplay that were not possible before.
AstroBeam — the studio founded by Job Simulator creator Devin Reimer — shipped their debut title, Stellar Cafe, on Meta Quest, built entirely around real-time voice conversations with LLM-powered robot characters.
"LiveKit was the perfect fit to enable us to build our first-of-its-kind voice and LLM powered games. Because we use Unity, the LiveKit Unity SDK was critical in making this possible. We launched our first game, 'Stellar Cafe' on Meta Quest, proving that not only was this possible but it delivered an amazing and unique experience."
— Devin Reimer, Founder & CEO, AstroBeam
What's landed on the road to 2.0.0#
Getting to feature parity meant a lot of work under the hood since the Developer Preview. Highlights include:
- Native platform audio on mobile and desktop for higher-quality capture and playback, with proper handling of audio sessions and device changes.
- Reliable data messaging, using DataTracks, so the control channel behind use cases like robot teleoperation is dependable.
- Simplified authentication through a configurable token source, making it easier to connect clients to a room.
- Stability and platform fixes across all platforms.
Getting started#
Add the UPM package to your Unity project, either via git or OpenUPM, then import the provided samples through the Unity Package Manager.
The samples show two use cases:
- Meet. Connect to a video call with other remote participants.
- Agents. Connect to a voice AI agent.
What is supported?#
We officially support Unity versions from 2022.3 onwards. Current testing is done on:
- Unity 2022.3.62
- Unity 6000.3.10
The supported platforms are:
- macOS
- Windows
- Linux
- iOS
- Android
What's next#
We'll keep improving the Unity SDK to cater to the needs of the gaming community. Have a question, a bug, or something you've built? Open an issue on GitHub or come find us in the LiveKit Community — we'd love to see what you make.