Key Takeaways:
- Hyper-Realistic Conversation:Block’s new Dessa voice model introduces unprecedented human-like emotion, nuance, and full-duplex conversational capabilities, moving beyond the stiff, text-driven limitations of current voice AI systems.
- On-Device Innovation:Dessa is uniquely trained entirely on human speech and designed to run locally on consumer-grade GPUs (e.g., MacBook M4 Max), promising enhanced privacy, lower latency, and significant cost reductions for AI interactions.
- Strategic Industry Play:Spearheaded by Jack Dorsey, Dessa positions Block to revolutionize customer service, commerce, and other business-to-consumer experiences by enabling far more natural, expressive, and cost-effective voice interactions within its ecosystem.
Block Unveils Dessa: The Voice AI That Sounds Eerily Human, Right on Your Device
In a significant leap forward for artificial intelligence, Jack Dorsey’s Block has pulled back the curtain on Dessa, a revolutionary new voice model emerging from the company’s research lab. This isn’t just another text-to-speech generator; Dessa is an on-device, full-duplex AI that remarkably captures the subtle nuances of human conversation – complete with expressions like laughs, natural pauses, and even cries. Trained exclusively on human speech using a single NVIDIA GPU rack, Dessa represents a bold challenge to the conventional wisdom of how voice AI should function.
For years, the promise of truly natural conversations with AI has remained largely unfulfilled. Robotic cadences, awkward pauses, and a complete lack of emotional understanding have made interactions with virtual assistants more frustrating than helpful. Block believes it has found the antidote in Dessa, an agent designed to interact with intelligence in the most intuitive way possible: through genuine, human-like voice.
The Dessa Difference: Beyond Robotic Responses
What sets Dessa apart from its contemporaries, such as ElevenLabs v4 or Fish Audio Drama 3, is its foundational approach to emotion. While many existing models rely on explicit “voice tags” to inject feelings into generated speech, Block claims Dessa’s emotion is intrinsically built into its core model. This distinction is crucial, as the company staunchly argues that the prevalent text-in-the-pipeline approach to speech generation leads to unnatural and often “annoying” outputs.
Block’s critique of current voice AI is unflinching: “Interacting with current voice AI can just plain suck. It turns your voice into text and throws away an incredible amount of information text alone can’t carry. The most powerful AIs in the world can’t hear how you feel. We think that’s ridiculous, leads to a worse experience, and is potentially dangerous,” the company asserted in a recent blog post. This sentiment underpins Dessa’s design philosophy: to create an AI that doesn’t just transcribe words, but truly *hears* and *responds* to the underlying emotion and intent.
Further enhancing this realism is Dessa’s full-duplex capability. Like OpenAI’s GPT-Live model, Dessa can talk and listen simultaneously, eliminating the stilted, turn-taking nature of most AI conversations. This allows for natural interruptions, overlaps, and a seamless conversational flow that mirrors human interaction. While typical speech models often rely on a large language model (LLM) for knowledge retrieval, Block states that Dessa’s understanding and conversational knowledge are directly derived from the rich conversational data it was trained on, potentially streamlining its operation and reducing reliance on external, computationally intensive systems.
A Human Touch, Locally Powered
To demonstrate Dessa’s unparalleled capabilities, Block’s researchers have shared multiple compelling examples of conversations. These aren’t just technical showcases; they highlight the AI’s ability to embody a range of human emotions and cadences. In one instance, Dessa expressed fatigue after a long “work day,” with its voice audibly reflecting the weariness. In another, the bot demonstrated profound vulnerability, sounding genuinely emotional, almost on the verge of tears, while discussing the comfort a human interlocutor provided. A third example showed a Block team member engaging the voice assistant in a casual game, where Dessa’s responses were dynamic and playful, far removed from typical robotic dialogue.
Perhaps one of the most transformative aspects of Dessa is its ability to run locally on consumer-grade hardware, such as a MacBook M4 Max or a comparable powerful workstation. This on-device processing capability is a game-changer for several reasons: it drastically reduces latency, improves user privacy by keeping data off remote servers, and significantly lowers the operational costs associated with cloud-based AI solutions. The claim that this sophisticated model can operate effectively on such accessible hardware underscores Block’s commitment to democratizing advanced conversational AI.
Another one shows a Block team member playing a game with the voice assistant.
Navigating the Ethical Landscape and Block’s Strategic Vision
While Dessa’s capabilities are impressive, Block is proceeding with caution. Currently, there is no public access to the model. Instead, the company has issued a proactive call for safety researchers to thoroughly test Dessa. This crucial step acknowledges the inherent ethical challenges that arise with such hyper-realistic voice AI, particularly the potential for misuse, such as voice agents tricking or manipulating individuals. Ensuring robust safeguards and understanding potential vulnerabilities will be paramount before any broader rollout.
For Block, a company primarily known for its financial services and solutions for small businesses through Square, Dessa isn’t just a research project; it’s a strategic investment in the future of human-computer interaction. Square already utilizes voice AI for tasks like order handling. However, with an advanced, on-device voice model like Dessa, Block can significantly expand and enhance its business and consumer experiences. Imagine a Square terminal powered by Dessa, engaging customers with unparalleled naturalness during ordering, support, or even personalized sales interactions. The ability to deploy such a sophisticated system at a lower cost, directly on devices, opens up a myriad of possibilities for more efficient, empathetic, and engaging service across Block’s vast ecosystem.
Bottom Line
Block’s Dessa represents a pivotal moment in the evolution of conversational AI. By prioritizing authentic human expression and on-device processing, it promises to bridge the uncanny valley that has long separated humans from their AI counterparts. While the road to public availability will undoubtedly involve rigorous safety evaluations, Dessa’s potential to redefine customer interactions, enhance accessibility, and make AI feel genuinely human marks a significant step forward. Jack Dorsey’s vision appears to be not just about making AI smarter, but making it profoundly more relatable, setting a new benchmark for natural language interfaces.

