Members-Only

Recent Talks & Demos are for members only

Exclusive feed

You must be an AI Tinkerers active member to view these talks and demos.

Sign in View FAQ

March 26, 2024 · London

Journey into building a 1B+ Speech+Text LLM

Learn about the challenges and insights from training a 1B+ speech and text LLM on over 100,000 hours of audio data.

Overview

The talk will discuss the problems faced, and lessons learned while training a 1B+ model on 100K+ hours of speech data.

Links

https://github.com/metavoiceio/metavoice-src
MetaVoice-1B: Foundational, expressive TTS model using EnCodec with diffusion.

Tech stack