Developed in collaboration with Mirelo (AI https://www.mirelo.ai/), MuScriptor is an open-weight model for multi-instrument automatic transcription
AI & ML interests
Our mission is to build and democratize artificial general intelligence through open science
Recent Activity
View all activity
Papers
MuScriptor: An Open Model for Multi-Instrument Music Transcription
The FID Lottery: Quantifying Hidden Randomness in Generative-Model Evaluation
Full-duplex speech models post-trained with reinforcement learning for improved conversational interactivity.
-
Multi-Faceted Interactivity Alignment in Full-Duplex Speech Models
Paper • 2606.11167 • Published • 6 -
kyutai/moshika-rl-seamless
Audio-to-Audio • 8B • Updated • 187 • 31 -
kyutai/personaplex-rl-seamless
Audio-to-Audio • 8B • Updated • 4.27k • 37 -
kyutai/interactivity-alignment-samples
Viewer • Updated • 5.56k • 580 • 9
Streaming speech translation without the need for word-level alignments
-
Hibiki Zero Samples
🏆13Demo samples of the speech translation model Hibiki-Zero.
-
Simultaneous Speech-to-Speech Translation Without Aligned Data
Paper • 2602.11072 • Published • 2 -
kyutai/Audio-NTREX-4L
Viewer • Updated • 3.6k • 459 • 6 -
kyutai/hibiki-zero-3b-pytorch-bf16
Audio-to-Audio • Updated • 1.55k • 59
CASA: Cross-Attention over Self-Attention for Efficient Vision-Language Fusion on long-context streaming inputs
-
CASA Gallery
🏠4Video Gallery for CASA: Cross-Attention over Self-Attention
-
CASA: Cross-Attention via Self-Attention for Efficient Vision-Language Fusion
Paper • 2512.19535 • Published • 13 -
kyutai/CASA-Qwen2_5-VL-3B
Image-Text-to-Text • 4B • Updated • 131 • 3 -
kyutai/CASA-Qwen2_5-VL-3B-Shared
Image-Text-to-Text • 4B • Updated • 28
https://kyutai.org/next/tts
Helium 1: a modular and multilingual LLM
Hibiki is a model for streaming speech translation , which can run on device! See https://github.com/kyutai-labs/hibiki.
Developed with General Intuition (https://www.generalintuition.com/), in collaboration with Epic Games. MIRA is a Multiplayer Interactive World Model.
Candle & PyTorch model checkpoints released as part of the MoshiRAG release from Kyutai. Run inference via: https://github.com/kyutai-labs/moshi-rag
Temporal pretraining checkpoints and KairosQA evaluation dataset
Pretrained ARC-Encoders and a fine-tuning dataset: context compression for unmodified LLMs.
-
ARC-Encoder: learning compressed text representations for large language models
Paper • 2510.20535 • Published • 10 -
kyutai/ARC8_Encoder_Llama
Feature Extraction • 3B • Updated • 79 • 3 -
kyutai/ARC_finetuning
Preview • Updated • 37 • 1 -
kyutai/ARC8_Encoder_multi
Feature Extraction • 3B • Updated • 81 • 7
https://kyutai.org/next/stt
MoshiVis is a Vision Speech Model built as a perceptually-augmented version of Moshi v0.1 for conversing about image inputs
MLX, Candle & PyTorch model checkpoints released as part of the Moshi release from Kyutai. Run inference via: https://github.com/kyutai-labs/moshi
Developed in collaboration with Mirelo (AI https://www.mirelo.ai/), MuScriptor is an open-weight model for multi-instrument automatic transcription
Developed with General Intuition (https://www.generalintuition.com/), in collaboration with Epic Games. MIRA is a Multiplayer Interactive World Model.
Full-duplex speech models post-trained with reinforcement learning for improved conversational interactivity.
-
Multi-Faceted Interactivity Alignment in Full-Duplex Speech Models
Paper • 2606.11167 • Published • 6 -
kyutai/moshika-rl-seamless
Audio-to-Audio • 8B • Updated • 187 • 31 -
kyutai/personaplex-rl-seamless
Audio-to-Audio • 8B • Updated • 4.27k • 37 -
kyutai/interactivity-alignment-samples
Viewer • Updated • 5.56k • 580 • 9
Candle & PyTorch model checkpoints released as part of the MoshiRAG release from Kyutai. Run inference via: https://github.com/kyutai-labs/moshi-rag
Streaming speech translation without the need for word-level alignments
-
Hibiki Zero Samples
🏆13Demo samples of the speech translation model Hibiki-Zero.
-
Simultaneous Speech-to-Speech Translation Without Aligned Data
Paper • 2602.11072 • Published • 2 -
kyutai/Audio-NTREX-4L
Viewer • Updated • 3.6k • 459 • 6 -
kyutai/hibiki-zero-3b-pytorch-bf16
Audio-to-Audio • Updated • 1.55k • 59
Temporal pretraining checkpoints and KairosQA evaluation dataset
CASA: Cross-Attention over Self-Attention for Efficient Vision-Language Fusion on long-context streaming inputs
-
CASA Gallery
🏠4Video Gallery for CASA: Cross-Attention over Self-Attention
-
CASA: Cross-Attention via Self-Attention for Efficient Vision-Language Fusion
Paper • 2512.19535 • Published • 13 -
kyutai/CASA-Qwen2_5-VL-3B
Image-Text-to-Text • 4B • Updated • 131 • 3 -
kyutai/CASA-Qwen2_5-VL-3B-Shared
Image-Text-to-Text • 4B • Updated • 28
Pretrained ARC-Encoders and a fine-tuning dataset: context compression for unmodified LLMs.
-
ARC-Encoder: learning compressed text representations for large language models
Paper • 2510.20535 • Published • 10 -
kyutai/ARC8_Encoder_Llama
Feature Extraction • 3B • Updated • 79 • 3 -
kyutai/ARC_finetuning
Preview • Updated • 37 • 1 -
kyutai/ARC8_Encoder_multi
Feature Extraction • 3B • Updated • 81 • 7
https://kyutai.org/next/tts
https://kyutai.org/next/stt
Helium 1: a modular and multilingual LLM
MoshiVis is a Vision Speech Model built as a perceptually-augmented version of Moshi v0.1 for conversing about image inputs
Hibiki is a model for streaming speech translation , which can run on device! See https://github.com/kyutai-labs/hibiki.
MLX, Candle & PyTorch model checkpoints released as part of the Moshi release from Kyutai. Run inference via: https://github.com/kyutai-labs/moshi