AI product Open source · Apache-2.0
YuE2 is an open music-generation model and Python pipeline that turns lyrics and a style prompt into a symbolic melody-and-chord plan and then renders that plan as a complete stereo song with vocals and accompaniment. It supports zero-shot covers by using a transcribed melody score, and composition editing by allowing the score, lyrics, style, harmony, melody, tempo, or form to be revised before rendering.
Its AR–NAR Mixture-of-Transformers backbone predicts symbolic scores and semantic tokens, generates acoustic latents with flow matching, and uses a VAE to decode them into 48 kHz audio. The staged API exposes plan(), generate_semantic(), synthesize(), and decode() operations; the repository also provides an agent skill for song generation, transcription, cover creation, ABC-score editing, and listening comparisons.
The repository provides the YuE2-3B model and requires Linux, Python 3.12, and an NVIDIA GPU with BF16 support and 24 GB of VRAM for the documented quick start. First-party code, documentation, and the agent skill use Apache 2.0, while the model weights use CC BY-NC 4.0. The original YuE implementation is preserved on the repository's YuE-v1 branch.