Logo image
FEEDBACK-DRIVEN RETRIEVAL-AUGMENTED AUDIO GENERATION WITH LARGE AUDIO LANGUAGE MODELS
Conference proceeding

FEEDBACK-DRIVEN RETRIEVAL-AUGMENTED AUDIO GENERATION WITH LARGE AUDIO LANGUAGE MODELS

Junqi Zhao, Chenxing Li, Jinzheng Zhao, Rilin Chen, Dong Yu, Mark D. Plumbley and Wenwu Wang
2026 IEEE International Conference on Acoustics, Speech, and Signal Processing
2026 IEEE International Conference on Acoustics, Speech, and Signal Processing (Barcelona, Spain, 04/05/2026–08/05/2026)
03/03/2026

Abstract

Index Terms— Text-to-audio generation retrieval aug- mented generation large audio-language models
We propose a general feedback-driven retrieval-augmented generation (RAG) approach that leverages Large Audio Language Models (LALMs) to address the missing or imperfect synthesis of specific sound events in text-to-audio (TTA) generation. Unlike previous RAG-based TTA methods that typically train specialized models from scratch, we utilize LALMs to analyze audio generation outputs, retrieve concepts that pre-trained models struggle to generate from an external database, and incorporate the retrieved information into the generation process. Experimental results show that our method not only enhances the ability of LALMs to identify missing sound events but also delivers improvements across different models, outperforming existing RAG-specialized approaches.
pdf
icassp2026_camera_ready300.17 kB
Author's Accepted Manuscript CC BY V4.0 Embargoed Access, Embargo ends: 04/05/2026

Metrics

1 Record Views

Details

Logo image

Usage Policy