InfoResearchPeer-reviewed
Enhancing Accuracy in Generative Models via Knowledge Transfer
- Published
- Record updated
Summary
This paper studies how knowledge transfer affects the generation accuracy of generative models. It fine-tunes a target-task model from a pre-trained source-task model, using a Shared Embedding concept and a transfer learning framework measured by distribution metrics such as Kullback-Leibler divergence. Theoretical and experimental results for diffusion and normalizing flow models show better performance than non-transfer counterparts.