2026-11-08 · America/Los_Angeles · 论文 · #8

Decoupled Mode Connectivity for Base-to-Novel Generalization in Vision-Language Models

Prompt learning adapts vision-language models such as CLIP by optimizing a short learnable prompt. The cross-entropy objective pulls this prompt toward base-class specialization, whereas generalization to unseen classes benefits from staying close to CLIP's zero-shot feature space. Because both objectives act on the same prompt, their gradients conflict at convergence, and in our experiments no single-prompt loss design clearly improves on the cosine baseline. We propose Decoupled Mode Connectivity (DMC), which gives each objective its own prompt. Starting from a base-trained prompt, DMC…

热度 15.3 / 100；排名与评分保留该期记录。