Joint, Decoupled, or Agent: When Each Multimodal Alignment Paradigm Wins
arXiv:2610.24108v1 Announce Type: new Abstract: Jointly pretrained multimodal encoders are a common way to combine modalities, while alternatives integrate their information during downstream training or inference. When does each approach win? We compare three paradigms,…