Chat-Scene++: Exploiting Context-Rich Object Identification for 3D LLM

Summary

Chat-Scene++ is an MLLM framework that represents 3D scenes as sequences of context-rich object representations paired with identifier tokens, letting LLMs follow instructions across 3D vision-language tasks. It extracts object features using large-scale pre-trained 3D scene-level and 2D image-level encoders and supports grounded chain-of-thought reasoning. Without task-specific heads or fine-tuning, it reports state-of-the-art results on five benchmarks: ScanRefer, Multi3DRefer, Scan2Cap, ScanQA, and SQA3D.