TriSAIL: A Source-Sensitive Audit Protocol for Symmetric and Asymmetric Transfer in Hidden-State Safety Probes

Summary

TriSAIL is an evaluation protocol for hidden-state safety probes that records data sources, behavior labels, extracted layer, and probe family, and tests how these choices change the resulting claim. Tested on five text-only LLMs and six MLLMs with logistic, kNN, and SVM probes, LLM results varied substantially across held-out attack families, probe families, and source assignments. MLLM probes reached high label separability, but source-ID decoding and residualization tests showed strong source alignment, so those results describe source-sensitive separability.