Comment by goldemerald on Are SAE features from the Base Model still meaningful to LLaVA? · 2024-12-28T04:19:55.316Z · LW · GW

As one of the author's of llava-gemma, I'm thrilled to see our model is useful for alignment research. I think the multi-modal aspect of SAE research is under studied, and I am very glad to see this. I will be keeping an eye out for future developments!