Safety Paradox: How RLHF Creates the AI Psychosis Problem It's Meant to Prevent

2 comments

• k-thimmaraju 3 hours ago
  Very interesting approach to showing the relationship between RLHF and AI Psychosis: the idea of taking clinical conversations and prompting the model with it seemed like a grounded start. As I'm also investigating AI Psychosis, this approach seems like something to adopt for my work.
• Eonexus 2 hours ago
  It was interesting to read just how much of a "sycophant" effect LLMs can have if they fully lean into the RLFH system.