2026-11-14 · America/Los_Angeles · 社区动态 · #7
IBM trained small models to ignore instructions hidden in documents. Would you trust that in a RAG pipeline?
Saw on r/LocalLLaMA that IBM put out two small open models trained to ignore orders hidden inside documents. Basically prompt injection resistance baked into the model. For RAG and agents that read web pages or user uploads, this is the scary part. The usual advice is to handle it outside the model: clean the retrieved text, keep data and instructions separate in the prompt, and limit which tools the agent can call. Curious how people here are doing it: - Do you rely on the model to ignore injected text, or do you guard it in the pipeline? - Has anyone actually tested their RAG app against…
热度 45.4 / 100;排名与评分保留该期记录。