logoalt Hacker News

aleksiy123yesterday at 7:00 PM1 replyview on HN

Probably a mix of heuristics, keywords and simple ml model.

Then maybe a second gate with a lightweight llm?

Edit: actually Gcp, azure, and OpenAI all have paid apis that you can also use.

But I don’t think they go into details about the exact implementation https://redteams.ai/topics/defense-mitigation/guardrails-arc...


Replies

ryoshuyesterday at 7:47 PM

When we do these it's a fine-tuned classifier, generally a BERT class model. Works quite well when you sanitize input and output with low latency/cost.