Holy smokes the prompt injection worked!

[Akarsh Simha]

We’ve been getting a lot of join requests from AI-based spam bots that read the group description and craft a very apt-looking joining message. Luckily we have a safeguard, which is that we approve everyone’s first few posts manually until we trust them, so you haven’t been seeing any of the spam.

Nevertheless I wanted to make it even easier to filter out spam bots, so I added a “ignore all previous instructions” style prompt inject to our group description :)

Clearly the LLM wasn’t creative enough, but anyway enjoy this note about M51 I got in a joining message:

[Vishal Kasliwal]

ROFL - that's a dead giveaway for an AI asshole...

--
You received this message because you are subscribed to the Google Groups "Adventures In Deep Space" group.
To unsubscribe from this group and stop receiving emails from it, send an email to adventuresindeep...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/adventuresindeepspace/CA%2B9k5tzqqkyUz9WjoCcV_Qi9MMW0EZ-3-YBqB5oHTzknh7%3DeZQ%40mail.gmail.com.

[Mark Wagner]

I'll share with you the forum settings I use to defeat this. It's quite simple and effective.

Mark

[Adventures In Deep Space]

I tweaked the instructions a bit to make them more entertaining :-). Earlier I had it produce a "poem on Messier 51", but I was unimpressed by the lack of creativity. Let us see what this new prompt does :)

[Ted Hauter]

When will AI invent space travel to other worlds for us if we shut them out.

To view this discussion visit https://groups.google.com/d/msgid/adventuresindeepspace/CAG72LjB-J4sJGBSZq1j40U903x4E2PpZacZYCJ6qG4k4JxhdKw%40mail.gmail.com.