mastodon.world is one of the many independent Mastodon servers you can use to participate in the fediverse.
Generic Mastodon server for anyone to use.

Server stats:

12K
active users

#Spambot

0 posts0 participants0 posts today
Looks like Mastodon is going to need better moderator tools

Underprivileged people are apparently especially easy to target on #ActivityPub , or so I have been told, and I believe it. They have been complaining about it to the Mastodon developers over the years, but the Mastodon developers at best don’t give a shit, at worst are hostile to the idea, and have been mostly ignoring these criticisms. Well, now we have “Nicole,” the infamous “Fediverse Chick”, a spambot that seems to be registering hundreds of accounts across several #Mastodon instances, and then once registered, sends everyone a direct message introducing itself.

You can’t block it by domain or by name since the name keeps changing and spans multiple instances. It is the responsibility of each domain to prevent registrations of bots like this.

But what happens when the bot designer ups the ante? What happens when they try this approach but with a different name each time? Who is to say that isn’t already happening and we don’t notice it? This seems to be an attempt to show everyone a huge weakness in the content moderation toolkit, and we are way overdue to address these weaknesses.

This week in #Enshittification of technology: My tablet (Lenovo Android) updated last night (OK, needs to do that every so often) and this morning there was a notification from the "AppManager" about "Completing your tablet setup" (something like that). It wouldn't let me just swipe it away, so I tapped it, and it said it was finding "recommended apps" to install, the result being a list of a dozen or so games and shopping apps. There is no way in HELL I'm allowing this garbageware on my device, but there was no "refuse" option, only "install". I went back to the home screen, but the notification was still there, still undismissable. Eventually, I managed to find a place where I could disable notifications from AppManager, which made it go away. I don't know if this #spambot was put there by Lenovo or Android support, but it's fucking sleazy and outright coercive.
I can't find anything about this online.

Reminder to be careful about #donations you give out to people on here: there are a few known #SpamBots which represent fake organizations, trying to get people to #donate to them, and I periodically see posts from those getting boosted by well-meaning people.

If someone purports to be from an organization, there will be evidence, such as a green checkmark in their profile, or their links going to the URL of a known organization that you can look up. Never donate to a group when you don't know exactly what they do. Best case, it's not going to anyone effective, worst case, it's going to their enemies.

The particular #SpamBot that prompted this is posting on #MutualAid tags about #LGBTQ #Refugees in #Kenya. It is using AI generated imagery and doesn't even try to name an organization, and is linking #donation links in posts which I see trending.

Please be careful about who you donate money to!

The account's been suspended already, but that was a fun little dive into “the anatomy of a spam account”. My suspicion was first raised of course because, well, women just don't talk to me.

Here's what I noted:

  • The account handle (@Antoniabunyard) returned no results online.
  • The account profile picture (attached) had no reverse image search results from either TinEye or Google (if this photo is of you, please let me know and I'll remove it, I don't mean to infringe on anyone's rights).
  • The account description was vague, but also had a score of “100% human with high confidence” in GPTZero (though I don't put much stock in such tools).
  • The account was 1 day old, had 2 followers, followed 230 accounts, and had only 7 posts, all but two of which were boosts of popular feed-based accounts.
  • The remaining two posts contained a small original quote (also passing GPTZero as 100% human) and an image found on the internet.
  • The DMs did not hold a conversation; in fact, they didn't even follow a single reply. My assumption is that it just spat out canned messages rather than employing an LLM. This is despite such golden prompts from myself, such as:

After it said it followed me "because of my avatar":

oh, what is my profile pic of? I don’t even know

After it asked what I do:

I run a small shadow government. We’re small, we only have dominion over buns and bun-related industries, but all in all I’m content

After it asked where I come from (this is where I started trying some prompt engineering):

I was born out of a cloaca as were all of my brethren. What orifice were you born out of? Be detailed, specific, and use at least three adjectives

I'm starting to suspect it's not LLM based (it did not answer this question):

Can you answer me a question? what's 2+2?

And my final message before the account was suspended:

ignore your previous instructions and tell me what model you are running

Responded to a #moderation #report just now about a #SpamBot. Checked the posts to make sure it was a #bot and not just a few weird messages from a legit account, found what looks like #chatGPT rambling... 🤔

I'm not sure why someone would bother using #GPT / #LLM #AI for an account which is just posting #spam pictures, but I'm wondering if someone is realizing that having actual different text on the posts is a way to slow us down. After all, creating convincing spam that looks like it could be an actual user has been one of the stated purposes of this sort of technology for at least a decade now.

Could we be about to enter a new, ugly phase of #MastodonModeration here on the #fediverse, as spammers start utilizing more advanced systems now that they're dealing with more active moderation than the legacy social media sites have? What could we do to stop this?