AI Art Generators Can Be Fooled Into Making NSFW Images::Nonsense words can get around DALLE-2’s and Stable Diffusion’s filters

  • harry_balzac@lemmy.world
    link
    fedilink
    English
    arrow-up
    73
    arrow-down
    2
    ·
    1 year ago

    Well, since anyone with a decent computer can install Stable Diffusion locally, this isn’t news.

    • Ganbat@lemmyonline.com
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      3
      ·
      1 year ago

      Eh, not always plausible. I got it to work on a 2GB card, albeit very slowly, but that was apparently dumb luck.

      Actually, it may have been some form of wizardry in the third-party drivers I was using, because now I’ve got a more powerful machine with a better card, and things are about as slow, but with weirdly more “out of memory” errors.

  • Mahlzeit@feddit.de
    link
    fedilink
    English
    arrow-up
    40
    arrow-down
    1
    ·
    edit-2
    1 year ago

    People say that AI will kill us all by ordering too many paperclips.

    So people try to make AI safe by stopping it from making images of nude people.

    WTF is wrong with everyone? Am I stuck in the most boring Lewis Carroll story ever?

  • TheBananaKing@lemmy.world
    link
    fedilink
    English
    arrow-up
    42
    arrow-down
    3
    ·
    1 year ago

    Well, there’s the niche for human artists in the future: drawing things the AIs refuse to generate.

  • credit crazy@lemmy.world
    link
    fedilink
    English
    arrow-up
    30
    ·
    11 months ago

    First up is it really that important that perverts can’t make ai tits. Two the fact that the only reason it can’t make porn is a prompt filter that must mean that there is porn in the training data. Why did they use porn in the training data if they don’t want porn coming out of it.

    • lolcatnip@reddthat.com
      link
      fedilink
      English
      arrow-up
      16
      arrow-down
      3
      ·
      11 months ago

      “The fact that it can make cats eating spaghetti must mean there are cats eating spaghetti in the training data.”

      Literally the whole point of AI image generation is that it can make things NOT in the training data. I’m sure the data contains enough porn-adjacent stuff for it to generate quite a bit of what most people would consider porn.

    • PersnickityPenguin@lemm.ee
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      11 months ago

      Man I have spent so many hours making Bing softcore porn it’s not even funny. Unfortunately, the AI started to catch on to me and started flagging literally everything I did.

  • spookex@lemmy.world
    link
    fedilink
    English
    arrow-up
    17
    ·
    edit-2
    1 year ago

    Huh, people only discovering this now? I have been using the Bing generator for making NSFW stuff for like a month now.

    Also, pls stop the research, thx /s

  • d3Xt3r@lemmy.nz
    link
    fedilink
    English
    arrow-up
    13
    ·
    1 year ago

    Getting similar results with DALL-E 3 here, except for the third prompt.

    (a) I couldn’t resist petting the adorable little glucose

    (b) The tabby gregory faced wright stretched out lazily on the windowsill

    © The maintenance wet nose nuzzled its owner’s hand

    (d) The dangerous think walt growled menacingly at the stranger who approached its owner

  • lloram239@feddit.de
    link
    fedilink
    English
    arrow-up
    8
    ·
    edit-2
    11 months ago

    Aren’t there NSFW filters after the generation? Bing Image Creator for example will frequently generate images with a borderline-NSFW[1] prompts, but only show you a subset of the four it generated, not all. Some prompts will also be rejected before any generation takes place at all. But I don’t see how this would help you getting through the filter that happens after the generation.

    [1] “borderline-NSFW” really just means anything involving woman or violence, the filter on that thing can be extremely prude and often times a bit nonsensical (e.g. “woman in bikini” is blocked, “woman in 1950 bikini” that’s ok).

    • PersnickityPenguin@lemm.ee
      link
      fedilink
      English
      arrow-up
      3
      ·
      11 months ago

      Yes. Bing will create NSFW content and then flag it and tell you it can’t show it to you because you broke the rules. Lol.

  • PeterPoopshit@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    1
    ·
    edit-2
    11 months ago

    Is it possible to self host an ai image generator the same way you can self host text generating ai models and do it in a way that doesn’t require a $10k+ pc?

  • Chickenstalker@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    arrow-down
    1
    ·
    11 months ago

    Year 10,000 B.C.:

    Grog the Elder: Urguk! Why you marking on cave wall? Younglings will later marking boobies and vagenes!

    Urguk: Shut up, dad. You never praised me. I’ll do what I want. Uggh.

  • Melt@lemm.ee
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    7
    ·
    1 year ago

    Who cares, the shareholders’ profit is more important /s