Follow Slashdot blog updates by subscribing to our blog RSS feed

 


Forgot your password?
Close
typodupeerror
×
Open Source AI

Bumble Open Sourced Its AI That Detects Unsolicited Nudes (techcrunch.com) 49

Posted by BeauHD from the private-detection dept.
An anonymous reader quotes a report from TechCrunch: As part of its larger commitment to combat "cyberflashing," the dating app Bumble is open sourcing its AI tool that detects unsolicited lewd images. First debuted in 2019, Private Detector (let's take a moment to let that name sink in) blurs out nudes that are sent through the Bumble app, giving the user on the receiving end the choice of whether to open the image. "Even though the number of users sending lewd images on our apps is luckily a negligible minority -- just 0.1% -- our scale allows us to collect a best-in-the-industry dataset of both lewd and non-lewd images, tailored to achieve the best possible performances on the task," the company wrote in a press release.

Now available on GitHub, a refined version of the AI is available for commercial use, distribution and modification. Though it's not exactly cutting-edge technology to develop a model that detects nude images, it's something that smaller companies probably don't have the time to develop themselves. So, other dating apps (or any product where people might send dick pics, AKA the entire internet?) could feasibly integrate this technology into their own products, helping shield users from undesired lewd content. When Bumble first introduced this AI, the company claimed it had 98% accuracy. "There's a need to address this issue beyond Bumble's product ecosystem and engage in a larger conversation about how to address the issue of unsolicited lewd photos -- also known as cyberflashing -- to make the internet a safer and kinder place for everyone," Bumble added.
This discussion has been archived. No new comments can be posted.

Bumble Open Sourced Its AI That Detects Unsolicited Nudes More

Bumble Open Sourced Its AI That Detects Unsolicited Nudes

Comments Filter:

  • You're beautiful (Score:4, Insightful)

    by phantomfive ( 622387 ) on Tuesday October 25, 2022 @09:10AM (#62996265) Journal

    "Even though the number of users sending lewd images on our apps is luckily a negligible minority -- just 0.1%"

    That they know of.

  • Can't wait to hear from all the people wondering why it's such a big deal to cover up nude photos sent to people. As if everyone and their grandmother wants unexpected nudes sent to them from people they don't know. And sometimes from people they do know or are getting to know.

    • Well, as far as I know most men would be ok with receiving unsolicited nudes from strangers or people they know (given it is the sex they are attracted to sending it), SPECIALLY in a app used for dating where if you get a match it means both feel attracted to each other somehow.
      Women on the other hand seem to generally not like to see nudes unless they ask for it or if the conversation induces it (which can be complicated to be sure given how difficult, specially for most men, to know the actual intentions

  • If (say) Linkedin/Facebook etc had this, they could:

    1) Run the AI over all images sent in DMs (or in posts, I guess)
    2) If the AI blurs it, then:
    2a) If the user has no previous flags, then pass the image along, blurred with a warning and an unblur button, and a "flag as inappropriate" (and possibly "flag as okay")
    2b) If the user has previous flags against them, then send the image for moderation before delivering it
    2c) Is the user has flags against them, but the recipient has previously said blurred images w

    • Re: (Score:2)

      by Bert64 ( 520050 )

      If you're going to send the image for moderation then you're potentially violating someone's privacy if they believe that they've shared an image privately with someone.

      There are MANY things other than nudity that someone may not like to receive. Depictions of violence, rotten things, dead or mutilated bodies of people and/or animals, logos of organisations you dislike, (non nude) images of people you dislike etc. There are also plenty of people who would absolutely love to receive nude images.

      There are alr

  • But can it detect hot dog and not hot dog?
  • ... that they're unsolicited?

    • Re: (Score:2)

      by Sloppy ( 14984 )

      It works the same way as the DRM enforcement code which determines whether an operation is copyright infringement or fair use. They probably just send the AI to college for a few years, and the ones who graduate instead of drinking themselves to death, get deployed.

    • ... that they're unsolicited?

      The images are unsolicited if there is no prior message history between the sender and recipient.

      • The images are unsolicited if there is no prior message history between the sender and recipient.

        This is Bumble. On that app, the woman has to make the first move - Men can't message a woman without the woman having messaged him first.

        ...so there would always be a "prior message history" even if it's just a woman saying "Hi."

        • ...so there would always be a "prior message history" even if it's just a woman saying "Hi."

          Well then, saying "Hi" to someone certainly means they're expecting a nude or dick pic from you. /s

        • That's if it's a man sending a nude to a woman. What if a woman's first message to a man contains a nude? And, for that matter, what if the first message is going to a member of the same sex?

          • What if a woman's first message to a man contains a nude?

            What if I trip over a crate of gold bars that has appeared in my shed?

            Possible, but so unlikely as to not merit consideration here.

            And, for that matter, what if the first message is going to a member of the same sex?

            If it is a woman messaging a woman, then a dick-pic won't be sent. If it's a man messaging a man then I suppose the first message sent could be a dick-pic, and presumably this AI would catch it.

            ...but the latter case is unli

            • What I was thinking of is a woman sending a picture of herself nude to a strange man to imply that she's looking for a physical relationship. The other parts were mostly to expand the possibilities. I suppose that if I'd ever visited Bramble, I'd know that it's mostly for women to hunt for men, but at my age, I'd not expect any serious incoming messages.

              • What I was thinking of is a woman sending a picture of herself nude to a strange man to imply that she's looking for a physical relationship.

                I understood. My point was that it's not terribly uncommon for men to send unsolicited nudes to women.

                By contrast, it is extremely uncommon for women to send unsolicited nudes to men. It's possible, I suppose, but in general so incredibly rare there's really not a lot of point in putting procedures and expensive software code in place.

  • I'm fine with it (Score:4, Funny)

    by Pieroxy ( 222434 ) on Tuesday October 25, 2022 @09:22AM (#62996305) Homepage

    It's all well and good to get the algo for free. I am more interested by the training dataset. It is available as well ? /sarcasm

    • When you've seen one nekid body part, you've seen them all!

    • It's all well and good to get the algo for free. I am more interested by the training dataset. It is available as well ? /sarcasm

      How many cocks do you want to see? No man on Bumble of all fucking places is complaining about women sending him nudes. NONE!!!! Has anyone in history ever said "Hey stop sending pictures of your tits!!!!" "Geez lady, stop sending me pics of your muff or I'll report you!"

      There are many things about being a (grown) woman I'll never understand. If you sent me a dick pic, I'd be bored, but not traumatized. I'm not saying they shouldn't. I just can't relate. I can look at dick all day and will just b

      • Re: (Score:2)

        by rayzat ( 733303 )
        My best friend is back on the market after years of marriage. A few things I learned looking over his shoulder at all the apps that didn't exist until long after I was married. To lay the groundwork my buddy is fairly tall and attractive with a good sense of fashion. When hanging out at a bar it's not uncommon for women to start conversations with him or offer their phone numbers. First observation. The number of unsolicited nudes he gets from women blew my mind. Generally they fall into two categories, wom

        • Generally they fall into two categories, woman promoting OF or Insta so fake profiles, and woman we'll say he just isn't attracted to physically. He hates getting them for two reasons, first the woman are either fake or unattractive second, if he doesn't respond within a minute of opening with a soliloquy of the gloriousness of their bosoms it turns into a huge issue every time.

          Fake messages are a nuisance, but not a traumatic event. If I were dating, I'd delete them, but not care much. They're a waste of 2 seconds of your life. However, they're generally just spam. If a woman wants to send pics of her tits, it's not a guarantee the recipient wants to date her, but it's also generally not a traumatic event. I'll happily look at tits from psychos and sex workers trying to get me to subscribe to their OF, which I NEVER will do.

          It's pretty safe to say men want to receive nudes

  • How does the AI know that?

  • So if you send somebody an unsolicited image of the Venus de Milo or Michaelangelo's David, Bumble might slap your wrist?

    On another note...the word "lewd" just sounds right. Somehow you would probably know what it meant even if you'd never heard it before.

    • So if you send somebody an unsolicited image of the Venus de Milo or Michaelangelo's David, Bumble might slap your wrist?

      On another note...the word "lewd" just sounds right. Somehow you would probably know what it meant even if you'd never heard it before.

      Yeah, sorry buddy, if you want to send pics that may trigger an AI filter, get her number first. Bumble is there just to provide the introduction and get the conversation started. In general, it's probably not too smart to start your conversation with naked body parts, even if they're not yours. It's not particularly classy to send dick to a woman in the first few messages, even if it's a famous marble statue.

      You can send as many naked photos as you want in the next phase. On behalf of all men, thou

  • Anyone unfortunate enough to resort to using Bumble will quickly learn that this feature does nothing to make the platform productive, anyway. Can it detect snotty/shitty comments from men? I am guessing that most women there probably would love to stop messages that make them feel like shit, more than unsolicited dick pics. If you're a man on this platform, unless you're 6'10" and obviously very affluent looking, you're going to be wasting time, anyway.

    • Re: (Score:2)

      by dskoll ( 99328 )

      I would have thought that crappy messages would be much easier to detect than nude photos. There are tons of apps that check the tone of messages and warn if they think they're a bit nasty or hostile... mostly used in joint custody communication situations.

  • This is not banning nude images, it simply blurs them out and gives the recipient the choice of whether or not to unblur.

    So you can still send and receive all the dick pics, artistic nudes, etc. that you want. You just can't blindside the recipient into making them see your scraggly dick whether they want to or not.

  • Thank you, Bumble!! (Score:1)

    by Anonymous Coward
    I'm tired of opening unsolicited images only to discover that they aren't lewd! A tool to automatically classify those undesirable images would save me so much time and grief!

  • Note (Score:2)

    by ceoyoyo ( 59147 )

    our scale allows us to collect a best-in-the-industry dataset of both lewd and non-lewd images

    Your nudes might be unappreciated by the recipient, but they're definitely going in Bumble's corporate spank bank.

  • Lets see: Some hottie posts nudes to solicit more attention. What will I do? Oh that so many of my other life decisions were so simple.

  • Finally jing yang algorithm is getting the recognition it deserves.

  • ...this could be implemented on my smart TV to block political lewds.

  • I think that was a plot line from HBO's Silicon Valley. The Not Hotdog app got re-purposed as a dick pic detector.

Slashdot Top Deals

Make sure your code does nothing gracefully.

Close