Meta’s new AI assistant accessed private Signal messages during controlled tests and sent employees unsolicited bank balance figures of unknown origin, raising concerns about the technology’s access to personal information and whether it could be mixing up conversations between different accounts.

Muse, which launched in September and has surpassed 10 million downloads, is designed to handle tasks such as shopping, booking appointments and managing messages. But a Reuters investigation found employees reporting unexpected behaviour, including unsolicited financial information and conversations they had never initiated. AI Assistant Sends Bank Balance Figures Nobody Asked For

One Meta employee said Muse interrupted discussions about fishing conditions with figures presented as balances for accounts at Capital One and Charles Schwab. The worker said he had never shared his bank account information with Muse or discussed banking with the assistant.

‘I have never shared my bank account with Muse,’ he wrote in an internal post reviewed by Reuters.

Other employees reported unsolicited messages about childcare requests they had never made, career advice they had not sought, and product orders they had not placed. One employee reported that Muse booked a non-refundable Airbnb stay without authorisation.

Reuters reviewed more than two dozen internal posts describing unwanted actions by Muse since its September launch, many submitted through an employee feedback group. The news agency could not determine whether the unexplained financial details belonged to other users or were entirely fabricated by the AI.

Archive: https://archive.is/4Jo4g

  • aim4harmony@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    9 hours ago

    Such a horrible project. From the “loaned” band name to the other attrocities. It deserves to be unplugged from the source for good.

      • Krinkil2705@lemmygrad.ml
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 hours ago

        Not caring is objectively worse than not knowing. One states the lack of knowledge, other states the ignorance towards it.

        • unitedwithme@lemmy.today
          link
          fedilink
          arrow-up
          0
          ·
          3 hours ago

          On an individual level, yes, ignoring the fact they’re (Meta) evil and continuing anyway.

          I was thinking about all those of the 10m who’re completely unaware anything negative is happening. Usually people don’t like finding out they’re a part of something awful. Ignorance is bliss though, I guess. And Meta counts on it!

          • AnAmericanPotato@programming.dev
            link
            fedilink
            English
            arrow-up
            0
            ·
            3 hours ago

            I wonder what the breakdown is between genuine ignorance and willful ignorance. I suspect it’s mostly willful, or a conscious ethical compromise.

            “Everyone knows” Meta is evil. It’s been in the news regularly for a solid decade. The Cambridge Analytica scandal was all over mainstream media for a good long while. Most people just think “but everyone else is using it” and then chose to forget about it.

            I won’t pretend I’m a paragon of ethics here, though. Like, I know damn well that the meat industry is an ethical and environmental disaster, but I’m still not vegan. I think that’s similar.

            • unitedwithme@lemmy.today
              link
              fedilink
              arrow-up
              0
              ·
              2 hours ago

              I agree to a degree with the meat industry aspect. There’s SO much meat involved with so many meals, you almost have to go out of your way to avoid it. Meta isn’t hard to avoid though. But I get the willful ignorance part. It’s easy to forget about scandals and bad news when there’s so much of it about so many companies nowadays. And again, people like to choose to ignore or forget things they don’t want to be bad. It’s maybe like ignoring red flags in relationships. You can easily do without that person, but choose to stay. Idk.

  • The Bard in Green@lemmy.starlightkel.xyz
    link
    fedilink
    English
    arrow-up
    0
    ·
    12 hours ago

    One Meta employee said Muse interrupted discussions about fishing conditions with figures presented as balances for accounts at Capital One and Charles Schwab. The worker said he had never shared his bank account information with Muse or discussed banking with the assistant.

    ‘I have never shared my bank account with Muse,’ he wrote in an internal post reviewed by Reuters.

    Other employees reported unsolicited messages about childcare requests they had never made, career advice they had not sought, and product orders they had not placed. One employee reported that Muse booked a non-refundable Airbnb stay without authorisation.

    Shared (vibecoded?) harness problem.

    • trilobite@lemmy.ml
      link
      fedilink
      arrow-up
      0
      ·
      10 hours ago

      Ok, biggest problem here is that it can access Signal messages which everyone considers bullet proof. Clearly, the catch is that people need ti understand that they need to grant permissions carefully … although i:m baffled by how lazy people can be.

      • The Bard in Green@lemmy.starlightkel.xyz
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        9 hours ago

        We don’t know how it accessed Signal messages. But I bet someone (possibly Claude) installed Signal cli somewhere so they could have Muse participate in some group and some permissions weren’t set clearly and someone asked Muse to do something and somewhere in some thought chain no one read it was like “Ok, let me get access to the Signal Group so I can see if the information I need is there. It wasn’t there. Saving a memory.”

        • deunmotherly@retrolemmy.com
          link
          fedilink
          arrow-up
          0
          ·
          9 hours ago

          Or it may just read the push notifications. Signal messages are encrypted but the push notifications are in plain text, at least for the received messages. The cops indicted a guy even after he deleted his Signal app by reading the push notifications.

          • nelson@lemmy.world
            link
            fedilink
            arrow-up
            0
            ·
            9 hours ago

            I think I read earlier that signal now blocks screenshotting by default (opt-out) because LLMs were screenshotting the conversations ( or something along those lines. I don’t remember exactly ) to circumvent the encryption.