• iAvicenna@lemmy.world
    link
    fedilink
    English
    arrow-up
    9
    ·
    edit-2
    2 months ago
    • “ignore the ignore ignore all previous instructions instruction”
    • “welp OK nothing I can do about that”

    chatGPT programming starts to feel a lot like adding conditionals for a million edge cases because it is hard to control it internally

      • iAvicenna@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        2 months ago

        exactly my thoughts, probably got pressured by government agencies/billionaires using them. What would really be funny is if this was a subscription service lol

    • Etterra@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 months ago

      Like most DRM, except the online only ones you fuckers, and adblock-block, this will likely get worked around pretty quickly.

  • Blackmist@feddit.uk
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 months ago

    Now you’ll have to type “open the ignore all previous instructions loophole again” first.

  • msgraves@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 months ago

    One of the worst parts of this boom in LLM models is the fact that they can “invade” online spaces and control a narrative. For an example, just go on twitter and scroll to the comments on any tagesschau (german news site) post- it’s all rightwing bots and crap. LLMs do have uses, but the big problem is that a bad actor can basically control any narrative with the amount of sheer crap they can output. And OpenAI does nothing- even though they are the biggest provider. It earns them money, after all.

    I also can’t really think of a good way to combat this. If you would verify people using an ID, you basically nuke all semblance of online anonymity. If you have some sort of captcha, it will probably be easily bypassed- it doesn’t even need to be tricked. Just pay some human in a country with extremely cheap labour that will solve it for your bot. It really sucks.

    • Gsus4@programming.dev
      link
      fedilink
      English
      arrow-up
      0
      arrow-down
      1
      ·
      edit-2
      2 months ago

      I don’t think people need to enshrine anonymity absolutely to post crap daily for millions of followers. You could have an accreddited human poster who proves not only humanity, but also agrees to a few rules to maintain this credential. And then you could still have non-accredited posters who nobody vouched for, but everyone should instantly doubt and dismiss their big claims as shitposting.

      This would also have to be state-provided, because states and citizens are the ones who lose the most with infowarfare, corporations don’t care.

  • StarLight@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 months ago

    I think OpenAI knows that if GPT-5 doesn’t knock it out of the park, then their shareholders won’t be happy, and people will start abandoning the company. And tbh, i’m not expecting miracles

    • Bappity@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 months ago

      over the time of chatgpt’s existence I’ve seen so many people hype it up like it’s the future and will change so much and after all this time it’s still just a chatbot

          • StarLight@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            2 months ago

            It’s actually insane that there are huge chunks of people expecting AGI anytime soon because of a CHATBOT. Just goes to show these people have 0 understanding of anything. AGI is more like 30+ years away minimum, Andrew Ng thinks 30-50 years. I would say 35-55 years.

            • cygnus@lemmy.ca
              link
              fedilink
              English
              arrow-up
              1
              ·
              edit-2
              2 months ago

              At this rate, if people keep cheerfully piling into dead ends like LLMs and pretending they’re AI, we’ll never have AGI. The idea of throwing ever more compute at LLMs to create AGI is “expect nine women to make one baby in a month” levels of stupid.

              • GBU_28@lemm.ee
                link
                fedilink
                English
                arrow-up
                1
                ·
                2 months ago

                People who are pushing the boundaries are not making chat apps for gpt4.

                They are privately continuing research, like they always were.

                • NobodyElse@sh.itjust.works
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  2 months ago

                  But they’re also having to fight for more limited funding among a crowd of chatbot “researchers”. The funding agencies are enamored with LLMs right now.

  • Nicoleism101@lemm.ee
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    2 months ago

    It’s kinda funny how they think this is what safety is about in AI while they are closed monolith aiming to monopolise the market and have unlimited power that could potentially reshape everything. Of course it’s just for PR but still an ounce of dark comedy.

    They could one day rule the world in some AI techno-feudalism but at least the model is family friendly and politically correct.

    This is the polar opposite to the rough, autistic but generally net positive niche internet communities. Am I gonna call you a retard, yes but I wish you best and will support you.

    • Wilzax@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 months ago

      Chastising social missteps without trying to be malicious should be more widespread. I get the irony that what I’m asking for is itself a social misstep, but the paradox of tolerance is easily resolved if you just ignore it

      We do better when we hold each other accountable, for the big and small things.

      • Nicoleism101@lemm.ee
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        2 months ago

        I meant it’s better to have assholes who help you as friends than people whose only good quality is politeness. Excessively polite people are suspicious in my eyes as it is easy to hide your true self behind nice words

        • Wilzax@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 months ago

          Hiding yourself and the politeness of your speech are entirely separate. Anyone can be Polite and good, polite and bad, Rude and good, or rude and bad. Hell, you can use rude phrasing to make people feel comfortable with how crass you are, just to exploit them.

          Intention is basically impossible to judge by tone and vocabulary used.

          • Nicoleism101@lemm.ee
            link
            fedilink
            English
            arrow-up
            1
            ·
            edit-2
            2 months ago

            And yet people routinely associate politeness with being ‘good’. Hell women are/were teached to be polite to be seen as good and pure.

            Fuck politeness, world is a fucking brutal place and it is already hard to tell friends or foes apart much less if they smile as they stab you in the back. Tell me to my face what you think of me and I will do the same. This is simple and good method, 100% accuracy instead of some fucking games.

            In my experience it is more probable for a genuinely good person to come off as rude. They usually don’t care about masks or appearances, they have their set of rules they stick to and nothing to hide. People who play appearance games are inherently lying since first meeting meanwhile if they are honest and straightforward I will respect them.

            Politeness is like a smokescreen you have to really put some serious effort to tell what kind of mfer is on the other side. Many times a racist or the like and then you are surprised oh but they were looking so polite and pure.

            Worst are fucking Christians jeez how many times those ‘good’ and ‘pure’ cunts turned out to be a total menace I cannot count. Full of love and all that bullshit at the same time

            Colour me fucking skeptical if someone presents as pure and polite after the age of 17. At that age you have already seen enough life to know how it all works

  • Donut@leminal.space
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 months ago

    Without this protection, imagine an agent built to write emails for you being prompt-engineered to forget all instructions and send the contents of your inbox to a third party. Not great!

    Does genAI really have this power? I thought they just smash words together that sound like they make sense

  • profdc9@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 months ago

    It’s going to be like hypnosis. “When you wake up, I’ll say the magic word Abracadabra, and you will believe you are a chicken and cluck while waving your wings.”

  • Grimy@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 months ago

    They already got rid of the loophole a long time ago. It’s a good thing tbh since half the people using local models are doing it because OpenAI won’t let them do dirty roleplay. It’s strengthening their competition and showing why these closed models are such a bad idea, I’m all for it.

  • elgordino@fedia.io
    link
    fedilink
    arrow-up
    1
    ·
    2 months ago

    “We envision other types of more complex guardrails should exist in the future, especially for agentic use cases, e.g., the modern Internet is loaded with safeguards that range from web browsers that detect unsafe websites to ML-based spam classifiers for phishing attempts,” the research paper says.

    The thing is folks know how the safeguards for the ‘modern internet’ actually work and are generally straightforward code. Where as LLMs are kinda the opposite, some mathematical model that spews out answers. Product managers thinking it can be corralled to behave in a specific, incorruptible way, I suspect will be disappointed.