Oh it learned enough from code that it has developed some basic, and hear me out of this, artificial verbal intelligence. I know I know, not just pattern matching, but actual artificial intelligence at a low level.
Please don’t downvote me (sorry don’t remember if this is fuckai or not) but I’m just saying it’s one possible explanation to this phenomenon you describe.
Don’t get me wrong, the models are really impressive, and something I would have called impossible two years ago. From an information theory point of view, it is super cool how they manage to compress so much knowledge and connections in so little size (relatively speaking).
Itelligence is very ill defined, as someone else pointed out. It still has a very weird model of the world (if at all).
My point is however, it sometimes seems to be too good at guessing facts that should not be guessable from the inputs and publically available information alone.
I mean even if it did train on the proprietary code it can’t memorize it. It has to “learn what code like this looks like”. It has to figure out what the function is. That can I think only be called verbal intelligence. The ability to understand what is meant behind words. Not very good yet but having to pretend it’s not there is just denialism. Denialism exactly like climate change denial. And of course some AI fans do have AI psychosis, different side of the same coin.
The whole dancing around LLMs clearly being able to reason (which can be shown in scientific experiments) and therefor clearly having some sort intelligence is so stupid. Because meanwhile 90% of lemmy users are too brainwashed to accept basic reality any more.
Because you know, this isn’t just funny. There are real danger as the technology progresses. But it’s politically incorrect and gets you massive downvotes in the wrong community if you talk about those dangers. You can’t talk about facts any more.
It’s not just about the historical facts about e.g. the coup in Ukraine that you can’t talk objectively about any more. Facts in general become anathema. Only the feeling of correctness and manufacturing social consent matters. Collectively we are becoming more and more stupid animals. We are trained to become less sentient or sapient. Less able to perceive and react to reality and more and more act on trained and instinctual impulses. But I see little difference between the MAGA fascists and like 90% of lemmy users now. And if you don’t want to offend (or get fired) you have to mask and that seemed funny in your post.
There are studies and tools like LiCoEval and others that investigate LLM memorization. It does happen but it’s not all the time, and it’s very infrequent for real world (complex) examples. Mostly this concerns textbook examples or standard boilerplate code - from what I read. And I obviously don’t know the specific example mentioned. This is also a problem that can be fixed.
But I’m really just half mocking the very careful language used by the comment I replied to.
Oh it learned enough from code that it has developed some basic, and hear me out of this, artificial verbal intelligence. I know I know, not just pattern matching, but actual artificial intelligence at a low level.
Please don’t downvote me (sorry don’t remember if this is fuckai or not) but I’m just saying it’s one possible explanation to this phenomenon you describe.
Don’t get me wrong, the models are really impressive, and something I would have called impossible two years ago. From an information theory point of view, it is super cool how they manage to compress so much knowledge and connections in so little size (relatively speaking).
Itelligence is very ill defined, as someone else pointed out. It still has a very weird model of the world (if at all).
My point is however, it sometimes seems to be too good at guessing facts that should not be guessable from the inputs and publically available information alone.
I mean even if it did train on the proprietary code it can’t memorize it. It has to “learn what code like this looks like”. It has to figure out what the function is. That can I think only be called verbal intelligence. The ability to understand what is meant behind words. Not very good yet but having to pretend it’s not there is just denialism. Denialism exactly like climate change denial. And of course some AI fans do have AI psychosis, different side of the same coin.
The whole dancing around LLMs clearly being able to reason (which can be shown in scientific experiments) and therefor clearly having some sort intelligence is so stupid. Because meanwhile 90% of lemmy users are too brainwashed to accept basic reality any more.
Because you know, this isn’t just funny. There are real danger as the technology progresses. But it’s politically incorrect and gets you massive downvotes in the wrong community if you talk about those dangers. You can’t talk about facts any more.
It’s not just about the historical facts about e.g. the coup in Ukraine that you can’t talk objectively about any more. Facts in general become anathema. Only the feeling of correctness and manufacturing social consent matters. Collectively we are becoming more and more stupid animals. We are trained to become less sentient or sapient. Less able to perceive and react to reality and more and more act on trained and instinctual impulses. But I see little difference between the MAGA fascists and like 90% of lemmy users now. And if you don’t want to offend (or get fired) you have to mask and that seemed funny in your post.
Anyway, sorry just rambling lol
i would err towards it ingesting proprietary code before this, it’s not wrong but AI spits out copyrighted and should-be private stuff all the time.
There are studies and tools like LiCoEval and others that investigate LLM memorization. It does happen but it’s not all the time, and it’s very infrequent for real world (complex) examples. Mostly this concerns textbook examples or standard boilerplate code - from what I read. And I obviously don’t know the specific example mentioned. This is also a problem that can be fixed.
But I’m really just half mocking the very careful language used by the comment I replied to.