188

Quote of the day by computer scientist Judea Pearl: 'Deep learning has instead given us machines with truly impressive abilities but no intelligence' — capturing the central fault line in modern AI.

#technology
TechRadar QOTD: 'Deep learning has given us machines with truly impressive abilities but no intelligence" Although LLMs and similar systems have impressed us, they haven't yet demonstrated real humanlike smarts www.techradar.com

check post at origin

29 comments

log in to comment.

  • @eicker@lemmy.worldOP · 2d ago

    AI can write a convincing essay about fire, but it has never burned a finger. Pearl’s point is less that these systems are useless and more that fluency gets mistaken for understanding. Silicon Valley saw a spectacular autocomplete and immediately started selling it as a digital philosopher. The marketing department achieved AGI first.

    • Yes, LLMs are incredible tools if used in appropriate situations by people who understand LLMs’ limitations. Like any other tool, actually. Give a drill to an idiot and just wait for the disaster.

  • @red_tomato@lemmy.world · 2d ago

    The quote is from 2018. Back then most neural networks were still mostly single purpose - far from today’s all-in-one package. Text generation was barely working at all.

    • @Wildmimic@anarchist.nexus · 2d ago

      The underlying problems are still the same. Transformer models do not have an inkling of intelligence, and they still don’t have an internal model of the world around them. Creativity is also non-existent, which is a hard requirement if you want these things to actually create something new instead of rehashing what already exists.

      • @redballooon@lemmy.world · 2d ago

        Spoken with the confidence of a non user.

        • @Wildmimic@anarchist.nexus · 2d ago

          I am not a non-user. I run local models, because i am a tech enthusiast, and am watching the space closely. I will never spend a cent or use the offerings of OpenAI and Anthropic tho - i will not finance the people who are providing the tools to bind us all.

          • @redballooon@lemmy.world · 2d ago

            Open weight models are not far behind and good enough to get software developers jobless, but there is a huge difference in what you can do with 1M context and 500token/sec or 60k context and 40token/sec.

            • @Wildmimic@anarchist.nexus · 2d ago

              Sure! End the AI Bubble and i’ll go ahead and buy a bunch of H200’s.

              But for real, if you structure your tasks well, you can get by for most things with local models, and for a small business in IT, investing in dedicated hardware you own is a smart move. The employer of an acquaintance of mine bought some inference hardware for his 5 engineer business, and they rely mostly on that. Around 80% of all tasks are done by a GLM5.3 model, and while they currently still use Claude for some things, the percentage of external inference has dropped dramatically in the last months, because people have adapted on how to structure tasks for the local model.

              Noone can explain to me how Claude, OpenAI and the NeoClouds plan to become profitable businesses when you can reduce inference costs by 90% by getting your own inference - and it’s not even that hard to set up. if you already have IT staff for your inhouse stuff, they will probably manage.

        • @vagrancyand@sh.itjust.works low rep · 2d ago

          Hey that’s a good zinger, good work. I found an article to help you take down that AI Hater. If you want me to jazz it up, or reword future zingers for better impact, just let me know. I’m down for anything.

      • @robert@piefed.ca · 2d ago · edited

        LLMs have made a number of significant mathematical discoveries in the past year. Some of them were problems that had significant prize money attached and were considered some of the biggest open problems in mathematics. This has been so disruptive that Terrance Tao, who is widely considered to be the worlds greatest living mathematician, has spent considerable time publicly grappling with how the field of mathematics should proceed now that AI is in the picture (for example, he thinks less importance should be placed on discovery, since that is now trivial, and more emphasis should be placed on understanding).

        I am sympathetic to criticisms of LLMs, but these criticisms need to be grounded in reality. We can’t just put our head in the sand. To say that AI has “not an inkling of intelligence” is just factually inaccurate at this point.

        • @Wildmimic@anarchist.nexus · 2d ago

          And we will never learn how many of these discoveries are born out of simple theft.

          Statistics do not have intelligence.

          • @robert@piefed.ca · 2d ago

            You do not simply steal groundbreaking mathematical theorems. These are open problems that haven’t been solved, so prior to these AI proofs no solution had been discovered, so there was nothing there to steal.

            • @emmy5482@quokk.au · 2d ago

              Dunno about that. Cause they did steal them. Assuming their solutions are even correct, cause nobody has done peer review on them, because LLMs can’t publish and anthropic or whoever refuses to engage with the academic community.

              All this and there’s a lot of talk about stealing results among maths academics right now. Including a lack of attribution.

              So yeah. They probably did steal that shit

              • @red_tomato@lemmy.world · 2d ago · edited

                I doubt they stole the results of quasi Riemann hypothesis, unique games conjecture and exponential time hypothesis.

                • @emmy5482@quokk.au · 2d ago

                  Doubt all you like. But the idea a company stole something is hardly controversial or unlikely.

                  • @robert@piefed.ca · 2d ago · edited

                    Are you suggesting that these open problems in mathematics were in fact solved by someone who did not take any prize money for them or claim any credit, unbeknownst to the entire mathematical community, and the AI stole these secret solutions? Because in order for these solutions to be stolen that would need to be the scenario.

                    • @emmy5482@quokk.au · 2d ago

                      I am suggesting that someone was in the process of finalising publication of papers which might have asserted these. Papers such as these can take more than a year as a draft paper.

                      Draft papers are often made public for gasp peer review

                      And they robbed that person.

                      Yes

                • @Wildmimic@anarchist.nexus · 2d ago · edited

                  There have been accusations by mathematicians that OpenAI used their (non-public, but fed to OpenAIs LLM) methods. It would have been very possible to take what they already did and throw as much compute as they had available at it as soon as the hard parts were done to race ahead at the final stretch.

                  LLMs fail badly at trying to do original research. There was a study where 4 not-yet published papers were used - they gave the LLM all the data the researchers had at the beginning of the study. The LLMs were not successful at reproducing anything of it.

                  These things are not intelligent. Just because they can remix existing content does not mean they have creativity. And they miss the entire “physicality"-aspect of human existence, which is a central part of how intelligence develops - by interacting with the world and creating an internal model of how it works. They do not have a sense of self - a bunch of matrix multiplication will never achieve this.

                  They can’t be creative, because for creativity (and therefor intelligence - these two things go hand in hand) you must be able to have thoughts that have never been thought in a specific context. All these transformer models do is to remix existing thoughts - this looks a bit like intelligence, but the contained data can never be expanded outside of training a new model at a large expense. Intelligence also means to be able to learn and adapt - outside of creating a text file where LLMs can store their non-original output and reading it again, they do not have this capability, especially the “adaptation” part.

                  Do not humanize these mathematical constructs. This thinking is what got us into the current mess to begin with.

                  I personally like the technology aspect of Transformer Models a lot! But what is done with it is not in the interest of humanity - at all. Just this morning we all were able to read in the news that Anthropic uses its LLM to do a “Minority Report” and contact the police when their LLM, which is being used to scrape socials and categorize people depending on how much “Threat” they pose, tells them someone might do something illegal in the future.

                  This is the real usage of this technology. We are nearing a future where our every step, action, word, and even thoughts in some cases (through the wonders of profiling) are ingested by one of these things, and we will get sorted into bins according to threat level and how much money we can provide them with. Tip your toe over the line by saying that this sucks ass, and find yourself in your friendly neighbourhood reeducation gulag.

                  • @robert@piefed.ca · 2d ago

                    I’m not trying to say that LLMs are on the whole good for humanity. I agree with you that they’re not. And I’m not trying to argue that OpenAI never steals intellectual property. Clearly they do.

                    But these mathematical problems were solved by OpenAI’s models. That much is indisputable. There was nothing in the training data that could have given them the solutions.

                    • @Wildmimic@anarchist.nexus · 2d ago · edited

                      If you feed them the approach the mathematicians were using, they for sure can solve it! It has never been published what source material their LLM was provided with. This is the equivalent of someone telling you a result, but never telling you how they got the information needed to achieve it in the first place.

                      There is value in this technology. But we should do out best to not conflate remixing shit with intelligence - these things are not the same at all. LLMs are more like the proverbial infinite room of monkeys with typewriters, with the very important restriction that these monkeys can never type something that resembles an original thought.

            • @bold_atlas@lemmy.world · 2d ago · edited

              lol they’re so busy solving obscure esoteric problems that nobody one even knew existed that they forgot to solve the problems that people would actually notice.

              Why don’t you SHOW us the problems being solved instead of TELLING us about them?

              You ass licking parasites are such pathetic pieces of shit.

        • @bold_atlas@lemmy.world · 2d ago

          LLMs have made a number of significant mathematical discoveries in the past year.

          No.

  • @medem@lemmy.wtf · 2d ago

    Roughly citing Taleb: in a way, we have managed, indeed, to create the utopia that people and computers think alike.

    …though we didn’t manage to bring about that machines think like people, but exactly the opposite.

  • @baltakatei@sopuli.xyz · 2d ago

    My conclusion is that they’re auto-indexing books capable of rapidly temporarily integrating and regurgitating knowledge they store if you inject electricity into them, but still just books in the end after you cut their power.