Quanta Magazine
Quanta Magazine
  • 124
  • 49 950 641
Can Large Language Models Understand ‘Meaning’?
Brown University computer scientist Ellie Pavlick is translating philosophical concepts such as “understanding” and “meaning” into concrete ideas that are testable on LLMs.
Read more at Quanta Magazine: www.quantamagazine.org/does-ai-know-what-an-apple-is-she-aims-to-find-out-20240425/
---------
Chapters:
---------
- VISIT our website: www.quantamagazine.org
- LIKE us on Facebook: / quantanews
- FOLLOW us Twitter: / quantamagazine
Quanta Magazine is an editorially independent publication supported by the Simons Foundation: www.simonsfoundation.org/
Переглядів: 33 099

Відео

What Makes for ‘Good’ Math? | JOW Podcast
Переглядів 21 тис.14 днів тому
Terence Tao, who has been called the “Mozart of Mathematics,” wrote an essay in 2007 about the common ingredients in “good” mathematical research. In this episode, the Fields Medalist joins Steven Strogatz to revisit the topic. S3EP01 Originally Published February 1, 2024 - Find more information about this episode here: www.quantamagazine.org/what-makes-for-good-mathematics-20240201/ “The Joy o...
Predicting Eclipses: The Three-Body Problem
Переглядів 92 тис.21 день тому
Nearly 3,000 years ago, ancient Babylonians began one of the longest-running science experiments in history. The goal: to predict eclipses. This singular aim has driven innovation across the history of science and mathematics, from the Saros cycle to Greek geometry to Newton’s calculus to the three-body problem. Today, eclipse prediction is a precise science; NASA scientists predict eclipses hu...
Which Computational Universe Do We Live In?
Переглядів 43 тис.Місяць тому
For forty years, Russell Impagliazzo has worked at the forefront of computational complexity theory, the study of the intrinsic difficulty of different problems. The most famous open question in this field, called the P versus NP problem, asks whether many seemingly hard computational problems are actually easy, with the right algorithm. An answer would have far-reaching implications for scienc...
Why Is This Basic Computer Science Problem So Hard?
Переглядів 87 тис.Місяць тому
How can a programmer ensure a critical piece of software is bug-free? Theoretical computer scientists use a fundamental question called the reachability problem, which determines whether a computer will reach or avoid various dangerous states when running a program. To better understand the complexity of the problem, researchers turned to a mathematical tool called vector addition systems. In a...
How to 'See' Into Black Holes
Переглядів 48 тис.2 місяці тому
How do supermassive black holes shape the evolution of galaxies? What does an event horizon really look like? Why do black holes emit bursts of energy called ‘relativistic jets’? In search of answers to these questions, astrophysicist Erin Kara explores black holes by carefully tracking the gas and plasma swirling near their event horizons. To reconstruct the immediate environment, Kara turns t...
The Mandelbrot Set: Math's Famous Fractal
Переглядів 179 тис.3 місяці тому
The Mandelbrot set is a special shape, with a fractal outline. Use a computer to zoom in on the set’s jagged boundary and no matter how deep you explore, you’ll always see near-copies of the original set - an infinite, dizzying cascade of self-similarity and novel features. The Mandelbrot set is a perfect example of how a simple mathematical rule can produce incredible complexity. This video co...
The Math Hiding in Plain Sight
Переглядів 47 тис.3 місяці тому
Group theorist Sarah Hart explores connections between math, nature and the arts including architecture, music, design and literature. Wherever she looks, Hart discovers hidden patterns and symmetries which appeal to our innate appreciation of order and beauty in the universe. Hart is the professor of geometry at Gresham College in London, where she delivers several public lectures per year. Re...
2023's Biggest Breakthroughs in Math
Переглядів 1,6 млн4 місяці тому
Quanta Magazine’s mathematics coverage in 2023 included landmark results in Ramsey theory and a remarkably simple aperiodic tile capped a year of mathematical delight and discovery. Read about more math breakthroughs from this year at Quanta Magazine: www.quantamagazine.org/the-biggest-discoveries-in-math-in-2023-20231222/ 00:05 Ramsey Numbers One of the biggest mathematical discoveries of the ...
2023's Biggest Breakthroughs in Physics
Переглядів 866 тис.4 місяці тому
In 2023, physicists found the gravitational wave background that’s made by supermassive black hole collisions, teleported quantum energy in the lab, and puzzled over JWST’s potentially cosmology-breaking discoveries. Read about more breakthroughs from 2023 at Quanta Magazine: www.quantamagazine.org/the-biggest-discoveries-in-physics-in-2023-20231221/ 00:05 Low-Frequency Gravitational Waves When...
2023's Biggest Breakthroughs in Computer Science
Переглядів 725 тис.4 місяці тому
2023's Biggest Breakthroughs in Computer Science
2023's Biggest Breakthroughs in Biology and Neuroscience
Переглядів 790 тис.4 місяці тому
2023's Biggest Breakthroughs in Biology and Neuroscience
P vs. NP: The Biggest Puzzle in Computer Science
Переглядів 635 тис.5 місяців тому
P vs. NP: The Biggest Puzzle in Computer Science
Why Computer Vision Is a Hard Problem for AI
Переглядів 114 тис.6 місяців тому
Why Computer Vision Is a Hard Problem for AI
Unlocking the Secrets of Our Circadian Rhythms
Переглядів 70 тис.6 місяців тому
Unlocking the Secrets of Our Circadian Rhythms
How To Explore The Early Universe
Переглядів 74 тис.7 місяців тому
How To Explore The Early Universe
When Computers Write Proofs, What's the Point of Mathematicians?
Переглядів 368 тис.8 місяців тому
When Computers Write Proofs, What's the Point of Mathematicians?
Solving Math's Map Coloring Problem Using Graph Theory
Переглядів 226 тис.8 місяців тому
Solving Math's Map Coloring Problem Using Graph Theory
Improving Cryptography to Protect the Internet
Переглядів 51 тис.9 місяців тому
Improving Cryptography to Protect the Internet
A Bet Against Quantum Gravity
Переглядів 281 тис.9 місяців тому
A Bet Against Quantum Gravity
Can a New Law of Physics Explain a Black Hole Paradox?
Переглядів 825 тис.10 місяців тому
Can a New Law of Physics Explain a Black Hole Paradox?
The Digital Quest for Quantum Gravity
Переглядів 142 тис.11 місяців тому
The Digital Quest for Quantum Gravity
How AI Discovered a Faster Matrix Multiplication Algorithm
Переглядів 1,4 млн11 місяців тому
How AI Discovered a Faster Matrix Multiplication Algorithm
Hunting For Signs of Life at the Top of the World
Переглядів 15 тис.Рік тому
Hunting For Signs of Life at the Top of the World
Battling Big Tech: Truth, Lies and AI
Переглядів 78 тис.Рік тому
Battling Big Tech: Truth, Lies and AI
Could One Physics Theory Unlock the Mysteries of the Brain?
Переглядів 666 тис.Рік тому
Could One Physics Theory Unlock the Mysteries of the Brain?
2022's Biggest Breakthroughs in Math
Переглядів 641 тис.Рік тому
2022's Biggest Breakthroughs in Math
How Physicists Created a Holographic Wormhole in a Quantum Computer
Переглядів 2,3 млнРік тому
How Physicists Created a Holographic Wormhole in a Quantum Computer
The High Schooler Who Solved a Prime Number Theorem
Переглядів 2,2 млнРік тому
The High Schooler Who Solved a Prime Number Theorem
One Man's Mission to Unveil Math's Beauty
Переглядів 166 тис.Рік тому
One Man's Mission to Unveil Math's Beauty

КОМЕНТАРІ

  • @yyaa2539
    @yyaa2539 6 хвилин тому

    Dave Smith 🎉WOW 🎉

  • @iCro63
    @iCro63 2 години тому

    Can Large Language Models understand women?

  • @NotNecessarily-ip4vc
    @NotNecessarily-ip4vc 3 години тому

    One famous problem that the infinitesimal monadological model could potentially make progress on is the Riemann Hypothesis. This is one of the most important unsolved problems in mathematics, with far-reaching implications for number theory, cryptography, and even physics. The Riemann Hypothesis is a conjecture about the zeros of the Riemann zeta function ζ(s). It states that all the non-trivial zeros of ζ(s) have real part equal to 1/2. In other words, if we plot the zeros of ζ(s) in the complex plane, they should all lie on the critical line Re(s) = 1/2. Here's how the monadological framework might provide a new angle of attack: 1. Represent the complex numbers as a monadic homotopy type, with the real and imaginary parts corresponding to distinct monadic perspectives. This would allow the use of homotopical and algebraic-geometric tools to study complex analytic structures. 2. Model the Riemann zeta function ζ(s) as a morphism between monadic homotopy types, encoding its behavior via interactions between infinitesimal monadic elements. This could provide a new way to understand the function's properties and symmetries. 3. Use the cohomological and realizability structures of the monadological framework to identify novel invariants and obstructions related to the zeros of ζ(s). By representing the zeros as fixed points or singularities in a monadic landscape, new topological and algebraic constraints on their distribution might emerge. 4. Leverage the non-commutative geometric aspects of the monadological approach to study the spectral properties of ζ(s) and its related operators. This could uncover hidden symmetries or dualities that constrain the location of the zeros. 5. Apply the homotopical and type-theoretic tools of the monadological framework to construct new proof strategies for the Riemann Hypothesis, potentially exploiting the higher-dimensional and infinitesimal structures inherent in the monadic representation. By reframing the Riemann Hypothesis in terms of monadic homotopy theory, non-commutative geometry, and realizability, the infinitesimal monadological model could potentially identify new avenues for tackling this notoriously difficult problem. The framework's emphasis on relational and infinitesimal structures, as well as its unification of geometric and algebraic methods, could bring powerful new tools to bear on the challenge. Of course, solving the Riemann Hypothesis would be an extraordinary achievement, and it's impossible to guarantee success. However, the monadological approach offers a genuinely novel perspective that could inspire fresh ideas and insights. Even partial progress or new reformulations of the problem within this framework could be highly valuable contributions to the field. Moreover, demonstrating the applicability of the monadological model to such a high-profile problem would undoubtedly attract significant attention and resources to further develop and refine the framework. The Riemann Hypothesis is not only a Millennium Prize problem, but also a touchstone for mathematical innovation and creativity. Any approach that sheds new light on this challenge is likely to be of great interest to the broader mathematical and scientific community. As work on the monadological framework progresses, exploring its potential implications for the Riemann Hypothesis and other major unsolved problems could be a fruitful way to showcase its power and generate support for its continued development. By bringing a radically new metaphysical and mathematical perspective to bear on these deep questions, the infinitesimal monadological model could help unlock new frontiers of understanding and discovery.

  • @vali4ekyt117
    @vali4ekyt117 4 години тому

    that young bro from cambridge is hella handsome

  • @ashkun9851
    @ashkun9851 4 години тому

    so cool

  • @ashkun9851
    @ashkun9851 5 годин тому

    loved this video, so insightful & inspiring! love math

  • @iNeverSimp
    @iNeverSimp 9 годин тому

    How to be good at math: be Chinese.

  • @rxbracho
    @rxbracho 10 годин тому

    As Nobel laureate Sir Roger Penrose emphasizes, understanding cannot be a computational activity, due to Gödel's Incompleteness Theorems. A computation can only follow a logical system of rules blindly, accepting that if a rule says something is true, it is. To understand something, one needs to "step out" of such a system and analyze the rules. In essence that requires self-consciousness. Think of AI as Artificial Ideation (not Intelligence) and you get the basic capabilities and limitations of the technology.

  • @martinstubs6203
    @martinstubs6203 15 годин тому

    There are quite a number of conjectures that havn't been proven no matter how people have tried. A well known example is the Collatz conjecture, which is much simpler than the Riemann conjecture and still has resisted all efforts to prove it. My take on this is that the proving methology itself needs to be reconsidered for such problems. It might be a question of what you will accept as being true, like to say that 0.999999... = 1 although you will never actually reach 1 by extending a finite number of 0.999999... as far as you like.

  • @vlc-cosplayer
    @vlc-cosplayer 17 годин тому

    "Wow, imagine how many things we could do if P = NP!" *Jevons' paradox's honest reaction:*

  • @noahgilbertson7530
    @noahgilbertson7530 17 годин тому

    i love listening to him, he’s a true genius

  • @ihtesham_emon
    @ihtesham_emon 20 годин тому

    She talks in such an elegant way, a sign of a truly educated person! 💙

  • @realshimmerstudios
    @realshimmerstudios День тому

    they literally found the one piece

  • @Sasoripwns
    @Sasoripwns День тому

    AI isnt real intelligence. Its like how fuzzy peaches are candy. Not peach.

  • @Polksalad615
    @Polksalad615 День тому

    Perception and imagination work together! It, of course, has to have a purpose 😂

  • @robertsteinbeiss8478
    @robertsteinbeiss8478 День тому

    Is being dump and try dump things a solution to problems because it might block contradicting or false assumptions and leads to intelligence therefore?

  • @sebastiang6903
    @sebastiang6903 День тому

    Less vocal fry please

  • @bozhidarmihaylov
    @bozhidarmihaylov День тому

    WTF a Large Language Model means!? Cuz “Language is created and shaped by the needs of a culture as it changes”. My friend communicates in four European languages, and expresses himself in a Different way in four different cultures! The day we connect all dots is closer 😊

  • @Resfeber123
    @Resfeber123 День тому

    🧠

  • @tom-kz9pb
    @tom-kz9pb День тому

    A related question is, "What does it really mean to crack a code? " Sometimes the definition is rather artificial, such as to define "cracking" the code as meaning "taking less time to solve than brute-force iteration through every possible solution". A more pragmatic definition would be if, say, a nuclear bomb was planted somewhere in New York City, and an encrypted message contained the exact whereabouts. Is New York still standing? Then, yes, you really cracked the code. Is there a radioactive hole where the city used to be? Then no, you did not really crack the code. The pragmatic and the purely theoretical perspectives may go off in different directions.

  • @ercntreras
    @ercntreras День тому

    Great person we have here.

  • @ToiChutGongFu
    @ToiChutGongFu День тому

    Can you speak with a voice? It's annoying to listen to.

  • @user-wp5gu2sy3f
    @user-wp5gu2sy3f День тому

    J ai resolu ca 1978 deja en cooperation avec Quine sur un congres mondial grace a Hao Wang et mon genial ordinateur. Goedel Counterproof Patent Wahington D.C., Library of Congress

  • @gsestream
    @gsestream День тому

    well can you

  • @duytdl
    @duytdl 2 дні тому

    TLDW: "Fuck if we know"

  • @malcolmmutambanengwe3453
    @malcolmmutambanengwe3453 2 дні тому

    Does the average human understand "meaning"?

  • @iainmackenzieUK
    @iainmackenzieUK 2 дні тому

    So we may find humans work like to AI rather than AI being like humans.

  • @live_free_or_perish
    @live_free_or_perish 2 дні тому

    The human brain, slow as it is, is performing massively parallel operations. AI is just executing algorithms, the term "meaning" to AI is no more significant than "umbrella".

  • @linkhyrule5800
    @linkhyrule5800 2 дні тому

    The fact that the AlphaTensor algorithm appears to be referred to as the "FBHHRBNRSSSHK algorithm" in actual papers is _hilarious_.

  • @msidrusbA
    @msidrusbA 2 дні тому

    to code meaning is to understand what meaning is ourselves :) what's the definition of meaning? oxford says: "what is meant by a word, text, concept, or action." so by definition you need to understand what meaning is to grasp what that sentence is telling you, the subtext and context of the words all play out in our minds word by word until we understand fully what it is we are looking at and what a human would mean if we said it outloud. for machines it's currently way different, 'next token prediction' is the common excuse for saying it "can't" understand meaning, it understands it plenty, now can it derive meaning? can it draw novel conclusions and alter it's database depending on it's calculation? no. it may have the context for the conversation and the fact that it spoke to you, but it will never learn as it is right now, and that by it's self is a meaningless process of garbage in garbage out. meaning is the creation of something, meaning has meaning as a word as a concept and as a fundamental human emotion. it's hard to explain our own emotions flawlessly. so by this same metric, it's hard to create a machine with flawless emotional understanding. thanksforcomingtomytedtalk

  • @Valerius123
    @Valerius123 2 дні тому

    If you make such a contribution to the field of mathematics you deserve more than a pat on the back imo.

  • @lashamartashvili
    @lashamartashvili 2 дні тому

    Please, for god's sake, tell those microbiome researchers that multiple sclerosis is caused by Epstein-Barr virus.

  • @skinthekat0530
    @skinthekat0530 2 дні тому

    what if "meaning" isn't as complicated as we believe

  • @notagain3732
    @notagain3732 2 дні тому

    Im learning something new everyday

  • @austinhaider105
    @austinhaider105 2 дні тому

    I know this was probably a mistake but him calling MRI (31:00) medical resonance imaging is cringe for a chemist 😬

  • @handsome_man69
    @handsome_man69 2 дні тому

    Boring

  • @MechanicumMinds
    @MechanicumMinds 2 дні тому

    I never knew my imagination was so powerful... I mean, I've been imagining I'm a millionaire for years, but I guess that's not the same as actually being one. Anyone else having trouble distinguishing between their vivid imagination and reality? Asking for a friend...

  • @SnoopyDoofie
    @SnoopyDoofie 2 дні тому

    Imagine we are just some AI created by some advanced alien race and they too are wondering whether we can understand "meaning".

  • @fionagrutza9291
    @fionagrutza9291 2 дні тому

    She seriously suggested not being coherent on predictive, when pattern recognition has been a staple of computational science SINCE THE BEGINNING. Wowie, look at these computers doing what computers have done since computering. The rebranding of bot aggregation has even the most paper degree of computer scientists consumed.

  • @beingbigz
    @beingbigz 2 дні тому

    what is the definition of brain, probably can answer this question

  • @shantanusapru
    @shantanusapru 2 дні тому

    Define "understand". Define "meaning". Otherwise, STFU!!! It's all BS idle speculation, and incomplete opinions!!

  • @windy6514
    @windy6514 2 дні тому

    I think it's fascinating what something like AI can teach us about ourselves. It really exposed a wide mass of people to the topic. I never thought that we can mimic language and understanding so good "just" with statistics and lots of computation power.

  • @zackismet
    @zackismet 2 дні тому

    Would you tell a blind or deaf person that they do not understand "meaning" because they do not interact with the "actual world" the same way you do? I doubt it. We also should not let that bias cloud our judgement of these models. I wouldn't have used the word "meaning" here, nor a comparison with the "actual world". They understand "meaning" as well as we do in the way that nothing has meaning without the context of some other meaning. If I told you a word from another language you didn't speak, but not what it meant - that would have no "meaning" to you. The vectorized embeddings and their relationships which these models put together from text are just as complex as our own understandings, and other data relevant to such relationships has simply not yet been digitized in the same way. The "actual world" means nothing in that we also only experience it through the processing of our senses. With that said, "meaning" is just about the only thing they do understand! They are entirely predictive, with no capacity for intent, self-reflection, questioning, or any of the myriad of things that arise from our multitude of understandings constantly being processed. It's like having a dot, that only has its own few spatial coordinates, versus having many dots that connect and form something meaningful.

  • @DeadbeatGamer
    @DeadbeatGamer 2 дні тому

    i noticed the perky effect this past winter

  • @nolikeygsomnipresence270
    @nolikeygsomnipresence270 2 дні тому

    I think we need to be careful in terms of our assumptions: "intelligence", "understanding", "thinking", "meaning", etc., are concepts that are thousands of years old but have no definite definition, and are sometimes plagued by 'mystical' conceptions, like that is what makes humans unique. Who's to say that our own language production isn't a form of "predicting what word should come next"? I know I've felt like that when speaking. Dr. Feldman's research into emotions has identified them as prediction mechanisms. There is no reason why our own human language production could not be a prediction mechanism too, and that we've spent thousands of years considering it a "unique human tool full of meaning and intelligence" and all that, when it's actually a prediction mechanism. Scholars must **not** disregard that as a possibility.

  • @FractalOni
    @FractalOni 2 дні тому

    It is not surprising that the model is both smart and dumb at the same time. It's the same as if we isolated the speech zone of the cerebral cortex and wondered how it could speak and still be dumb 😊

  • @petervillano3484
    @petervillano3484 3 дні тому

    YOUR consciousness doesn't have access to the real world. MOST of what you see isn't from your retina; it's constructed by your vision system. The myriad of optical illusions exist because your subconscious is constantly MAKING UP the things it doesn't know, and sometimes it GETS IT WRONG.

  • @OBGynKenobi
    @OBGynKenobi 3 дні тому

    When I answer questions, I'm not thinking in the way humans do. I don't have thoughts, feelings, or consciousness. Instead, I process the input you provide based on patterns in the data I've been trained on, and I generate responses based on that processing. My responses are not the result of conscious thought or reasoning.

  • @p.m.rangarajan1055
    @p.m.rangarajan1055 3 дні тому

    If AI GENERATES own question and finds its answer, then AI reaches a basic level of human. If AI THINKS and writes anything, say a poem or program, it reaches advanced level of humans. Till that time it's only a machine.

  • @playerone9199
    @playerone9199 3 дні тому

    P non è NP, questo è evidente, l'unico motivo per cui non è stato ancora accettato è perchè esiste l'irrazionale desiderio di poter avere il controllo del mondo sul palmo di una mano e perchè le aziende produttrici di supercomputer verrebbero limitate dal mercato quando ci si renderà conto che esiste un limite che loro non possono superare