AI Latest Research & Developments - With Digitalent & Mike Nedelko

Latest Artificial Intelligence Latest R&D Session - With Digitalent & Mike Nedelko - Episode (009)

Dillan Leslie-Rowe Season 1 Episode 9

Use Left/Right to seek, Home/End to jump to start or end. Hold shift to jump forward or backward.

0:00 | 1:05:17

In this conversation, Mike discusses the latest developments in AI and machine learning, focusing on recent research papers that explore the reasoning capabilities of large language models (LLMs) and the implications of self-improving AI systems. 

The discussion includes a critical analysis of Apple's paper on LLM reasoning, comparisons between human and AI conceptual strategies, and insights into the Darwin-Girdle machine, a self-referential AI system that can modify its own code. Mike emphasizes the importance of understanding the limitations and capabilities of AI in various domains, particularly in high-stakes environments.

Highlights:

- Apple's paper claims that large language models (LLMs) struggle with reasoning.

- The importance of understanding LLMs' reasoning capabilities.

- Understanding controlled puzzles to evaluate LLM reasoning in isolation.
Findings suggest that LLMs face fundamental scaling limitations in reasoning tasks.

- Comparing human and LLM conceptual strategies using information theory.
LLMs are statistically efficient but may lack functional richness compared to human cognition.

- Exploring the distinction between factual knowledge and logical reasoning in AI. Self-improving AI systems, like the Darwin-Girdle machine, represent a significant advancement in AI technology.