#82 - Dr. JOSCHA BACH - Digital Physics, DL and Consciousness [UNPLUGGED]

AI Helps Ukraine - Charity Conference
A charity conference on AI to raise funds for medical and humanitarian aid for Ukraine
https://aihelpsukraine.cc/

YT version: https://youtu.be/LgwjcqhkOA4

Support us!
https://www.patreon.com/mlst 

Dr. Joscha Bach (born 1973 in Weimar, Germany) is a German artificial intelligence researcher and cognitive scientist focusing on cognitive architectures, mental representation, emotion, social modelling, and multi-agent systems. 
http://bach.ai/
https://twitter.com/plinz

TOC:
[00:00:00] Ukraine Charity Conference and NeurIPS 2022
[00:03:40] Theory of computation, Godel, Penrose
[00:11:44] Modelling physical reality
[00:15:19] Is our universe infinite?
[00:24:30] Large language models, and on DL / is Gary Marcus hitting a wall?
[00:45:17] Generative models / Codex / Language of thought
[00:58:46] Consciousness (with Friston references)

References:

Am I Self-Conscious? (Or Does Self-Organization Entail Self-Consciousness?) [Friston]
https://www.frontiersin.org/articles/10.3389/fpsyg.2018.00579/full

Impact of Pretraining Term Frequencies on Few-Shot Reasoning [Yasaman Razeghi]
https://arxiv.org/abs/2202.07206

Deep Learning Is Hitting a Wall [Gary Marcus]
https://nautil.us/deep-learning-is-hitting-a-wall-238440/

Turing machines
https://en.wikipedia.org/wiki/Turing_machine
Lambda Calculus
https://en.wikipedia.org/wiki/Lambda_calculus
Godel's incompletness theorem
https://en.wikipedia.org/wiki/G%C3%B6del%27s_incompleteness_theorems
Oracle machine
https://en.wikipedia.org/wiki/Oracle_machine