a theory of AI

2019 The unreasonable effectiveness of deep learning in artificial intelligence Terrence J. Sejnowski

RG and Deep Learning

The new work, completed by Pankaj Mehta of Boston University and David Schwab of Northwestern University, demonstrates that a statistical technique called “renormalization,” which allows physicists to accurately describe systems without knowing the exact state of all their component parts

• Learning hierarchical category structure in deep neural networks

Information Bottleneck METHOD

Information Bottleneck sheds insight into AI as well as human brain

Learnability can be undecidable

We describe simple scenarios where learnability cannot be proved nor refuted using the standard axioms of mathematics. The main idea is to prove an equivalence between learnability and compression.