# [SCI] Deep Learning

**Deep Learning** is the application of deep (many-layer) neural networks to perception and prediction tasks, achieving human or superhuman performance on image recognition, speech, language, and scientific modelling.

## Overview

The ImageNet breakthrough (Krizhevsky, Sutskever, Hinton, 2012) demonstrated that deep convolutional networks trained on GPUs massively outperformed all prior approaches for image classification. This launched the modern AI era. Transformers (Vaswani et al., 2017) replaced recurrent networks for sequence modelling, enabling GPT (2018), BERT (2018), and ultimately GPT-4 (2023) and Claude. AlphaFold (DeepMind, 2020) solved the 50-year protein structure prediction problem. Deep learning is now applied to drug discovery, materials design, climate modelling, and physics.

## Key Figures & Recognition

- **Geoffrey Hinton** (1947–), **Yann LeCun** (1960–), **Yoshua Bengio** (1964–): **Turing Award 2018**. Hinton: **Nobel Prize in Physics 2024**.
- **Ilya Sutskever** (1985–): GPT, co-founded OpenAI.
- **Demis Hassabis** (1976–): AlphaFold, AlphaGo. **Nobel Prize in Chemistry 2024**.

## Seminal Papers

- [Krizhevsky, A., Sutskever, I. & Hinton, G. "ImageNet Classification with Deep CNNs." *NeurIPS* (2012)](https://dl.acm.org/doi/10.5555/2999134.2999257)
- [Vaswani, A. et al. "Attention Is All You Need." *NeurIPS* (2017)](https://arxiv.org/abs/1706.03762)
- [Jumper, J. et al. (DeepMind). "Highly accurate protein structure prediction with AlphaFold." *Nature* (2021)](https://doi.org/10.1038/s41586-021-03819-2)

## What This Enables

- **[TECH] AI & Large Language Models** — LLMs (GPT, Claude, Gemini, Llama) are large-scale deep learning systems; the transformer is a deep learning architecture.
- **[TECH] Medical Imaging (X-ray, CT, PET)** — Convolutional networks for radiology, pathology, and ophthalmoscopy are among the first clinically deployed DL applications.
- **[SCI] Genomics & Computational Biology** — AlphaFold (2021) and protein language models applied transformer architecture to solve protein structure prediction.⏎

# Parents

* [SCI] Machine Learning Theory
* [SCI] Machine Learning Theory
* [TECH] Medical Imaging (X-ray, CT, PET)