Hitchhiker's guide to rebranding:
- Machine learning -> statistical mechanics
- Loss function -> energy functional
- Optimize the model -> minimize free energy
- Trained model -> reached equilibrium distribution
- KL divergence -> free energy difference
- Gaussian noise -> random thermal fluctuations
- Random step -> Brownian motion
- SGD -> directional Brownian motion
- GPU -> simulated particle accelerator
- Diffusion models -> Langevin dynamics
- Reinforcement learning -> control theory
- Robotics -> physical computation
- Audio learning -> 1D signal processing
- Image learning -> 2D signal processing
- Video learning -> 3D signal processing
- Multimodal models -> multidimensional signal processing
- Sora -> learned physics engine
https://x.com/DrJimFan/status/1843681423443800315
