6. Edge AI (ONNX)

1. The Cloud is too Slow

Self-driving cars cannot wait 200ms for a server response. They need <10ms latency.

2. Optimization

• TensorRT: NVIDIA's compiler for Jetsons.
• ONNX: The universal format to move models from PyTorch to C++.