What is the incorrect relationship between neural networks and deep learning?

The concept of deep learning sterns from the study or artificial neural networks.

A neural network algorithm with multiple hidden layers is a deep learning algorithm

Single layer neural networks are also a type of deep learning

Convolutional neural networks are a type of deep learning.