Machine Learning

Reference Machine Learning Glossary - Google for Developers activation function A function that enables neural networks to learn non-linear (complex) relationships between features and the label. Popupar activation functions include: ReLU Sigmoid Tanh backpropagation The algorithm that implements gradient descent in neural networks. Training a neural network involves many iterations of the following two-pass cycle: During the forward pass, the system processes a batch of examples to yild prediction(s). The system compares each prediction to each label value. The difference between the prediction and the lable value is the loss for that example. The system aggregates the losses for all the examples to compute the total loss for the current batch. During the backward pass (backpropagation), the system reduces loss by adjusting the weights of all the neurons in all the hidden layer(s). Neural networks often contain many neurons across many hidden layers. Each of those neurons contribute to the overall loss in difference ways. Backpropagation determines whether to increase or decrease the weights applied to particular neurons. ...