Do not count input layer as perceptron (no weights & bias)learnable parameters=weights(edges)+perceptron(bias) learnable\;parameters = weights(edges) + perceptron(bias)learnableparameters=weights(edges)+perceptron(bias)Neural Network Layer NotionLayer NormalizationBatch NormalizationFully Connected LayerResidual ConnectionGradient NormalizationQuery Key Normalization
