Vectors, Matrices & Tensor Shapes
How to read the tensor shapes inside an LLM such as Llama 3.1 8B: parameters and activations, the cost of a matrix multiply, and fixing shape errors.
How to read the tensor shapes inside an LLM such as Llama 3.1 8B: parameters and activations, the cost of a matrix multiply, and fixing shape errors.