Match the optimization to the bottleneck

Choose an optimization for three different problems: weights that cannot fit, wasted cache reservations, and slow decoding.