For example, pruning more than 30% of weights significantly decreases an LLMs ability to recall facts presented during pre-training. Yet pruning 60-70% of weights largely preserves an LLMs ability to ...