Separate the two update types
Quality updates carry security fixes; driver updates come through the same channel but are optional in nature. The settings treat them differently, which is exactly the lever you want.
Settings > Windows Update > Advanced options