You, or the CUDA packaging are doing something wrong then.

Installing a broken driver may cause the machine to not boot, fair enough, but CUDA should be straightforward.