Radioacitivy in the ore is dilute, but during processing there is a step where you separate the daughter nuclides from thorium decay, mainly radium-228. Those wastes have real danger potential.