Calories are just a measure of the energy released by a material.
Normally they're measured by burning the material, so it's not really accurate to say that you can get that many calories from uranium. On the other hand the whole concept is fucking stupid anyway, because it's measured by burning the material. Technically, a kilo of dry sawdust has 4800 calories (more than double the daily calorie requirement of the average person).