I've tried cracking balls on purpose with no success. I've put them in very hot water for a while, and then threw them straight into snow. Brittle materials are much more likely to crack when going from hot to cold, but it still wouldn't crack for me. But I've had multiple crack just sitting in my room on a rack go figure.

I do not think a ball will crack that easily even if it's left outside in the cold. It's the drastic temperature changes that are more dangerous. But going from the alley to your car, and sitting in a warmth, it will not change temperature fast enough to do damage. But it would be ideal to not test it.
--------------------
Pennsylvania State University