For current inhabitants, I am not worried about either process.
Of course, in the long run, ice ages are exponentially more dangerous to all life on Earth. Even rather small decreases in global temps can kill hundreds of millions of humans, animals and plants. We have ample proof of this from the “Little Ice Age” which occurred around 1600–1850. During winters throughout much of this cold period, the Thames River in the UK froze. Crop production was greatly diminished and hundreds of thousands starved. Northernmost settlements were abandoned.
On the other hand, slight warming of the planet would be beneficial overall, just like it was during previous warmer periods called “climate optima” (Roman and Medieval Warm Periods). Civilizations thrived and expanded further north during these periods.