The sense of smell is directly connected to the emotional centers of the brain, which is why smells can evoke such strong memories.
You're going to pay a price for every bloody thing you do and everything you don't do. You don't get to choose to not pay a price. You get to choose which poison you're going to take. That's it.