The half-life is the time it takes for half the amount of a substance to decay.

Something like Zeno's paradox applies, where you can never get rid of all the substance because you'll always take away half of the remaining amount, but be left with half.

But it doesn't work out that way, because substances aren't infinitely divisible.

...Zeno's paradox doesn't work out either, but I'm not sure why.