Possible downsides (not necessarily related to Face ID as such):
-
I suppose it needs to be disabled before preparing an iPhone to be sold or traded in, as otherwise you might have to wait an hour in an Apple Store if you’ve forgotten to do that at home as it would prevent you from signing out of your account. I wonder why Apple has not updated the related support article yet.