Jetpack is useful for a lot more than just the stats, so I’d still activate it. The “Protect” feature is important, I think, unless you have another way of handling that.
(https://jetpack.com/support/protect/)
@HeyScottyJ and I have Jetpack and the Seriously Simple Podcasts setup for Nested Folders and it’s working great for us! In fact, while I set up some fancy automation behind the scenes for auto-sharing, the first tweet that goes out is done by Jetpack