Figured it out!
I had just been using the connection for screen sharing. But once you mount one of the drives (not just see the list of drives, but actually go into one) on the remote Mac, then it adds itself to the sidebar Locations list and stays there.