Hey @nplanchon,
I was pissed off by the same problem for a while and after reading your post, I found out about this little donationware called Lunar (https://lifehacker.com/control-your-external-displays-settings-from-your-macbo-1827981352).
It just made my day and I hope it can help you too.