Adding fuse mount options sync_readdir,dir_cache=no,no_readahead,sshfs_sync,max_conns=1 solves that last issue. Did not investigate which one(s) of them.
Sshfs shorage over the internet is slow, but seems good enough when having a decent ping time, high deduplication factor, backups size...