The kind of unity Jesus talks about is not the same as conforming or complying with what someone else wants you to do. Unity is actually about being “joined” together which goes way deeper than our own behaviour. Jesus is talking about being one with him the way he is one with God.