Row In The Same Direction phrase

When the Swamp gets frustrated that their agenda is getting derailed by conservatives, they condescendingly urge everyone to "row in the same direction". But the direction has to be towards the Swamp's agenda, not towards anything remotely conservative.