Between the Walls

Two harbor towns are feuding so furiously that they decide to build high stone walls around between the towns. A pier that they used to share is now empty, sitting on a no-mans-land between the walls. In spite of everything, could the townspeople remove stones from the walls to build a new pier for everyone?