Basically the two long sides need to be compressed inwards so the retaining tabs inside the pillar will clear the hole.

The problem with removing the bushings is that they are only made of plastic and are usually dried out and hard from the elements and their age, so they are brittle and break upon removal.