Up to 4 buildings can be queued for construction or upgrade.

In order to queue building construction click the "+" near the building icon.
In order to queue building upgrade click the "Queue" button in the Upgrade Window.

In order to remove building from the queue of construction click the building icon in the queue.