Click Delete from the drop-down menu:

A confirmation pop-up will appear as follows:

Click Delete to finish deleting this label and its sub-labels or Cancel to skip this.