If you select an edge, the label properties are in section Label:
If you select an edge label, the properties view will only display label properties:
In both cases, there are color properties for the label background, the label border, and the label text color (called Color only).