Unfortunately, yEd's UML class node does not support coloring its constraint and stereotype labels. The constraint and stereotype labels do not support HTML formatting either.
If you need a colored constraint and/or stereotype, you will have to "create" your own class style, e.g. using a plain rectangular node with several manually positioned labels.