edit the Header Element that is set to display on Pages, within it settings you can change the background colors.
If you wish to have a different color for each of the different pages then you would need to delete the current header element and create a new separate Header Element for each page.