To customise the default header, please go to Default customiser of WordPress. There you will find options to change header stuff. For example, here are the steps to change the logo.