There is growing observational evidence for a close connection between the formation and evolution of galaxies and of their central supermassive black holes. Motivated by this connection, we investigate the coupled formation and evolution of black holes and galaxies using state-of-the-art cosmological hydrodynamic simulations of structure formation in the Lambda-Cold Dark Matter model. I will present results from cosmological hydrodynamic simulations which incorporate black hole growth and associated feedback self-consistently. I will discuss black hole growth in the centers of galaxies and their impact on galaxy formation. I will show how we can use our model to investigate the global history of black hole mass assembly in galaxies from the high redshift Universe to today and the formation and fate of the first quasars and the properties of their hosts.