It has been realized recently that black holes at the centers of galaxies are no mere ornament but may play a major role in shaping the galaxies we see today. Feedback from accreting black holes seem to play a key role in the galaxy evolutionary models. For Active Galactic Nuclei (AGN) in high accretion rates, this feedback may be in the form of winds or outflows due to radiation pressure acting on the surrounding gas and dust of the interstellar medium. After a general introduction to AGN feedback, I will describe the current open questions in this field and the on-going observational and theoretical campaigns to answer them. In particular, I will present integral field spectroscopy and sub-mm spectroscopy observations to study the ionized and molecular gas dynamics in these galaxies to show how the black hole affects various gas phases at kiloparsec scales.