Wild Rover Hostel
This is a good place to sleep. It has a good atmosphere. The only inconvenient thing is that it's an Irish hostel and the speak English there. They do know how to speak a little Spanish there, at reception. There are also in Cusco and Arequipa.