What difference does a "good" college make?

Is there a huge advantage for students who attended Yale or MIT in the big picture? I know the difference in quality between a community college and a university, but is there a difference between xyz university and Harvard when applying for a job? From what I hear the most important things are your college degrees and past work experience, not where you went to school.