In this article, we extend research on neighborhood social isolation by (1) examining residents of disadvantaged and advantaged communities and (2) considering the character of neighborhoods where people conduct routine activities away from home. We contend that social isolation is experienced by residents of both highly disadvantaged and highly advantaged neighborhoods because the two groups spend time in largely nonoverlapping parts of the city. Individual and neighborhood race-ethnic dynamics exacerbate such social isolation. Data from the Los Angeles Family and Neighborhood Survey show that social isolation is experienced by residents of all areas of the city, whether highly disadvantaged or advantaged. African Americans, Latinos and residents of areas with many Latinos suffer additional penalties in the social isolation of disadvantage in where they conduct routine activities.