In a speech to Justice Department employees marking Black History Month, Holder said the workplace is largely integrated but Americans still self-segregate on the weekends and in their private lives.

“Though this nation has proudly thought of itself as an ethnic melting pot, in things racial we have always been and continue to be, in too many ways, essentially a nation of cowards,” said Holder, nation’s first black attorney general.

Race issues continue to be a topic of political discussion, Holder said, but “we, as average Americans, simply do not talk enough with each other about race.”