A schoolteacher named Mary Chase Walker was boycotted in 1866 in San Diego, California, after lunching in public with a black woman.