Consular cards were not designed to be identification and no treaty recognizes them as such. Legal travelers visitors and long-term residents carried passports visas or green cards for that purpose.
My dad remembers being in school with my uncle and the teacher would say outright to the class that the Japanese were second-class citizens and shouldn't be trusted.
