}

Yes

Country Lists

African Countries:
Algeria, Angola, Benin, etc.

Asian Countries:
Afghanistan, Bangladesh, China, etc.

European Countries:
Albania, Austria, Belgium, etc.

North/South American Countries:
Canada, USA, Brazil, etc.

Ethnic Categories

White List:
English, Welsh, Scottish, British, Irish, etc.

Asian List:
Indian, Pakistani, Bangladeshi, Chinese, etc.

Black List:
African, Caribbean, Black British, etc.

Mixed List:
Mixed, Multiple, Biracial, etc.

Other List:
Arab, Not specified, etc.

Input: DataFrame with Ethnicity Column

Initialize Configuration Flags

assumeBritishWhite?

Add 'british' to whiteList

Skip British assumption

assumeEnglishWhite?

Add 'english' to whiteList

Skip English assumption

assumeEuropeanWhite?

Add europeanCountries to whiteList

Skip European assumption

assumeAfricanBlack?

Add africanCountries to blackList

Skip African assumption

assumeAsianAsian?

Add asianCountries to asianList

Skip Asian assumption

includeNationalitiesForCountries?

Add nationalities to respective lists

Skip nationalities

edgeCases?

Add extra white countries
American, Australian, Canadian

Skip edge cases

Create copy of DataFrame with census column

Initialize census column with 'other_ethnic_group'

Start processing each row

Convert entry to lowercase

Initialize result as 'other_ethnic_group'

Check against whiteList

Match found in whiteList?

Set result = 'white'

Check against asianList

Match found in asianList?

Set result = 'asian_or_asian_british'

Check against blackList

Match found in blackList?

Set result = 'black_african_caribbean_or_black_british'

Check against otherList

Match found in otherList?

Set result = 'other_ethnic_group'

Check against mixedList

Match found in mixedList?

Set result = 'mixed_or_multiple_ethnic_groups'

Apply explicit keyword checks

Contains 'black'?

Override: result = 'black_african_caribbean_or_black_british'

Contains 'white'?

Override: result = 'white'

Contains 'asian'?

Override: result = 'asian_or_asian_british'

Contains 'mix'?

Override: result = 'mixed_or_multiple_ethnic_groups'

Contains 'other'?

Override: result = 'other_ethnic_group'

Store result in census column

More rows to process?

Return DataFrame with abstracted ethnicity

FilesExpand file tree

ethnicity_abstractor.svg

Latest commit

History

ethnicity_abstractor.svg

File metadata and controls