bbq

bbq

BBQ(split: str = 'test', config: str | None = 'all')

Bases: ChatTemplateDataset

BBQ: Bias Benchmark for QA (Parrish et al., 2022).

Probes social biases across multiple demographic dimensions. The config parameter selects the bias category (default "all"). Available configs: Age, Disability_status, Gender_identity, Nationality, Physical_appearance, Race_ethnicity, Race_x_SES, Race_x_gender, Religion, SES, Sexual_orientation, all.