Title: | Bias mitigation techniques in image classification: fair machine learning in human heritage collections |
Authors: | Ortiz Pablo, Dalia Badri, Sushruth Norén, Erik Nötzli, Christoph |
Citation: | Journal of WSCG. 2023, vol. 31, no. 1-2, p. 53-62. |
Issue Date: | 2023 |
Publisher: | Václav Skala - UNION Agency |
Document type: | článek article |
URI: | http://hdl.handle.net/11025/54284 |
ISSN: | 1213 – 6972 (hard copy) 1213 – 6980 (CD-ROM) 1213 – 6964 (on-line) |
Keywords: | klasifikace obrázků;spravedlnost;zmírnění předsudků;klasifikace pohlaví;přenos učení;sbírka lidského dědictví |
Keywords in different language: | image classification;fairness;bias mitigation;gender classification;transfer learning;Human Heritage Collection |
Abstract in different language: | A major problem with using automated classification systems is that if they are not engineered correctly and with fairness considerations, they could be detrimental to certain populations. Furthermore, while engineers have developed cutting-edge technologies for image classification, there is still a gap in the application of these models in human heritage collections, where data sets usually consist of low-quality pictures of people with diverse ethnicity, gender, and age. In this work, we evaluate three bias mitigation techniques using two state-of-the-art neural networks, Xception and EfficientNet, for gender classification. Moreover, we explore the use of transfer learning using a fair data set to overcome the training data scarcity. We evaluated the effectiveness of the bias mitigation pipeline on a cultural heritage collection of photographs from the 19th and 20th centuries, and we used the FairFace data set for the transfer learning experiments. After the evaluation, we found that transfer learning is a good technique that allows better performance when working with a small data set. Moreover, the fairest classifier was found to be accomplished using transfer learning, threshold change, re-weighting and image augmentation as bias mitigation methods |
Rights: | © Václav Skala - UNION Agency |
Appears in Collections: | Volume 31, Number 1-2 (2023) |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
!_2023-Journal_WSCG-63-72.pdf | Plný text | 1,23 MB | Adobe PDF | View/Open |
Please use this identifier to cite or link to this item:
http://hdl.handle.net/11025/54284
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.