Orwellian odyssey: smart borders and the imperative for explainability

Conference paper


Nnawuchi, U. and George, C. 2024. Orwellian odyssey: smart borders and the imperative for explainability. Farhaoui, Y., Herawan, T., Imoize, A.L. and El Allaoui, A. (ed.) 6th International Conference on Artificial Intelligence and Smart Environments. Errachidia, Morocco 07 - 09 Nov 2024 Springer.
TypeConference paper
TitleOrwellian odyssey: smart borders and the imperative for explainability
AuthorsNnawuchi, U. and George, C.
Abstract

Sunlight, they say is the best disinfectant. Therefore, it does not come as a surprise that transparency vis-a-vis explainability of Machine Learning (ML) algorithms used in the context of border control constitutes a key societal desideratum. Integrating ML algorithms in surveillance technologies, particularly algorithms deployed in border and asylum control and management (smart borders), has transformed security measures. This has evoked profound ethical and legal concerns as a result of ML opacity. This paper seeks to contribute to the ongoing discourse on safeguarding fundamental rights in an increasingly algorithmic world, specifically in the context of migration. The paper argues that embedding explainability into AI systems used in migration control is essential to prevent the emergence of an Orwellian surveillance state, ensuring that security measures do not erode civil liberties. It proposes several technical solutions to enhance AI system explainability and address power asymmetries between affected individuals and system users, including developers. It argues that by mandating explainability of ML algorithms, we can better balance power dynamics and protect the rights of individuals impacted by AI systems.

KeywordsMachine learning; Explainability; Automated decision-making; GDPR; AI Act
Sustainable Development Goals16 Peace, justice and strong institutions
Middlesex University ThemeSustainability
Research GroupAspects of Law and Ethics Related to Technology group
Conference6th International Conference on Artificial Intelligence and Smart Environments
Proceedings TitleIntersection of Artificial Intelligence, Data Science and Cutting Edge Technologies: From Concepts to Applications in Smart Environments: ICAISE’24, Volume 1
SeriesLecture Notes in Networks and Systems
EditorsFarhaoui, Y., Herawan, T., Imoize, A.L. and El Allaoui, A.
PublisherSpringer
Publication process dates
Accepted20 Aug 2024
Deposited11 Oct 2024
Output statusAccepted
Accepted author manuscript
File Access Level
Open
LanguageEnglish
Permalink -

https://repository.mdx.ac.uk/item/1v109w

Restricted files

Accepted author manuscript

  • 14
    total views
  • 3
    total downloads
  • 0
    views this month
  • 0
    downloads this month

Export as

Related outputs

Transparency vs explanation of machine learning algorithms: perspectives from recent legal proceedings
Nnawuchi, U., George, C. and Kammueller, F. 2024. Transparency vs explanation of machine learning algorithms: perspectives from recent legal proceedings. Santos M., Machado, J., Novais, P., Cortez, P. and Moreira, P. (ed.) 23rd International Conference on Artificial Intelligence. Viana do Castelo, Portugal 03 - 06 Sep 2024 Springer.
Enhancing digital forensics readiness in big data wireless medical networks: A secure decentralised framework
Mpungu, C, George, C. and Mapp, G. 2024. Enhancing digital forensics readiness in big data wireless medical networks: A secure decentralised framework. International Journal of Network Security & Its Applications (IJNSA) . 16 (4), pp. 13-30. https://doi.org/10.5121/ijnsa.2024.16402
Digital forensics readiness in big data networks: a novel framework and incident response script for Linux-Hadoop environments
Mpungu, C., George, C. and Mapp, G. 2024. Digital forensics readiness in big data networks: a novel framework and incident response script for Linux-Hadoop environments. Applied System Innovation. 7 (5). https://doi.org/10.3390/asi7050090
Developing a novel digital forensics readiness framework for wireless medical networks using specialised logging
Mpungu, C., George, C. and Mapp, G. 2023. Developing a novel digital forensics readiness framework for wireless medical networks using specialised logging. Jahankhani, H. (ed.) 14th ICGS3-22: International Conference on Global Security, Safety and Sustainability. Virtual Conference 07 - 08 Sep 2022 Springer. pp. 203-226 https://doi.org/10.1007/978-3-031-20160-8_12
Securing future healthcare environments in a post-COVID-19 world: moving from frameworks to prototypes
Vithanwattana, N., Karthick, G., Mapp, G., George, C. and Samuels, A. 2022. Securing future healthcare environments in a post-COVID-19 world: moving from frameworks to prototypes. Journal of Reliable Intelligent Environments. 8 (3), pp. 299-315. https://doi.org/10.1007/s40860-022-00180-7
A new privacy framework for the management of chronic diseases via mHealth in a post-Covid-19 world
Jusob, F., George, C. and Mapp, G. 2022. A new privacy framework for the management of chronic diseases via mHealth in a post-Covid-19 world. Journal of Public Health. 30 (1), pp. 37-47. https://doi.org/10.1007/s10389-021-01608-9
Exploring a new security framework for future healthcare systems
Vithanwattana, N., Karthick, G., Mapp, G. and George, C. 2021. Exploring a new security framework for future healthcare systems. IEEE Global Communications Conference: Workshop on Securing Next-Generation Connected Healthcare Systems using Futuristic Technologies. Madrid, Spain [Hybrid: In-Person and Virtual] 07 - 11 Dec 2021 IEEE. pp. 1-6 https://doi.org/10.1109/GCWkshps52748.2021.9681967
A qualitative assessment of machine learning support for detecting data completeness and accuracy issues to improve data analytics in big data for the healthcare industry
Juddoo, S. and George, C. 2020. A qualitative assessment of machine learning support for detecting data completeness and accuracy issues to improve data analytics in big data for the healthcare industry. ELECOM 2020 - 3rd International Conference on Emerging Trends in Electrical, Electronic and Communications Engineering (ELECOM). Mauritius, Mauritius 25 - 27 Nov 2020 IEEE. pp. 58-66 https://doi.org/10.1109/ELECOM49001.2020.9297009
Discovering the most important data quality dimensions in health big data using latent semantic analysis
Juddoo, S. and George, C. 2018. Discovering the most important data quality dimensions in health big data using latent semantic analysis. 2018 International Conference on Advances in Big Data, Computing and Data Communication Systems (icABCD). Durban, South Africa 06 - 07 Aug 2018 IEEE. https://doi.org/10.1109/ICABCD.2018.8465129
Exploring the need for a suitable privacy framework for mHealth when managing chronic diseases
Jusob, F., George, C. and Mapp, G. 2017. Exploring the need for a suitable privacy framework for mHealth when managing chronic diseases. Journal of Reliable Intelligent Environments. 3 (4), pp. 243-256. https://doi.org/10.1007/s40860-017-0049-7
Data governance in the health industry: investigating data quality dimensions within a big data context
Juddoo, S., George, C., Duquenoy, P. and Windridge, D. 2018. Data governance in the health industry: investigating data quality dimensions within a big data context. Applied System Innovation. 1 (4), pp. 1-16. https://doi.org/10.3390/asi1040043
Developing a comprehensive information security framework for mHealth: a detailed analysis
Vithanwattana, N., Mapp, G. and George, C. 2017. Developing a comprehensive information security framework for mHealth: a detailed analysis. Journal of Reliable Intelligent Environments. 3 (1), pp. 21-39. https://doi.org/10.1007/s40860-017-0038-x
Procedural aspects of the new regime for the admissibility of expert evidence: what the digital forensic expert needs to know
Sallavaci, O. and George, C. 2013. Procedural aspects of the new regime for the admissibility of expert evidence: what the digital forensic expert needs to know. International Journal of Electronic Security and Digital Forensics. 5 (3/4), pp. 161-171. https://doi.org/10.1504/IJESDF.2013.058645
New admissibility regime for expert evidence: the likely impact on digital forensics
Sallavaci, O. and George, C. 2013. New admissibility regime for expert evidence: the likely impact on digital forensics. International Journal of Electronic Security and Digital Forensics. 5 (1), pp. 67-79. https://doi.org/10.1504/IJESDF.2013.054420
The Internet and pharmaceutical drugs in the era of interoperable eHealth systems across the European Union
George, C. 2013. The Internet and pharmaceutical drugs in the era of interoperable eHealth systems across the European Union. in: George, C., Whitehouse, D. and Duquenoy, P. (ed.) eHealth: Legal, Ethical and Governance Challenges Berlin, Germany Springer. pp. 135-164
Assessing legal, ethical and governance challenges in eHealth
George, C., Whitehouse, D. and Duquenoy, P. 2013. Assessing legal, ethical and governance challenges in eHealth. in: George, C., Whitehouse, D. and Duquenoy, P. (ed.) eHealth: Legal, Ethical and Governance Challenges Berlin, Germany Springer. pp. 3-22
eHealth: legal, ethical and governance challenges: an overview.
Whitehouse, D., George, C. and Duquenoy, P. 2011. eHealth: legal, ethical and governance challenges: an overview. Med-e-Tel 2011. Luxembourg 06 - 08 Apr 2011
Electronic medical records: addressing privacy & security concerns in the UK and US
George, C. and Berčič, B. 2009. Electronic medical records: addressing privacy & security concerns in the UK and US. BILETA 2009 - To Infinity and Beyond: Law and Technology in Harmony?. University of Winchester, UK 21 - 23 Apr 2009
Illegal activities, preventative technologies & ISP immunity: where should the buck stop?
George, C. 2008. Illegal activities, preventative technologies & ISP immunity: where should the buck stop? BILETA 2008: the 23rd annual conference. Glasgow Caledonian University 27 - 28 Mar 2008
Regulatory challenges in the era of the convergence of telecommunications, broadcasting and information
George, C. 2007. Regulatory challenges in the era of the convergence of telecommunications, broadcasting and information. 15th Telecommunications Forum, TELFOR 2007. Belgrade, Serbia 20 - 22 Nov 2007
Legal challenges of cybercrime
George, C. 2007. Legal challenges of cybercrime. 15th Telecommunications Forum, TELFOR 2007. Sava Centre, Belgrade, Serbia 20 - 22 Nov 2007
Players’ image management in the UK football industry
Futre, D., George, C. and Coathup, R. 2007. Players’ image management in the UK football industry. 15th Congress of the European Sports Management Association (EASM 2007). Torino, Italy 12 - 15 Sep 2007
Data protection: peeking over the study cubicle online!
George, C. 2005. Data protection: peeking over the study cubicle online! JISClegal: Legal Issues of Online Learning Environments.. University of Warwick, UK 01 - 02 Jun 2005 pp. 4-5
Online healthcare: internet pharmacies may not be good for your health
George, C. 2005. Online healthcare: internet pharmacies may not be good for your health. in: Zielinski, C., Duquenoy, P. and Kimppa, K. (ed.) The information society: emerging landscapes: IFIP International Conference on Landscapes of ICT and Social Accountability, Turku, Finland, June 27-29, 2005. Netherlands Springer.
Copyright management systems: assessing the power balance.
George, C. 2005. Copyright management systems: assessing the power balance. in: Zielinski, C., Duquenoy, P. and Kimppa, K. (ed.) The information society: emerging landscapes: IFIP International Conference on Landscapes of ICT and Social Accountability, Turku, Finland, June 27-29, 2005. New York Springer.
Pursuing electronic health: a UK primary health care perspective
Ndeti, M. and George, C. 2005. Pursuing electronic health: a UK primary health care perspective. in: Funabashi, M. and Grzech, A. (ed.) Challenges of expanding Internet: e-commerce, e-business, and e-government: 5th IFIP Conference on e-Commerce, e-Business, and e-Government (13E'2005), October 28-30, 2005, Poznan, Poland. New York Springer.
Challenges of identity theft in the information society.
Jahankhani, H. and George, C. 2008. Challenges of identity theft in the information society. in: Kiekegaard, S. (ed.) Synergies and conflicts in cyberlaw. International Association of IT Lawyers. pp. 42-51
Ethical, legal and social issues in medical informatics.
Duquenoy, P., George, C. and Kimppa, K. 2008. Ethical, legal and social issues in medical informatics. Hershey, PA. Medical Information Science Reference.
Compiling medical data into national medical databases: legitimate practice or data protection concern?
Berčič, B. and George, C. 2008. Compiling medical data into national medical databases: legitimate practice or data protection concern? in: Duquenoy, P., George, C. and Kimppa, K. (ed.) Ethical, legal and social issues in medical informatics Hershey, PA. Medical Information Science Reference. pp. 228-247
Managing social irresponsibility in cyberspace: the walled garden approach
George, C. 2008. Managing social irresponsibility in cyberspace: the walled garden approach. The 11th International Symposium - Management and Social Responsibility, (SymOrg2008). Belgrade, Serbia 10 - 13 Sep 2008
Issues and challenges in securing interoperability of DRM systems in the digital music market
George, C. and Chandak, N. 2006. Issues and challenges in securing interoperability of DRM systems in the digital music market. International Review of Law Computers and Technology. 20 (3), pp. 271-285. https://doi.org/10.1080/13600860600852143
Web 2.0 and user-generated content: legal challenges in the new frontier.
George, C. and Skerri, J. 2007. Web 2.0 and user-generated content: legal challenges in the new frontier. Journal of Information, Law and Technology.
Internet pharmacies: global threat requires a global approach to regulation.
George, C. 2006. Internet pharmacies: global threat requires a global approach to regulation. Hertfordshire law journal. 4 (1), pp. 12-25.
Identifying personal data using relational database design principles
Berčič, B. and George, C. 2009. Identifying personal data using relational database design principles. International Journal of Law and Information Technology. 17 (3), pp. 233-251. https://doi.org/10.1093/ijlit/ean007
Investigating the legal protection of data, information and knowledge under the EU data protection regime
Berčič, B. and George, C. 2009. Investigating the legal protection of data, information and knowledge under the EU data protection regime. International Review of Law Computers and Technology. 23 (3), pp. 189-201. https://doi.org/10.1080/13600860903262255
Information systems failures: whose responsibility?
Georgiadou, E. and George, C. 2006. Information systems failures: whose responsibility? in: Dawson, R. (ed.) Learning and teaching issues in software quality [INSPIRE XI] Swindon British Computer Society.
Online medical consultations: are we heading in the right direction?
George, C. and Duquenoy, P. 2005. Online medical consultations: are we heading in the right direction? Ethicomp 2005, Looking back to the future. Linköping, Sweden. 12 - 15 Sep 2005
Exploring legal & ethical aspects of IPR management in e-learning
George, C., Duquenoy, P. and Middlesex Univerity: School of computing science 2007. Exploring legal & ethical aspects of IPR management in e-learning. London School of Computing Science, Middlesex University.
Online medical consultations: legal, ethical and social perspectives
George, C. and Duquenoy, P. 2008. Online medical consultations: legal, ethical and social perspectives. in: Duquenoy, P., George, C. and Kimppa, K. (ed.) Ethical, legal, and social issues in medical informatics Medical Information Science Reference.
What ELSE? Regulation and compliance in medical imaging and medical informatics
Duquenoy, P., George, C. and Solomonides, A. 2008. What ELSE? Regulation and compliance in medical imaging and medical informatics. in: Gao, X., Müller, H., Loomes, M., Comley, R. and Luo, S. (ed.) Medical Imaging and Informatics: 2nd International Conference, MIMI 2007. Berlin Springer.
ICT in medicine and health care: assessing social, ethical and legal issues.
Duquenoy, P., George, C., Colliste, G., Hedstrom, K., Kimppa, K. and Mordini, E. 2006. ICT in medicine and health care: assessing social, ethical and legal issues. in: Berleur, J., Markku, I. and Nurminen, J. (ed.) Social informatics: an information society for all? In remembrance of Rob Kling: proceedings of the seventh international conference on human choice and computers (HCC7). Boston IFIP Press.
Managing IPR in a successful e-learning enterprise: the global campus, Middlesex University, UK
Bacsich, P., Duquenoy, P., George, C., Weldon, J., Bakry, W., Davis, G. and Middlesex Univerity: School of computing science 2006. Managing IPR in a successful e-learning enterprise: the global campus, Middlesex University, UK. in: Proceedings of the IPR in E-learning Workshop/Conference 21st March, 2006. London School of Computing Science, Middlesex University.
Considering something ELSE: ethical, legal and socio-economic factors in medical imaging and medical informatics
Duquenoy, P., George, C. and Solomonides, A. 2008. Considering something ELSE: ethical, legal and socio-economic factors in medical imaging and medical informatics. Computer Methods and Programs in Biomedicine. 92 (3), pp. 227-237. https://doi.org/10.1016/j.cmpb.2008.06.001