In the age of artificial intelligence (AI) and automated decision-making, governments worldwide are embracing technological advancements to streamline public administration. Finland, at the forefront of digitalization in Europe, has championed a national AI strategy, emphasizing the need to modernize the public sector to meet the challenges posed by aging demographics.
However, a recent study by researchers Riikka Koulu and Terhi Esko sheds light on a critical aspect often overlooked in the race towards automation—the perspective of ordinary citizens. The study, published in Big Data & Society, delves into the legislative initiatives surrounding automated decision-making, revealing a conspicuous absence of citizen-centric considerations.
The legislative drive, rooted in the EU General Data Protection Regulation, appears to prioritize the continuation of existing automated procedures with limited critical discourse. The researchers raise concerns about the lack of discussion on the citizen's role and understanding in the context of automated decision-making, emphasizing a legislative initiative carried out on the administration's terms.
Citizens, initially sidelined in the law-drafting stage, are later thrust into the role of quality controllers for information systems. This shift in responsibility raises questions about citizens' ability to comprehend complex decision-making technology and their role as targets of automated decisions.
As automated decision-making becomes increasingly prevalent, citizens are expected to take on a more active role, not only safeguarding their individual rights but also ensuring the system's overall functionality. The researchers highlight the risk of citizens becoming less likely to complain about automated systems, fueled by a misplaced trust in computers to make correct and objective decisions.
The study challenges the prevailing narrative of unbridled digitalization as a panacea for societal challenges. While Finland leads in the digitalization of public administration in Europe, the researchers question the absence of legal policy discussions regarding the limits of digitalization. They advocate for a nuanced approach, considering digital skills as integral to civic skills and emphasizing the importance of understanding both technology and the underlying social system when interacting with digital administration.
In parallel, the ADM-Gov project (The Automated Administration: Governance of ADM in the Public Sector) seeks to explore how automated decision-making can be implemented without compromising fundamental rights and trust in public institutions, drawing comparisons between Finland and Sweden.
The emergence of legal user interface research signals a paradigm shift, urging a closer examination of how user interfaces impact individuals' exercise of rights. The DARE (Digital Administration Redesigned for Everyone) research project aims to determine the compliance of technical user interfaces with the law, paving the way for a new branch of research that merges legal sciences, social sciences, and computer science.
In conclusion, as nations race towards an automated future, the study prompts reflection on the societal implications of automated decision-making, urging policymakers to consider the citizen's perspective and strike a balance between technological innovation and safeguarding individual rights.
