Work

Datafication of Automated (Legal) Decisions - or how (not) to install a GPS when law is not precisely a map

Year: 2017
Type: article
Abstract: Even though I maintain that it is a misconception to state that states are “no longer” the only actors, since they never were, indeed it makes sense to “shed light on the impact of (…) new tendencies on legal regulatory mechanisms (…)” One regulatory tendency is obviously the automation of (legal) decisions which has implications for legal orders, legal actors and legal research, not to mention legal legitimacy as well as personal autonomy and democracy. On the one hand automation may facilitate better, faster, more predictable and more coherent decisions and leave cumbersome and time consuming calculations to machines. On the other hand automation carries its problems: Firstly, the decision making may be hidden in algorithms that for most people are inaccessible and incomprehensible. This may undermine personal autonomy as we may believe that we are making genuine decisions whereas in fact a substantial part of the components of the decisions are prefabricated. With a risk of misplacing the responsibility, this may be called the “google syndrome”. The hidden algorithms may also constitute the basis for decisions concerning individuals (the passive aspect), the “profiling syndrome”. Based on big data machines may be able to (or are thought to be able to) make a prediction profile, leaving risks for individuals for being excluded from life and health insurances, being targets for computational policing etc. An additional dimension to the prefabricated decisions is the commercial aspect. Obviously, commercial interests are not illegitimate per se, on the contrary. The problem is the hidden dimension, the fact that commercial interests may have an influence on the algorithms in use, having implications for what is perceived as personal choices and decisions, for decisions and calculations regarding individuals, and perhaps even for decisions in relation to democracy and government. Secondly, it is questionable whether a (legal) decision is or ought to be entirely computable. The very idea of an automated decision seems to entail that the decision is made within a fixed amount of options, including clear cut categorization of facts, which seems to presume that facts come prepackaged and auto-categorizationable, and which leaves out human creativity and the occurrence of new, unforeseen situations and possibilities. Even though, at times, it may be worthwhile reducing seemingly open ended situations to closed situations with a vast, but technically manageable amount of fixed data – driving cars may be a good example – it may be counterproductive to reduce all situations to categorizationable and foreseeable ones. This automation skepticism hinges on various concepts such as ‘tychism’ (Peirce), ‘fact skepticism’ (Frank), ‘defeasible logic’ (Hart) and ‘communicative action’ (Habermas), which will be engaged in considering the possible limits to automated decision (work in progress). Presently, it may suffice to refer to Montesquieu who held that 1) judges of the lower courts ought to be nothing but inanimated beings, and 2) that the upper court ought to be able to mould the law in favor of the law, thus suggesting that automated decisions should in principle always be subject to human revision.
Language: English
Subfield: Law
Open Access status: green
OpenAlex ID: W2766686384
FWCI:
Cites:
Cited by:
Related to: 10