Technology & the criminal justice system

12 July 2022

This blog was first published in the New Law Journal on 10 June 2022

Unfairness and discrimination can be embedded in justice technology yet there is little means of scrutiny.
 

Using tech to solve problems without properly scrutinising its efficacy or considering the regulatory framework within which it has to operate can lead to expensive and embarrassing mistakes. The criminal justice system has already faced regulatory action in connection with the Metropolitan Police’s Gangs Matrix. Following concerns the Matrix included people who posed little or no risk, the London Mayor ordered a review which, according to press reports, led to about one thousand young, black men’s names being removed.

A House of Lords report published in March, suggests the criminal justice system could be forced into another humiliating policy retreat (‘Technology rules? The advent of new technologies in the justice system’, see: bit.ly/38hbOLz). The report by the Justice and Home Affairs Committee detailed a range of concerns with the technology itself, transparency about its deployment, and the oversight of its use. The committee concluded they had uncovered ‘a new Wild West, in which new technologies are developing at a pace that public awareness, government and legislation have not kept up with’.

Concerns were raised both about the way in which products were sold to law enforcement agencies and the way in which those products were evaluated by customers. The committee found vendors were not always open about how products worked when pitching to potential buyers and that a culture of evaluating technology was not embedded into law enforcement. Police forces lacked the expertise and resources to properly assess the efficacy of what they were offered before buying and deploying it.

This reluctance of police forces to invest in processes for evaluating new technology is surprising. The value of technology depends on how effectively it allows an organisation to achieve its objectives—not on the claims made by its developers. There is a real concern that money is being wasted on technology purchased on face value that is not fit for purpose.

Lack of transparency was another issue raised in the report and is one that could have a serious knock-on effect on criminal trials. They heard evidence that the underlying technology in systems operated by law enforcement was inaccessible to users, and of a failure to be transparent with stakeholders about its deployment. The complexity of systems and developers’ claims of commercial confidentiality over their technology meant forces were operating systems without adequately understanding how they worked. Because of the decentralised procurement structures in policing there is no clear picture of how widely novel technologies are being used. This lack of transparency has the potential to affect the fairness of criminal trials. If police forces are not candid about the systems used to collate, analyse and present evidence, then lawyers will not be able to effectively test the reliability of this evidence.

The committee found oversight of the use of new technology to be lacking on both a macro and micro level. Police’s internal accountability mechanisms are complex, and it was unclear who was responsible for external oversight. The government suggested in evidence to the committee that the courts could be the ultimate backstop when it came to scrutinising the use of technology in the justice system. This was somewhat surprising given their prevailing attitude to judicial review of executive action.

Finally, the committee heard evidence that individual decision makers who took data analysis from new technologies into account did not fully understand or scrutinise that analysis when making decisions, and there was a tendency to be overly reliant on it; human involvement could be limited to clicking a button confirming the algorithmic suggestion. Evidence of such approaches is particularly concerning given the emphasis that data protection legislation puts on human intervention as a safeguard when automated decision making is contemplated.

Various recommendations were made in response to the issues raised, some of them more workable than others. The idea that a single piece of new legislation could be produced that cuts across existing legislation, and is both future proof and accessible, is unrealistic. It is not clear how a single national body responsible for kitemarking AI tools would clarify lines of accountability for police forces. A mandatory register of ‘algorithms used in relevant tools’ may be overly cumbersome given the prevalence of algorithms in everyday use, or be ineffective if it does not carry a duty to explain the algorithms in the register.

In my view, the best way to rein in the ‘Wild West’ is through the introduction of training, guidance and cultural change, and the embedding of expertise within the procurement function. Data protection legislation and the Equality Act 2010 already provide frameworks through which new technologies in the justice sector should be assessed, and their significance needs to be drawn to the attention of law enforcement. It should be made clear there is an obligation to process personal data in a way which is fair, lawful and transparent; and that there are limitations on the reliance on algorithms in the context of decision making.

Moreover, law enforcement needs to be alive to the issue of being guided by big data analysis in a way that unfairly targets minorities and marginalised groups. A critical approach to emerging technologies should be taken in the procurement process and decision makers must be probing in their evaluations of what they are being sold.

Efforts to increase awareness and implement cultural change must begin now. Without such change it is increasingly likely that the courts will have to snap the criminal justice system out of its ‘digital enchantment’ through decisions in criminal trials and judicial review, with potentially expensive and embarrassing consequences for the organisations involved.

Further Information

If you have any questions regarding this blog, please contact Fred Allen in our Public Law team.

 

About the Author

Fred Allen is a senior associate within the Public Law Department and International Crime Group. His clients have included businesses, trade associations, religious institutions, schools, education providers, charities, and private clients including high net worth individuals, and senior political and business figures.

 

Latest blogs & news

Case Note – Judicial Review of Covid-19 care home policy: Gardner & Harris v Secretary of State for Health and Social Care & Ors [2022] EWHC 967 (Admin)

After over two long years of life under the shadow of the Covid-19 pandemic, we can circle back and
reflect on our colleague, Sophie Kemp’s predictions in relation to ‘the future public inquiry into
Covid-19’ in the light of the High Court judgment Gardner & Harris v Secretary of State for Health
and Social Care & Ors [2022] EWHC 967 (Admin).

Case note – CPR Part 18 Requests for Further Information in judicial review proceedings: R (KBL) v Secretary of State for the Home Department and ors [2022] EWHC 1545 (Admin) and R (JZ) V Secretary of State for the Home Department and ors [2022] EWHC 1708

CPR Part 18 gives power to the court to order a party to proceedings to provide further
information, where this is necessary to resolve disputes. Applications for orders under
CPR18 are very rare in judicial review cases but two recent decisions of the Administrative
Court illustrate the kind of circumstances in which orders will be made; and also, strikingly,
that an order can be made at the conclusion of a substantive hearing.

Technology & the criminal justice system

Fred Allen explains why taking a critical approach to emerging technologies is vital.

Case Note - amenability to judicial review challenge: R (Taggart) v The Royal College of Surgeons [2022] EWHC 1141 (Admin)

The Administrative Court of England and Wales has recently considered whether the Royal College of Surgeons (RCS), when producing a report, under the ‘Invited Review Mechanism’ (IRM), could be challenged by way of judicial review.  The judgment of Mrs Justice Hill provides a helpful review of the relevant authorities and illustrates the limits of the judicial review jurisdiction – she concluded that a challenge could not be made.

The ICO’s Enforcement of the PECRs – what powers are at its disposal?

Complaining about a PECR breach to the ICO, especially about an unwanted marketing communication, is quick and easy for the affected person. Meanwhile for an organisation at the sharp end of a complaint, the PECRs enforcement regime is not straightforward to untangle. In this blog, we outline the ICO’s specific enforcement regime when investigating breaches of the PECRs.

The (Long) Covid Inquiry – the challenge of complying with Article 2 in timing the Covid Inquiry

The UK Covid-19 Inquiry has published its long awaited draft terms of reference, and a consultation on those proposed terms. The final terms of reference are of considerable importance to those taking an interest in the Inquiry, as set out here by Stephen Parkinson

Case Note: challenging consultations in judicial review proceedings - R (oao Binder and others) v Secretary of State for Work and Pensions [2022] EWHC 105 (Admin)

The Administrative Court has recently upheld a challenge to a ‘consultation’ undertaken by the Department for Work and Pensions (DWP) prior to the publication of the National Disability Strategy. Strikingly the DWP gave evidence that it had not been intending to carry out a consultation – but Mr Justice Griffiths held that, as a matter of substance (as opposed to intention), there had in fact been a consultation; and that, (unsurprisingly as it was not a standard that it thought it had to meet) the DWP had failed to meet the legal requirements for a fair and adequate consultation.

 

The Covid-19 Inquiry: the Consultation on the Terms of Reference

In December 2021, the Prime Minister appointed Baroness Heather Hallett DBE as Chair of a statutory public inquiry into the handling of the Covid-19 pandemic across the UK. The announcement concerning the inquiry stated that there would be a public consultation on the draft terms of reference. This blog discusses the likely approach and scope of that consultation.

Data Protection reform: A new direction for charities?

Following the UK’s departure from the EU, the Government wishes to reform the data protection legislation within this country in order to ‘unlock the power of data.’ For charities, does this mean the painful prospect of reworking their existing GDPR compliance regime or the promise of a lighter regulatory load?

Why Companies with Supply Chains in Xinjiang and China Need to Act Now

It’s a year since the UK Government announced business measures over human rights abuses in the Xinjiang province of China. In this piece we reflect on those measures and what might come next. We also look at what action prudent businesses should take now if they are concerned about products from Xinjiang in their supply chain, or how products they export to China are being used.

Data: A New Direction - Research, Re-use and Responsibility

High on the Government’s wish list for data protection reform is the reduction of legislative barriers to ‘responsible innovation,’ particularly within the field of scientific research. Due to perceived complexity and lack of clarity, it is feared that organisations either choose not to conduct research at all or rely on unnecessarily burdensome consent processes. This blog considers the likely impact of the Government’s ideas

Consultation on ICO Powers Shows the Breadth of the Regulator’s Powers

On 20 December 2021 the ICO launched a consultation seeking views on three documents, which together demonstrate its wide-ranging powers to undertake investigatory, regulatory and enforcement action.  

The Terms of Reference for the Scottish Covid-19 Inquiry

As we await the publication of the terms of reference for the UK wide Covid-19 Inquiry, in this blog I consider the key features of the recently published terms of reference for the Scottish Inquiry into the Covid-19 pandemic.

The Covid-19 Inquiry – the importance of the terms of reference

Any day now the Covid-19 Inquiry will publish draft terms of reference. This will be a significant event.  Once agreed, the terms of reference will determine the scope and length of the inquiry which is due to begin its work in the Spring.  In turn this will have a direct impact on how valuable the inquiry turns out to be.  

Data: A new direction - Access to personal data

In this blog series, we will review the key proposals for reform of data protection law within the Government’s consultation paper ‘Data: A New Direction’. We will consider how far the Government will stray from the current path and signpost some potential pitfalls and practicalities for consideration along the way

The right to equality in fertility treatment

A same-sex couple have commenced a significant test case against a branch of the NHS fertility sector for discrimination against them on grounds of their sexuality. 

Court considers that intransigent public inquiry witnesses will often give evidence once they have been compelled to attend

In a 16 November 2021 blog, I described how refusing to give evidence to a public inquiry might play out. Another new case, Chairman of the Manchester Arena Inquiry v Romdhan [2021] EWHC 3274 (Admin), reinforces my view. Potential witnesses in next year’s coronavirus (Covid-19) inquiry take note.

 

Data: A New Direction - Unleashing the transformational power AI?

In this blog series, we will review the key proposals for reform of data protection law within the Government’s consultation paper ‘Data: A New Direction’. We will consider how far the Government will stray from the current path and signpost some potential pitfalls and practicalities for consideration along the way.

The Judicial Review and Courts Bill: Proposed reform of Judicial Review

Attempts to narrow the scope of judicial review have long been on the Conservative Party’s political agenda. Following the Independent Review of Administrative Law (‘IRAL’) and the subsequent government consultation on reform of judicial review, the then Lord Chancellor, Robert Buckland, introduced the Judicial Review and Courts Bill (‘the Bill’) to the House of Commons on 21 July 2021. The Bill is making its way through Parliament and is currently at the committee stage.

As we highlighted in our earlier blog following the Bill’s announcement, the proposed reforms are, at first sight, milder than had been feared. Nevertheless, the Bill proposes to make significant amendments to the remedies available in judicial review proceedings and to also limit the court’s jurisdiction.

Data protection law reform: A new direction?

In this blog series, we will review the key proposals for reform of data protection law within the Government’s consultation paper ‘Data: A New Direction’. We will consider how far the Government will stray from the current path and signpost some potential pitfalls and practicalities for consideration along the way.

We begin with the Government’s proposals for creating a ‘whitelist’ of legitimate interests which always provide a lawful basis for processing under the UK GDPR. 

Share insightLinkedIn Twitter Facebook Email to a friend Print

Email this page to a friend

We welcome views and opinions about the issues raised in this blog. Should you require specific advice in relation to personal circumstances, please use the form on the contact page.

Leave a comment

You may also be interested in:

Skip to content Home About Us Insights Services Contact Accessibility