By clicking “Accept”, you agree to the storing of cookies on your device to enhance site navigation, analyze site usage, and assist in our marketing efforts. View our Privacy Policy for more information.

Latest articles

Featured

We are in the Age of AI Economies

March 31, 2023

With the expansion of computational power observed in the last ten years, artificial intelligence (AI) models have been gaining more and more space in various sectors of industry and academia. In an article written in 2021 and signed by a relevant group of researchers (including Adriano Koshiyama and Emre Kazim), it was stated that we are starting the Age of Algorithms (whether they are AI, machine learning or similar). This statement logically leads to the idea that we are now increasingly close to the Age of AI Economies. Meaning that work processes, the way that different markets are organised, the consumption patterns of economic agents, the way in which economic phenomena occur and are analysed, all are permeated by algorithms that generate impacts that are as of now still unknown.

Thank you! Your submission has been received!

Oops! Something went wrong while submitting the form.

AI Regulation

AI Risk Management

AI Theory

Data Science

EU AI Regulation

NYC Bias Audit

UK AI Regulation

US AI Regulation

How Do You Measure Algorithm Efficacy?

March 28, 2023

Measuring algorithm efficacy gives important insights into how well the model is working and does what it is designed to do. In this blog post, we give an overview of some different metrics that can be used to measure the performance of classification and regression systems.

AI Regulation Around the World: Spain

March 23, 2023

The European Commission's proposed harmonised rules on artificial intelligence, the EU AI Act, aim to regulate AI systems on the EU market to create greater trust. Spain has not contributed to the development of the Act but has launched the first regulatory sandbox to experiment with its obligations. Spain has also published a National AI Strategy, announced Europe's first AI Supervisory Agency, and targeted platform-based worker rights with its Rider Law.

An Exploration of AI harms: The Need for AI Risk Management

March 20, 2023

With artificial intelligence (AI) being increasingly used in high-stakes applications, such as in the military, for recruitment, and for insurance, there are growing concerns about the risks that this can bring. This is because algorithms can introduce novel sources of harm, where issues such as bias can be amplified and perpetuated by the use of AI. As such, recent years have seen a number of controversies around the misuse of AI, which have affected a range of sectors.

Measuring and Mitigating Bias: Introducing Holistic AI's Open-Source Library

March 17, 2023

Today, artificial intelligence (AI) is increasingly present in our lives and becoming a fundamental part of many systems and applications. However, like any technology, it is important to ensure that AI-based solutions are trustworthy and fair. That's where the Holistic AI library comes in. In this blog post, we provide an overview of Holistic AI’s Bias analysis and mitigation framework, defining bias and how it can be mitigated before giving an overview of the bias metrics and mitigations available in the Holistic AI library.

The Dangers of ChatGPT: It’s All Fun and Games, Until It’s Not

March 14, 2023

OpenAI's GPT-4 can now process image-based prompts in addition to text-based ones, although the output is still text-based for now. While OpenAI has implemented ethical safeguards, there are still risks in using GPT. Check out our most recent blog on the dangers.

The US Pushing for Responsible AI in Military Use

March 13, 2023

On 15-16 February 2023, the first global summit on Responsible Artificial Intelligence in the Military Domain (REAIM) was held in the Netherlands. The US used the summit as an opportunity to put forth their “Political Declaration on Responsible Military Use of Artificial Intelligence and Autonomy.” In this blog, we begin by looking at the US’s latest development in promoting the adoption of responsible AI in the military, before briefly discussing investments into the military across the US and China, as well as the implications of AI in military capabilities on a macro-level, making a case for the growing importance of risk management and auditable methodologies.

SB 1103 – Connecticut’s Call for AI Regulation

March 10, 2023

In an attempt to regulate the use of artificial intelligence (AI) by State Agencies, Connecticut lawmakers have taken decisive action and proposed SB- 1103, An Act Concerning Artificial Intelligence, Automated Decision-Making and Personal Data Privacy. The Proposed Bill aims to establish an Office of Artificial Intelligence, a task force to study artificial intelligence and develop an AI Bill of Rights.

SHAP Values: An Intersection Between Game Theory and Artificial Intelligence

March 8, 2023

Game Theory was an intellectual advance built at final of World War II and initially had mathematicians as its main contributors. Over time, researchers from other areas began to adopt this theoretical framework, highlighting economists and political scientists. The Shapley value describes a method to distribute the total gain to players if they all collaborate in a specific coalition strategy. We can describe that SHAP (SHapley Additive exPlanation) values attribute to each feature the change in the expected model prediction when conditioning on that feature.

AI Regulation in the Public Sector: Regulating Governments’ Use of AI

March 6, 2023

While many regulatory efforts surrounding the use of AI are focused on business applications, the increasing use of AI within the public sector has led to an increased focus on regulating governmental use of AI. In this blog post, we give a high-level overview of some of these initiatives, focusing on the US, EU, and UK.

Practical and Societal Dimensions of Explainable AI

March 2, 2023

As artificial intelligence (AI) becomes more prevalent in various industries, it is crucial that all stakeholders are equipped to comprehend and articulate the outcomes produced by AI models. This understanding process must be clear and transparent at different dimensions to ensure that the results generated are ethical, unbiased, and trustworthy.

The Need for Risk Management in AI Systems

February 27, 2023

Artificial Intelligence (AI) risk management is an iterative process that requires an understanding of the risks associated with AI systems, and the best practices for managing them. The key steps for implementing a successful AI risk management strategy include: identifying and assessing risks, implementing a risk managment plan, and monitoring development. It is important to identify and mitigate AI risks to ensure a successful implementation of AI technologies and gain a competitive edge.

Overview of Large Language Models: From Transformer Architecture to Prompt Engineering

February 24, 2023

At the heart of this technology lies the innovative Transformer architecture. A deep learning model that has redefined the way we process natural language text due to its remarkable efficiency. In this article, we dive into the details of Transformer, exploring its impressive history of modification and improvement. By the end, you'll have a solid grasp of the cutting-edge technology driving the language models of today.

A comparison of NYC and New Jersey’s Bias Audit Mandates

February 20, 2023

In this blog post, we compare New York City Local Law 144, which will require independent bias audits of automated employment decision tools from the 15th of April 2023, and the New Jersey Assembly Bill 4909, which has been recently introduced and will have similar requirements if passed.

The Rise of Large Language Models: Galactica, ChatGPT, and Bard

February 17, 2023

The use of large language models (LLMs) such as Galactica, ChatGPT, and BARD have seen significant growth over the past few months. These models are becoming increasingly popular and are being integrated into various aspects of daily life, ranging from grocery lists to helping to write Python code. As with any novel technology, it is essential for society to understand the limitations, possibilities, biases, and regulatory issues brought about by these tools.

Transparency in HR Business Practices: A Legislative Overview

February 15, 2023

Within business organisations, human resources (HR) teams have been at the forefront of innovating their business practices through operationalising emerging technologies such as artificial intelligence (AI) and incorporating them into their talent sourcing and talent management practices.

AI Regulation Around the World: The Netherlands

February 22, 2023

The European Union’s (EU’s) proposed AI Act aims to harmonise requirements for AI systems across the EU with its risk-based approach. Ahead of this, some countries, like the Netherlands, are pressing ahead with specific national requirements.The Dutch approach is shaped by the scandal around a biased algorithm that their tax office used to assess benefits claims. The tax office implemented the system in 2013 and, after civil society raised concerns, two formal investigations in 2020 and 2021 uncovered systematic bias affecting 1.4 million people.

Making Sense of China’s AI Regulations

February 8, 2023

In 2022, China passed and enforced three distinct regulatory measures on the national, regional and local levels. This momentum has carried into 2023, where in January alone, China has already cracked down on deepfake technology through a national level legislation. In this blog, we survey China’s AI regulatory endeavours, highlighting interesting enforcement mechanisms and comment on China’s approach to AI governance.

What is AI Transparency?

February 6, 2023

AI systems are becoming increasingly integrated into our daily lives and are being used to make high-stakes decisions that can have significant implications for an individual’s life chances. Therefore, there are increasing calls to ensure that there is transparency about the capabilities of AI systems and that their outputs are explainable. In this blog post, we discuss what is meant by AI transparency and explainable AI and how they can be implemented through governance and technical approaches.

In Conversation with NIST: AI Risk Management

February 3, 2023

The National Institute of Standards and Technology (NIST), one of the leading voices in the development of artificial intelligence (AI) standards, launched the first version of the Artificial Intelligence Risk Management Framework (AI RMF 1.0) on 26 January 2023. Underpinning the AI RMF is a focus on moving beyond computational metrics and instead focusing on the socio-technical context of the development, deployment, and impact of AI systems. We sat down with NIST to discuss the AI RMF and learn about their vision for how it can be implemented.

Key Takeaways from the EEOC’s Navigating Employment Discrimination in AI and Automated Systems Hearing

February 1, 2023

On 31 January 2023, the Equal Employment Opportunity Commission (EEOC) held a public hearing on how the use of automated systems, including artificial intelligence, in employment decisions can comply with the federal civil rights laws the EEOC enforces. Check out our latest blog article on the key takeaways from the hearing, including how to promote diversity, equity and inclusion.

Insightful Resources for Uncovering Bias in English Speech Recognition

January 27, 2023

Speech tech is widely used & has many applications, incl. ASR for voice control of devices & accessing info. However, ASR systems can be fragile & biased, affecting certain groups. This post explores ASR bias metrics used to measure it and recommends datasets to consider.

Disparate Impact in Bias Audits: Evaluating the DCWP’s Impact Ratio Metrics for Regression Systems

January 23, 2023

In recent years, the fairness of automated employment decision tools (AEDTs) has received increasing attention. In November 2021, the New York City Council passed Local Law 144, which mandates bias audits of these systems.

Overcoming Small Sample Sizes When Identifying Bias

January 19, 2023

Under Local Law 144, employers and employment agencies are required to commission independent, impartial bias audits of their tools, where, under the latest version of the Department of Consumer and Worker Protection’s (DCWP) proposed rules, bias should be determined using impact ratios based on outcomes for different subgroups. In this blog post, we outline the metrics required to conduct the bias audit, how small sample sizes can pose issues, and how they can be dealt with when carrying out audits.

NYC Bias Audits Protected Characteristics

January 12, 2023

The New York City Council took decisive action to mandate bias audits of automated employment decision tools (AEDTs) used to evaluate employees for promotion or candidates for employment in New York City, signaling that the risks of Artificial Intelligence (AI) are becoming an increasing regulatory concern. Local Law 144, also known as the NYC Bias Audit Law, is the first of its kind to codify independent, impartial bias audits in law.

Digital Markets Act: The EU Commission is Cracking Down

January 10, 2023

The Digital Markets Act (DMA) came into effect on November 1st 2022 and focuses on regulating how online platforms operate with respect to fair competition and consumer choice by reducing the bottlenecks that so-called gatekeepers create by monopolising the digital economy.

What is the EU AI Act?

January 5, 2023

‍First proposed on the 21st of April 2021, the European Commission’s proposed Harmonised Rules on Artificial Intelligence, colloquially known as the EU AI Act, seeks to lead the world in AI regulation. Likely to become the global gold standard for AI regulation, much like the general data protection regulations did for privacy regulation, the rules aim to create an ‘ecosystem of trust’ that manages AI risk and prioritises human rights in the development and deployment of AI.

Responsible AI: 5 Best Practices

January 6, 2023

AI is being adopted across all sectors, with the global revenue of the AI market set to grow by 19.6% each year and reach $500 billion in 2023.

NYC Insurance Circular Letter: Using Consumer Data and Information Sources

December 22, 2022

In January 2019, the New York Department of Financial Services published a circular letter to all insurers authorized to write life insurance in New York State. The letter makes it clear that insurers should not use an external data source, algorithm or predictive model in underwriting or rating unless it has been determined by the insurer (not just the vendor) that the system does not collect or use prohibited criteria.

What is AI Auditing?

December 21, 2022

The ongoing proliferation of automated systems and artificial intelligence (AI) across industries has led to the development of regulation governing the use of these systems. The first of its kind, New York City Local Law 144 mandates independent bias audits of automated employment decision tools (AEDTs) used to evaluate candidates for employment or employees for promotion in New York City.

An Overview of the US AI Training Act 2022

December 19, 2022

The Artificial Intelligence Training for the Acquisition Workforce Act (AI Training Act) was signed into law by President Biden in October 2022. The Act is premised on education and training to inform procurement and facilitate the adoption of AI for services at the Federal Level.

Lost in Transl(A)t(I)on: Differing Definitions of AI [Updated]

February 10, 2023

The regulation of artificial intelligence (AI) has started to become an urgent priority, with countries around the world proposing legislation aimed at promoting the responsible and safe application of AI to minimise the harms that it can pose.

We Asked ChatGPT to Write an Article About Ethical AI, Here's What it Said

December 12, 2022

In recent years, the field of AI Ethics, and related fields, such as trustworthy AI and responsible AI, have gained much attention due to increasing concerns about the risks that AI can pose if it is not used safely and ethically.

EU AI Act: Summary of Updates on Final Compromise Text

December 13, 2022

The latest and final compromise text of the EU AI Act (released on 6 December 2022) marks the EU ministers' official greenlight to adopt a general approach to the AI Act.

The EU’s Digital Services Act – The Need for Independent Third-Party AI Audits

November 30, 2022

The Digital Services Act (DSA) is a lengthy (300 pages) and horizontal (cross-sector) piece of legislation with composite rules and legal obligations for technology companies. Notably, there is a focus on social media, user-oriented communities, and online services with an advertising-driven business model.

The UK’s AI Regulation: From Guidance to Strategies

November 25, 2022

The UK government has not yet proposed any AI-specific regulation but has published several policy papers, frameworks, standards, and strategies. This blog post outlines the major AI regulations in the UK.

Penalties of the EU AI Act: The High Cost of Non-Compliance

November 24, 2022

The European Commission aims to lead the world in Artificial Intelligence (AI) regulation with the proposed EU AI Act. This article explores the proposed penalties of the EU AI Act for organisations that are non-compliant with the Act.

The Washington DC Algorithms Law: Stop Discrimination

November 18, 2022

Washington DC proposes the "stop discrimination by algorithms act" aiming to prevent algorithmic discrimination for protected classes.

What You Need to Know About Canada’s AI Law Proposals

November 17, 2022

Canada has proposed the Digital Charter Implementation Act (Bill C-27), a trio of laws for trust and privacy. This new AI Law will regulate AI systems.

Spain's Rider Law: Algorithmic Transparency and Worker Rights

November 16, 2022

Spain’s royal decree 9/2021 or rider law gives platform delivery workers employment rights and imposes algorithmic transparency obligations.

Regulating AI: The EU AI Act vs California’s Employment Legislation

November 14, 2022

California has proposed a Workplace Technology Accountability Act and modifications to its employment regulations to address automated decision systems. In this blog, we compare these proposals to the proposed EU AI Act.

Department of Consumer and Worker Protection’s Public Hearing on the NYC Bias Audit Law (Local Law 144): Key Takeaways 

November 8, 2022

Following their proposed rules for the NYC Bias Audit legislation, the Department of Consumer and Worker Protection held a public hearing. In this blog, we summarise the key takeaways from this session.

HR Tech Regulations: New York City vs California’s Approaches to Regulating Bias and Discrimination

November 2, 2022

The blog compares the NYC bias audit law with California’s proposed Workplace Technology Accountability Act and Proposed Modifications to Employment Regulations Regarding Automated-Decision Systems.

The Proposed Amendments to California’s Employment Legislation Regarding Automated-Decision Systems

October 31, 2022

California has proposed amendments to its employment regulations to extend non-discrimination practices to automated decision tools. Here are a few things you need to know about the proposed modifications.

10 Things You Need to Know About the California Workplace Technology Accountability Act

October 26, 2022

The California Workplace Technology Accountability Act aims to increase the accountability surrounding using technology in the workplace and reduce potential harm. Here are 10 things that you need to know about the proposed Act.

How to Manage the Risk of AI Bias in Identity Verification

October 20, 2022

AI Risk Management is the process of identifying, verifying, mitigating and preventing AI risks. Concrete steps must be taken at each stage of the AI lifecycle, to reduce the likelihood of bias.

What is Ethical AI?

October 18, 2022

Ethical AI is the practice of incorporating the principles of AI ethics, and other related concepts, such as trustworthy AI and responsible AI, into the design, development and deployment of AI systems.

Webinar: NYC Bias Audit Law

October 13, 2022

Local Law 144 takes effect on 1st January 2023. It mandates independent bias audits of automated tools which are used to make or support decisions about hiring candidates or promoting employees within New York City. Learn about how RHR International, a global leadership consulting firm, are working with Holistic AI to prepare for the upcoming deadline.

The White House Publishes its Blueprint for an AI Bill of Rights

October 11, 2022

The White House recently published a Blueprint for an AI Bill of Rights, signalling the intent of the U.S. government to regulate AI.

What Enterprises Need to Know About the EU’s AI Liability Directive

October 6, 2022

The AI Liability Directive is the EU’s proposed new law to make it easier to prove liability in cases where AI systems cause harm.

AI in Insurance Needs to be Safe and Fair

October 5, 2022

AI is increasingly being used in the insurance sector for risk assessments, fraud detection, underwriting, sales, and customer service. While this automation can increase efficiency, it can also introduce novel harms that must be managed.

What Enterprises Need to Know About the EU AI Act

October 5, 2022

The EU AI Act was first proposed by the European Commission in April 2021. It will be the first law worldwide which regulates the development and use of AI in a comprehensive way.

New York City Government Proposes Changes to the Mandatory Bias Audit Law: Here’s Everything You Need to Know

September 26, 2022

The New York City (NYC) Department of Consumer and Worker Protection (DCWP) published proposed amendments to Local Law 144, which mandates independent bias audits of ‘automated employment decision tools’ used by employers or employment agencies.

How Hired Chose Holistic AI to be Their Auditing Partner

September 2, 2022

Aware of the NYC Bias Audit legislation, Hired's CTO Dave Walters began vetting AI audit providers, deciding that Holistic AI was just what they were looking for. In his interview with Protocol, Dave outlines the criteria he used in his search for a partner.

What is Bias and How Can it be Mitigated?

August 30, 2022

Bias refers to unjustified differences in outcomes for different subgroups. To contextualise this, bias in recruitment could take the form of white candidates being hired at a greater rate than non-white when the race is not related to job requirements.

Facial Recognition is a Controversial and High-Risk Technology. Algorithmic Risk Management Can Help

August 26, 2022

Facial recognition has several applications, from controlling access to a building and unlocking devices to replacing a boarding pass and identification of suspects by law enforcement.

10 Things You Need to Know About Colorado's Legislation to Prevent Discrimination in Insurance

August 23, 2022

Colorado’s General Assembly enacted legislation last year that restricts insurers’ use of ‘external consumer data’, prohibits data, algorithms, or predictive models from unfairly discriminating, and requires insurers to test their systems and demonstrate that they are not biased.

NIST’s AI Risk Management Framework Explained

August 19, 2022

This blog explains the key elements of NIST’s AI RMF and why AI risk management will become embedded as a core business function in the coming years.

Regulating AI: The Horizontal vs Vertical Approach

August 16, 2022

In response to concerns about harm that can result from the use of AI and the calls for greater governance of AI systems by the AI ethics movement, legislation addressing the use of these technologies has begun to emerge.

Why Do We Need AI Auditing and Assurance?

August 12, 2022

An overview of three high-profile cases that highlight the risks associated with the use of algorithms, and outline how applying AI ethics principles could have prevented these harms from occurring.

Assessing the Impact of Algorithmic Systems

August 10, 2022

The upcoming EU AI Act also requires AIAs to determine whether a system is high-risk and subject to additional regulation. This blog post gives an overview of AIAs, DPIAs, and the difference between them, providing some examples of legislation that requires them.

Auditing vs Assurance: What’s the difference?

August 5, 2022

While auditing and assurance are related concepts and practises, they are distinct. In this blog, we give an overview of algorithm auditing and assurance, outlining the key components of each practice and how they link to each other.

AI Ethics 101

August 2, 2022

In this blog post, we provide an overview of AI ethics, first defining the term before discussing the approaches that bring about more ethical AI and the major themes in the field.

Pro-innovation: The UK’s Framework for AI Regulation

July 22, 2022

Under a new framework, in the UK, AI regulation will be context-specific and based on the use and impact of the technology, with responsibility for developing appropriate enforcement strategies being delegated to the appropriate regulator(s).

Regulatory Sandboxes and The EU AI Act

July 19, 2022

The EU Artificial Intelligence (AI) Act aims to lead the world in the governance of AI, requiring impact assessments to identify the risk associated with the use of AI systems and continuous management and mitigation of this risk.

Who Needs to Comply with the NYC Bias Audit Mandate?

July 11, 2022

New York City’s legislation requiring bias audits of automated employment decision tools is coming into effect in just a few months (1st January 2023) and has left many people wondering – do I need an audit, or am I exempt?

Regulating the Robots: NYC Mandates ‘Bias Audits’ for AI-Driven Employment Decisions

July 11, 2022

Recruitment tools driven by artificial intelligence (AI) algorithms – including game- or image-based assessments and algorithmically analysed video interviews – are becoming more mainstream, with uptake accelerated by the pandemic. The growing adoption of these tools has led to concerns about how they can be applied ethically and without discrimination.

10 Things You Need to Know About the NYC Mandatory Bias Audits [UPDATED]

October 31, 2022

‍Originally due to come into effect on 1st January 2023, the enforcement date of the NYC Bias audit law (Local Law 144) has been pushed back to 15th April 2023. Here’s what you need to know.

5 Things You Need to Know About the Illinois Artificial Intelligence Video Interview Act

July 11, 2022

The Artificial Intelligence Video Interview Act came into effect in Illinois on 1st January 2020, affecting employers who use artificial intelligence to analyse video interviews of job applicants. Here are the 5 things you need to know about this legislation.