Starting Oct. 1, 2025, any California employer that uses artificial intelligence and other automated tools in recruiting, hiring, promotion and related human resources decisions will have to ensure that the tools don’t discriminate against protected classes.
If your firm uses AI or another data-driven system in hiring, you’ll want to beef up record-keeping and set testing procedures to ensure that the tools you use comply with the new regulations.
<body>
Starting Oct. 1, 2025, any California employer that uses artificial intelligence and other automated tools in recruiting, hiring, promotion and related human resources decisions will have to ensure that the tools don’t discriminate against protected classes.
The new regulations, promulgated by California’s Civil Rights Department, cover any “automated decision system” (ADS) which the rules broadly define to include any computer-based process that makes or influences employment decisions, such as:
- Artificial intelligence,
- Machine learning,
- Algorithms,
- Statistics, and
- Other data-processing techniques.
If your firm uses AI or another data-driven system in hiring, you’ll want to beef up record-keeping and set testing procedures to ensure that the tools you use comply with the new regulations.
What counts as an “automated-decision system”
Examples of systems that are covered by the new regulations include:
- Résumé screeners — These may favor applicants who use certain wording, which can disadvantage older workers or those from different cultural or educational backgrounds.
- Targeted job-ad delivery — Tools may push job ads to preferred genders, age groups, races and other protected classes.
- Puzzle or game-style assessments — These tools may screen out people with certain physical or neurological conditions.
- Voice and facial analysis tools — Tools that assess “enthusiasm” or “communication style” may produce biased results against applicants with disabilities, speech differences or accents.
Basics of the new rules
Discrimination risk — It is unlawful to use an ADS or other selection criteria that discriminate based on any protected characteristic such as race, gender and ethnicity. Crucially, an employer can be liable even without intent if the ADS causes an adverse disparate impact on a protected class.
Anti-bias testing — Employers are required to perform anti-bias testing of their automated systems. In any investigation or lawsuit, regulators and courts may look at six factors to determine whether an employer took reasonable steps to avoid discrimination:
- Quality of the testing
- Efficacy (how well it detects bias)
- Recency (how current it is)
- Scope (which systems or data were tested)
- Results of the testing or due diligence
- The employer’s response to those results (what was changed or fixed afterward)
Failing to conduct or document bias testing could weigh against an employer in a discrimination case.
Record-keeping — The rule requires employers to keep ADS-related records for four years.
What you can do
If you use an ADS system in your personnel decisions, focus on the following to comply with the new rules:
Tracking — Track your ADS system’s involvement in recruiting, hiring, promotion, training selection, performance screens or advertising. Include vendor tools and “off-the-shelf” filters.
Testing — Build a defensible bias-testing program and document the six factors that regulators will look at:
- Quality,
- Efficacy,
- Recency,
- Scope,
- Results, and
- Your response.
Planning — Establish a plan to regularly test your ADS systems for bias-tainted decisions. Most importantly, if you detect deficiencies, document the steps you took to address the problems.
The takeaway
One of the keys to a successful defense is showing you have taken steps to remedy issues with tools that you use in employment decisions. That means being able to show that you have ensured your data-driven personnel tools do not discriminate.
As a side note, employers should expect more AI-related legislation in the years to come as more companies use it in their day-to-day operations.
