Feds are still using ID.me to scan your face — and its human reviewers can’t keep up

On Monday, the IRS stated that it would be transitioning away from using third-party facial recognition services provided by ID.me, ending a period of intense scrutiny for the newly prominent vendor. But inside the company, workers and executives have been dealing with a very different set of challenges.

Internal documents and former ID.me employees say the company was beset by disorganization and staffing shortages throughout 2021, as shortcomings in the automated systems created tensions among the company’s workforce, particularly the human verification workers who have to step in when the algorithms fail. Even now, the company plays a central role in how claimants access benefits across the United States — working on behalf of 27 state-level uninsurance employment programs to verify applicants — and the underlying issues are far from settled.

Current and former employees who spoke to The Verge paint a picture of a company described as being in “permanent crisis mode,” changing policies rapidly to keep up with fluctuating demand for its services and fight a slew of negative press. In particular, they say a lack of human review capacity has been a chokepoint for the company, leading to stress, pressure, and a failure to meet quality standards.

It’s an unexpected challenge for a biometrics system that’s usually seen as automatic, pointing to the often-ignored workers needed to support automated systems at scale. When the automated systems fail — ID.me says roughly 10 percent of users will need video chat assistance — it’s workers and subjects who are left to manage the consequences.

“There are some real-world consequences to these delays and inefficiencies,” said Jake Laperruque, senior policy counsel at the Project on Government Oversight (POGO). “When a tech like facial recognition doesn’t work, which it disproportionately doesn’t for women and people of color, then there’s a human cost, and that cost is augmented when these types of backup systems fail.”

As detailed in a Bloomberg profile, ID.me was founded 12 years ago under the name TroopSwap, a Craigslist-style site aimed at the military community. (Blake Hall is himself from a military background, having served in Iraq.) But TroopSwap later pivoted into an identity verification service that would give veterans a simple way to prove their status with one trusted site and use this to claim discounts and other benefits without handing over sensitive information.

As the company leaned into identity services, it rebranded as ID.me in 2012 and began a slow expansion that took off in June 2020 when it secured its first partnership with a state agency, the Florida Department of Economic Opportunity. With a foot in the door, many more deals with state agencies were to follow: by July 2021, it was being used in 27 states across the US and playing a key role in verifying the identities of unemployment insurance claimants during the pandemic surge.

ID.me’s expansion also included a large federal contract with the IRS that would see it verifying the identity of child tax claimants for the revenue agency in 2021. To keep up with demand, the company added 1,300 new employees between January and September 2021, including 500 to be based in a new office in Tampa, Florida, dedicated to customer support.

But as adoption increased, so did complaints. A Vice report found dozens of complaints from applicants who said they had been locked out of unemployment benefits when ID.me’s verification service had failed to identify them. When the automated system failed, applicants often faced long wait times to reach human reviewers, according to the report — wait times that became even more burdensome and difficult to navigate for people without access to reliable internet connections.

In May 2021, as complaints about wait times were blossoming, video review staff were given a raise of $5 per hour as a bonus for dealing with an increase in workload anticipated from the new IRS contract. But the growth in video calls didn’t rise to the levels that had been projected, sources inside the company said, meaning that higher pay levels could not be sustained, and the policy was ended in September 2021, reducing salaries by around 20 percent. (Salary data shared on Glassdoor matches sources’ assessments of the minimum and maximum pay offered to video reviewers at this time.)

“We temporarily increased pay from May through September 20th, 2021, for both current and new customer support personnel,” said Patrick Dorton, a spokesperson for ID.me, in an email to The Verge. “This increase was always communicated as a temporary measure. The date ranges for the temporary pay increase were clearly communicated to all customer support personnel before it went into effect.”

In addition to the pay cut, sources said, many staff were unhappy about the end of work-from-home policies, which were being phased out at the company at the same time as first the delta and then omicron variants hit the US. As in-office staffing levels rose, more ID.me employees began to contract COVID at work, sources said, in some cases taking whole teams offline at once.

“We take worker health and safety very seriously and have consistently implemented health and hygiene requirements on-site that meet or exceed state and local government legal mandates,” Dorton said. “To make the adjustment back to work easier, ID.me did increase office space capacity to allow for social distancing and a phased return to work.”

At the same time as bonuses for junior staff were being cut, ID.me announced that it had raised $120 million in financing from New York-based investment management firm Fortress Investment Group. This was the company’s second funding raise of 2021, following a Series C funding round in March in which it raised another $100 million at a $1.5 billion valuation. But internally, dissatisfaction over the loss of bonuses, the end of work-from-home policies, and other factors led to many employees leaving the company towards the end of 2021, creating a higher workload for remaining employees and driving up stress within the company, according to source interviews and communications shared with The Verge.

Employees complained of target quotas that left them struggling to keep pace and disincentivized supervisors from taking the time to properly address complaints from junior staff.

“In terms of worker treatment, it’s like the Amazon of identity protection,” one employee told The Verge.

When asked about quotas, ID.me said that performance metrics represented industry standard practice for customer service staff and that employee attrition rates at the company were also standard for the industry.

Employees also shared communications that detailed radical changes to workplace policy taking place with little notice. In a Slack post seen by The Verge, a member of the ID.me leadership team apologizes for implementing security “floor sweeps” without informing the majority of staff and acknowledges cuts to work-from-home policies.

Sources familiar with the situation said that these policies partly stemmed from an instance of inappropriate conduct that took place on video calls.

“Last year, an ID.me video chat agent engaged in inappropriate conduct. ID.me investigated the situation, and the company took immediate action to terminate the video chat agent,” Dorton said. “Following this incident, a thorough review of existing policies was conducted, and measures to prevent inappropriate conduct by video chat agents were strengthened.”

However, sources said that these quality checks have begun to fall by the wayside under the pressure of clearing through the backlog of video verification requests. Since November, employees say, quality assurance staff — whose role is to ensure that standards of customer service are being met by reviewing trusted referees’ work — have been spending 40–50 percent of their time doing basic document verification in order to help referees keep up with demand.

“There have been instances where Quality Assurance staff have temporarily assisted ID.me customer teams when wait times are long,” Dorton said. “This cross-training has the added benefit of ensuring that Quality Assurance staff has access to front line information about the experience of our customers. ID.me cares deeply about experience and prioritizes adequate staffing.”

Job postings from ID.me suggest that the company is beginning to switch some of its employee base towards a temporary, contract-based staffing model in order to manage shifting demand: a LinkedIn posting uploaded by ID.me in January 2022 offers candidates a $500 sign-on bonus for starting work as a member support representative, a job listed as a contract position with a duration of three to four months.

On January 19th, 2022, cybersecurity journalist Brian Krebs published a post on his highly trafficked blog giving a detailed account of his experience trying to use ID.me’s services to log in to an IRS account. Krebs was prompted to write the post after seeing an advisory message on the IRS.gov portal warning that existing login credentials would cease to work later in the year, a message that other users began to receive at around the same time.

Although the IRS had announced in November that the agency’s existing sign-in system would be replaced by ID.me by summer 2022, Krebs’ blog post put renewed focus on the imminent change. The ACLU labeled it “deeply troubling,” pointing to evidence that suggests facial recognition is less accurate at identifying people of color than white people; prominent AI researcher Joy Buolamwini published an op-ed in The Atlantic calling for the IRS to drop the use of biometric identification techniques; and a coalition of groups led by Fight for the Future organized a petition asking the tax agency to abandon ID.me.

As public scrutiny of the company increased, sources describe a siege mentality in which both internal and external criticism of the company was poorly tolerated by senior management and often deflected rather than addressed. In a message in a company Slack channel, Hall referred to negative press as a result of “competitors… pushing a false narrative to try to take away our contracts and, by extension, jobs of folks who work here.” In another message, Hall insisted that the company was “on the right side of history” after pushback against its facial recognition systems, a sentiment one employee flagged to The Verge as concerning.

When asked about Hall’s statements, Dorton said: “Because ID.me has by far the most effective solution available, competitors like LexisNexis, which sells its data to ICE and others, have at times resorted to using inaccurate narratives.”

Ultimately, the public scrutiny received in the last few weeks has led to a change of tack from ID.me. The company is now offering the option of a direct-to-human review process, but in light of inefficiencies, questions remain over the viability of the choice.

For people with limited income, internet access, or time, deciding between human verification and a face scan may be a forced decision, said Jake Laperruque of POGO.

“I don’t think it’s really fair to say ‘we’re giving people the option not to use facial recognition’ if there’s a huge cost in terms of time that someone has to take,” Laperruque said. “It’s not really an option if it’s quick facial recognition or manual login plus five hours of your time.”