Three Senate Democrats filed a lawsuit Monday arguing that Acting Attorney General Matthew Whitaker’s appointment is unconstitutional and asking a federal judge to remove him.

The suit, filed by Sens. Richard Blumenthal of Connecticut, Mazie Hirono of Hawaii and Sheldon Whitehouse of Rhode Island, argues that Whitaker’s appointment violates the Constitution because he has not been confirmed by the Senate.

Whitaker was chief of staff to Attorney General Jeff Sessions and was elevated to the top job after Sessions was ousted by President Donald Trump on Nov. 7.

The Constitution’s Appointments Clause requires that the Senate confirm all principal officials before they can serve in their office.

The Justice Department released a legal opinion last week that said Whitaker’s appointment would not violate the clause because he is serving in an acting capacity. The opinion concluded that Whitaker, even without Senate confirmation, may serve in an acting capacity because he has been at the department for more than a year at a “sufficiently senior pay level.”

“President Trump is denying senators our constitutional obligation and opportunity to do our job: scrutinizing the nomination of our nation’s top law enforcement official,” Blumenthal said in a statement. “The reason is simple: Whitaker would never pass the advice and consent test. In selecting a so-called ‘constitutional nobody’ and thwarting every senator’s constitutional duty, Trump leaves us no choice but to seek recourse through the courts.”

The lawsuit comes days after a Washington lawyer challenged Whitaker’s appointment in a pending Supreme Court case dealing with gun rights. The attorney, Thomas Goldstein, asked the high court to find that Whitaker’s appointment is unconstitutional and replace him with Deputy Attorney General Rod Rosenstein.

The state of Maryland also made a similar court filing last week in a legal dispute with the Trump administration over the Affordable Care Act.

Rosenstein, the second-ranking Justice Department official, has been confirmed by the Senate and had been overseeing special counsel Robert Mueller’s Russia investigation. Whitaker is now overseeing the investigation.

The Justice Department issued a statement Monday defending Whitaker’s appointment as “lawful” and said it comports with the Appointments Clause, the Federal Vacancies Reform Act and legal precedent.

“There are over 160 instances in American history in which non-Senate confirmed persons performed, on a temporary basis, the duties of a Senate-confirmed position,” Justice Department spokeswoman Kerri Kupec said. “To suggest otherwise is to ignore centuries of practice and precedent.”

The Federal Vacancies Reform Act allows an acting official to serve in a vacant position for up to 210 days, though the official may continue serving while a president’s nomination to that position is pending before the Senate.