Claiming an ALJ Was Biased: How These Objections Work

You can object to the administrative law judge (ALJ) assigned to your SSDI case, but the rule sets a high bar. Under 20 CFR 404.940, a judge must not conduct a hearing if he or she is prejudiced or partial with respect to any party, or has any interest in the matter pending for decision, and your objection must be raised at your earliest opportunity.

Feeling that the judge was harsh with you is not enough, and neither is disagreeing with the outcome. This article explains how bias objections actually work, what conduct counts, and why waiting until after an unfavorable decision usually wastes the argument.

The Rule That Governs ALJ Disqualification

The core regulation, 20 CFR 404.940, works in three steps. First, the judge is disqualified if prejudiced, partial, or interested in the outcome, which HALLEX I-2-1-60 explains generally means a financial or personal interest in the result. Second, a claimant who objects must notify the ALJ at the earliest opportunity. Third, the ALJ considers the objection and decides whether to proceed or withdraw, and if the judge declines to withdraw, you may present the objection to the Appeals Council after the hearing as a reason the decision should be revised or a new hearing held before another ALJ.

SSA's internal rules add more ground rules. Under HALLEX I-2-1-60, ALJs must also follow federal ethics requirements, including the financial conflict rule in 18 U.S.C. 208 and the relationship rule in 5 CFR 2635.502. A judge may withdraw when participation would create an appearance of impropriety, meaning reasonable minds would question the judge's honesty, integrity, objectivity, or temperament. But the manual also states that disqualification is not a matter of personal preference, ALJs must have proper grounds, and blanket recusals across multiple cases are not allowed.

Why the Objection Must Come at the Hearing

The timing rule is not a technicality, and it is the reason most bias claims fail. Because the objection must be raised at the earliest opportunity, the ALJ gets the first chance to fix the problem by withdrawing. If the judge stays on the case, HALLEX I-2-1-60 requires the reasons for refusing disqualification to be documented, in writing before the hearing, on the record during the hearing, or in the decision itself if the objection comes late.

That documentation matters because of how the Appeals Council reviews the issue. Under SSR 13-1p, effective in 2013, the Council evaluates allegations of unfairness, prejudice, partiality, or bias under the abuse of discretion standard, and it relies solely on the information in the administrative record. The Council does not investigate, take outside statements, or consider evidence that never made it into the record. An objection raised for the first time after the decision, with nothing on the record from the hearing, leaves the Council with almost nothing to review.

In short: raise it early, be specific about what was said or done, and make sure it is captured on the record. Your representative can put the objection on the record at the start of the hearing if a written objection did not resolve it beforehand.

What Counts, and What Does Not

The abuse of discretion standard asks whether the ALJ's action was erroneous and without any rational basis, or clearly not justified under the circumstances of the case (SSR 13-1p and HALLEX I-3-3-2). The examples SSA gives are instructive.

Conduct that can amount to an abuse of discretion includes:

• Refusing to let you testify or cross-examine witnesses, which is a failure to conduct a full and fair hearing (HALLEX I-3-3-2).
• Not permitting you to submit evidence necessary to support your claim.
• Refusing to postpone a hearing despite physician documentation that you were too sick to attend.
• Failing to recuse in a case where the judge was actually prejudiced, partial, or interested in the outcome (SSR 13-1p).

What does not count is equally clear. SSR 13-1p lists two example allegations the Council will not even refer for investigation: that the ALJ is biased against me individually, and that the ALJ is prejudiced because she did not find me disabled. A judge's skepticism about your credibility, tough questions about daily activities, or pressing the vocational expert hard are opinions formed from your own case. The Supreme Court drew the same line for judges generally in Liteky v. United States (1994), holding that opinions built on what happens in a case are not bias unless they reveal a deep-seated antagonism that makes fair judgment impossible.

Claims that a judge shows general bias against a group, such as an allegation that an ALJ is biased against claimants who receive workers compensation, are handled differently. SSR 13-1p says those allegations are referred to the Division of Quality Service rather than weighed as a reason to change your claim.

Three Separate SSA Processes

SSR 13-1p describes three processes, and only the first can change your benefits:

• Appeals Council review. This is the only process that can produce a remedy on the claim itself. If the Council finds the ALJ abused his or her discretion, its sole remedy is a decision or a remand, and HALLEX I-3-3-2 notes that a remand after a failure to recuse may go to a different ALJ.
• Division of Quality Service complaint. You may file a written complaint within 180 days of the conduct, and SSA reviews it and may investigate. Findings can lead to counseling, training, or discipline, but they do not change any benefits decision, and the Privacy Act keeps the outcome confidential.
• Civil rights complaint. Discrimination based on race, color, national origin, religion, sex, sexual orientation, age, or disability can be raised on Form SSA-437-BK within 180 days. SSA's own form warns that even a finding of discrimination would not change a correct application of the law, and that the only way to change the benefits decision is to appeal it.

All three processes can run at the same time. A claimant can ask the Council for review, file a quality service complaint, and file a discrimination complaint, but only the appeal deadline protects the claim.

How Bias Arguments Fare on Appeal

At the Appeals Council, the argument lives or dies on the record. The Council will send a notice, order, or decision explaining that it considered the allegation under the abuse of discretion standard and whether it found an abuse (SSR 13-1p). Winning usually requires documented conduct of the kind SSA's own rules identify, such as excluded testimony or a refusal to develop evidence, not a complaint about tone.

In federal court, the bar is just as high. The court reviews the same administrative record and applies the same objective lens drawn from the general judicial standard described in Liteky (1994). Judges who asked hard questions, expressed doubt, or ruled against a claimant are not biased in any legal sense, and repeating the accusation without record evidence of prejudgment, hostility, or interest will not move a judge to reverse.

The practical lesson is to separate the two problems. If the ALJ genuinely excluded evidence or testimony, that is a procedural error worth raising early and preserving. If the disagreement is really with how the judge weighed the evidence, the better argument on appeal is substantial evidence or legal error, not bias.

Frequently Asked Questions

How do I object to the judge assigned to my disability hearing? Notify the administrative law judge at your earliest opportunity, in writing or on the record, with specific facts. Under 20 CFR 404.940 the ALJ considers the objection and decides whether to withdraw.

Can I complain about an ALJ without appealing my denial? Yes. Under SSR 13-1p you may file a written complaint with SSA's Division of Quality Service within 180 days, but that process cannot change the decision on your claim.

Does calling the ALJ biased help my appeal? Only if the administrative record supports an abuse of discretion. The Appeals Council relies solely on the record and treats disagreement with the outcome, such as the ALJ not finding you disabled, as an allegation of individual bias it will not refer for investigation (SSR 13-1p).

This article provides general information about Social Security Disability Insurance rules and is not legal advice. Program rules, regulations, and administrative procedures change over time, and all figures reflect standards applicable in 2026. Consult a qualified representative or contact the Social Security Administration directly for guidance regarding your individual claim.