The partner across the table had a deck. Fourteen slides. Slide nine was a wall of five-star badges: Super Lawyers, Best Lawyers, an AV Preeminent seal, a Chambers band, and a screenshot of a client review that read like it had been ghostwritten by the same person who writes airline apology emails. He slid it toward me with the confidence of a man who thinks the badges close the deal.
They do not.
I run legal for a mid-cap company. I sign the engagement letters, I approve the outside counsel budget, and I am the person who has to explain to the CFO why we paid $780 an hour for a fifth-year associate to reinvent a motion that exists in ten thousand prior filings. When I evaluate a firm I am not buying a brand. I am buying a specific outcome delivered by specific human beings whose track record I can verify without taking anyone’s word for it. The badges are marketing. I want the record.
So here is how I actually do it. Not the sanitized procurement-policy version. The version I run at my desk with fourteen browser tabs open and a healthy suspicion of anything that calls itself a rating.
the star rating lies more than the pitch deck
Start with the thing everyone trusts and nobody interrogates: the directory profile.
Legal directories are not one thing. They are at least three different businesses wearing the same costume, and if you treat them interchangeably you will get played. There is the peer-review model, the editorial model, and the pay-to-play model, and most of the big names are some blend of all three with the blend ratio kept deliberately fuzzy.
Martindale-Hubbell built its reputation on peer ratings. The AV Preeminent mark is supposed to mean other lawyers and judges rated this person at the top of the scale for legal ability and ethics. That framework goes back more than a century. It has real signal. It also has a self-nomination and confirmation process that a determined firm can shepherd along, and the parent company sells the plaques and profile placements, so the wall of a lawyer’s website is not a neutral referee. It is a store.
Super Lawyers, owned by Thomson Reuters, runs a nomination-plus-research-plus-peer-evaluation process and caps the list at a percentage of attorneys in a jurisdiction. Best Lawyers runs a pure peer-ballot model. Chambers and Partners does actual reporter-driven research, calls references, and interviews clients, which is why in-house buyers tend to weight Chambers rankings more than the badge farm. The Legal 500 does something similar. When a lawyer leads with a Chambers band and a set of named client references I can call, I lean in. When a lawyer leads with a generic seal and no methodology I can inspect, I discount it to roughly zero.
Then there is Avvo, which stapled a numeric score to lawyers whether they wanted one or not. The Avvo rating is algorithmic, driven partly by data the lawyer volunteers and partly by public records, and a lawyer who fills out every field and collects a few reviews can move the number in ways that have nothing to do with whether they can win my case. Avvo itself got tangled in ethics fights over its old lawyer-referral and marketing products; several state bars issued opinions questioning whether its pay-per-lead model amounted to improper fee-sharing or referral payments under the professional-conduct rules. New York, New Jersey, and others weighed in. The product model changed. The lesson stuck with me: the rating you see was built to serve the platform’s revenue, not your due diligence.
None of this means directories are useless. It means I read them like a skeptic reads a resume. I look at what a profile omits. A litigator with fifteen years of practice and zero reported decisions is telling me something. A profile that lists forty practice areas is telling me the lawyer does none of them at depth. A firm bio that describes representative matters in vague nouns, complex commercial disputes, sophisticated transactions, without a single verifiable client or docket, is a bio that survives only because nobody checks. I check.
what a bar record tells you, and what it buries
Before I get on a second call with anyone, I pull the bar record. Every one of them. Every state where the lawyer claims admission and every state where the matter might land.
The mechanics are boring and free. Nearly every state bar runs a public attorney search: name, bar number, admission date, current standing, and a public discipline history. California’s State Bar site is the gold standard for transparency; it shows admission date, status, and a full disciplinary and administrative-action record including probation and suspension, right there on the profile. New York’s Unified Court System has an attorney search. Texas has one through the State Bar. Florida the same. The formats differ, the completeness differs, and that variation is itself information.
Here is what a clean bar record actually tells you: this person is licensed, in good standing today, and has not been publicly disciplined in that jurisdiction in a way the bar chose to post. That is the floor. It is not the ceiling, and confusing the two is how buyers get burned.
What the bar record buries is almost as important. Private discipline, letters of caution, and diversions often do not appear. Pending investigations usually do not appear until they resolve, and resolution can take years. A lawyer who resigned from one state’s bar with charges pending might show up as simply resigned or not licensed rather than resigned in lieu of discipline. Reciprocal discipline lags; a suspension in one state can take months to register in another, so a lawyer sanctioned in Illinois might still read clean in the state where you are about to hire him. And the record almost never captures the thing you most want to know, which is competence. Plenty of lawyers with pristine bar records are mediocre, slow, and expensive. The bar is a licensing floor. It is not a quality screen.
So I cross-reference. I pull the discipline record from every jurisdiction of admission, not just the home state, and I check the ABA’s national lawyer regulatory data and the individual state disciplinary agencies. When I see a gap in a lawyer’s practice history, a two-year hole, a sudden move from one state to another, I ask about it directly. Not accusatorially. Just plainly. Good lawyers answer plainly. The ones who get squirrelly about a two-year gap are showing me the tell.
malpractice and discipline are public if you know where to dig
Discipline is only half of the risk picture. The other half is civil: has this lawyer, or this firm, been sued for malpractice, and how did it go.
Legal malpractice claims are civil lawsuits, which means they mostly live in court records, which means they are findable. I use PACER for federal filings and CourtListener, the free RECAP-backed database, to pull dockets without paying PACER’s per-page toll for everything. For state-court matters I use the county and state e-filing systems, which range from excellent to medieval depending on the jurisdiction. A malpractice complaint against a firm names the firm, describes the underlying representation, and lays out the theory of the botch. Even a dismissed or settled case tells me what kind of trouble a firm has stepped in before.
One caution I apply to myself: a single malpractice suit against a busy litigation firm is noise, not signal. Litigators get sued by unhappy former clients the way surgeons get sued by families. What I watch for is pattern. Three or four suits with the same fact shape, missed deadlines, blown limitations periods, conflicts they should have caught, that is a system failure, not bad luck. The blown-deadline cluster is the one that ends careers, because in most states failing to file before the statute of limitations runs is close to per se negligence once causation is shown.
Discipline reporting has produced public cautionary tales I actually cite when I train my team on why competence review matters. The one everybody now knows is Mata v. Avianca, Inc., 678 F. Supp. 3d 443 (S.D.N.Y. 2023), where lawyers filed a brief stuffed with fake judicial opinions that ChatGPT had hallucinated, then doubled down when the court asked for the cases. Judge Castel sanctioned the attorneys. That case is not really about artificial intelligence. It is about a firm that filed something it had not verified and a client who had no idea until the sanctions hit. If I had been that client I would have wanted to know, before I hired them, that nobody in the room checked the cites. You cannot fully screen for that in advance. But you can ask a firm to walk you through their verification and supervision process, and you can watch whether they treat the question as reasonable or as an insult.
I also read reported opinions for tone. When a court writes that counsel’s briefing was unhelpful, or that a party’s discovery conduct was sanctionable, that is a named, dated, citable fact about how a firm behaves under pressure. A lawyer can spin a loss on a sales call. A lawyer cannot spin a docket entry granting a motion for sanctions with his name on the receiving end.
the FTC finally made fake reviews expensive
Now the part that changed the math on client reviews, and the reason I stopped treating testimonials as pure theater.
In August 2024 the Federal Trade Commission finalized its Rule on the Use of Consumer Reviews and Testimonials. It took effect on October 21, 2024. For the first time there is a federal rule with real teeth aimed squarely at the fake-review economy, and it reaches service businesses, which includes law firms and the directories and marketing vendors they hire.
What the rule actually prohibits is worth stating plainly, because the marketing people at half the firms I deal with have not read it. It bans creating, buying, or selling fake consumer reviews and testimonials, including reviews from people who do not exist or who never used the service. It bans reviews that misrepresent the reviewer’s experience. It bans insider reviews, meaning reviews written by a business’s own officers, employees, managers, or their relatives, unless the connection is clearly and conspicuously disclosed. It bans buying positive or negative reviews. It bans company-controlled review websites that pose as independent. It restricts using legal threats and intimidation to scrub honest negative reviews. And it prohibits selling or buying fake social-media indicators like bot-generated followers and views when the buyer knew or should have known they were fake.
The number that matters to a buyer: violations can carry civil penalties, and the FTC has said the per-violation figure runs up into the tens of thousands of dollars, with the inflation-adjusted maximum sitting above $51,000 per violation. Stack that across a campaign of fake reviews and the exposure gets serious fast.
This did not come from nowhere. The Commission had already been swinging at review manipulation for years. It hit Fashion Nova with a $4.2 million settlement in 2022 over allegations the company suppressed lower-star reviews by using a system that let it approve the flattering ones and quietly hold back the rest, a practice known as review gating. In 2024 the FTC went after Rytr, an AI writing tool, over allegations that its service could churn out fake, detailed reviews at scale. The agency has pursued Roomster and a network of fake-review sellers. It has warned platforms and marketers. The 2024 rule takes that ad hoc enforcement and turns it into a standing prohibition the agency can penalize directly.
Here is why an in-house buyer should care and not just nod along. The rule reshapes the reliability of the exact signal that used to be worthless. If a law firm’s Google reviews or directory testimonials are now subject to a federal rule that makes fabrication a penalty-bearing offense, then a review carries slightly more weight than it did in 2023, because the downside of faking it went up. Slightly. I am not naive; enforcement is uneven and a lot of junk will still slide. But the review-gating ban in particular changes how I read a firm’s rating profile. If a firm shows a suspiciously perfect four-point-nine average across two hundred reviews with no texture, no mixed experiences, no honest one-star gripe about a billing dispute, I now read that not as excellence but as a possible gating operation that the firm had better hope nobody reports. The absence of any negative feedback is the anomaly worth flagging.
The rule also collides with legal ethics in a useful way. ABA Model Rule 7.1 already prohibits false or misleading communications about a lawyer’s services, and most states have adopted a version of it. A fake testimonial has always been an ethics problem for a lawyer. Now it is also a federal-penalty problem for the firm and potentially for the marketing vendor. When I ask a firm’s marketing contact whether their reviews comply with the FTC rule and Rule 7.1, and they look at me like I have grown a second head, that is diligence gold. A firm that has thought about it has an answer ready.
what verified credentials actually change, and what they do not
Every quarter someone pitches me a verification product. Verified badges, blockchain-anchored credentials, third-party attestation of a lawyer’s admissions and standing. Some of it is useful. Most of it is a solution racing ahead of the problem.
Here is the honest accounting. A verified credential is valuable exactly to the extent that it compresses my diligence time and pulls from an authoritative source. A badge that means a third party confirmed this lawyer is admitted and in good standing in these three states as of this date, and links me straight to the underlying bar records, saves me twenty minutes and gives me a timestamped snapshot I can file. That is real. A badge that means the lawyer paid a directory for a graphic is worse than useless, because it dresses marketing up as verification and trains buyers to trust the costume.
So I have a simple test. Show me the source. If a credential links to the California State Bar profile, the New York court attorney search, a PACER docket, or a court’s own opinion, it is verification. If it links to a marketing page, a self-reported form, or nothing at all, it is a sticker. I treat the two completely differently, and I tell firms that.
Board certification is the credential I actually respect, and buyers underuse it. Texas, Florida, California, and other states run legal specialization certification programs with real requirements: years in the specialty, a defined volume of relevant work, peer references, and a written examination. When a Texas lawyer is board certified in civil trial law by the Texas Board of Legal Specialization, that is a verifiable, hard-to-fake statement about focus and demonstrated competence in a way an AV seal simply is not. I check the certifying board’s own registry to confirm it, because people claim certifications they let lapse.
What verified credentials do not change is the thing that actually determines whether I am happy in month eight of an engagement: judgment, responsiveness, and whether the lawyer will tell me the answer I do not want to hear. No badge measures whether a partner will call me at 6 p.m. to say the deal has a real problem instead of burying it. No verification service captures whether the associate staffing my matter will still be at the firm in six months or whether I am about to eat a re-education tax when they leave. For that I use references, and I use the specific kind of reference call that gets past the reference’s instinct to be polite. I do not ask, would you recommend them. Everyone recommends everyone. I ask, what did they miss, what surprised you about the bill, and would you hire them again for the same matter knowing what you know now. The pause before the answer tells me more than the answer.
my actual routine, in order
People ask me for the checklist, so here it is, in the order I run it, stripped of ceremony.
First, before any second meeting, I pull the bar record in every jurisdiction of admission and every jurisdiction where the matter could land. Status, admission date, discipline history. Five minutes each. If anything reads suspended, resigned, or inactive without a clean explanation, the process stops there until it is resolved.
Second, I run the individual lawyer and the firm through PACER and CourtListener for malpractice suits, sanctions, and reported opinions in the relevant practice area. I am reading for pattern, not for a single data point. A cluster of missed-deadline malpractice claims kills the engagement. One old, settled matter does not.
Third, I read the reported decisions themselves, not the summaries the firm sends. I want to see how they wrote under fire, whether courts found their arguments useful, and whether their name appears on the wrong end of a sanctions order like the lawyers in Mata. I want wins in matters that resemble mine, argued the way I would want mine argued.
Fourth, I audit the review and directory profile with the FTC rule in mind. A perfect score with no texture is a flag, not a comfort. I look for the honest negative review and how the firm responded to it, because a professional, non-defensive response to a real complaint tells me how they will treat me when we disagree. I ask directly whether their reviews and testimonials comply with the 2024 rule and with Rule 7.1.
Fifth, I verify any credential that matters by going to the source. Board certification to the certifying board’s registry. Bar standing to the bar. Chambers or Legal 500 ranking to the publisher’s site to confirm the band and year, because lawyers quote five-year-old rankings as if they are current.
Sixth, references, run the hard way, with the questions designed to surface what went wrong rather than confirm what went right. I ask specifically to speak with a client who had a difficult moment in the engagement, not the firm’s happiest golfing buddy.
Seventh, and only seventh, do I care about the pitch deck. By the time I get there I already know most of what the deck is trying to tell me, and I am mostly watching whether what they say matches what I already verified. When it does, my confidence goes up. When the deck oversells a matter I have already read the docket on, the whole engagement is in question, because a firm that shades its own record to me will shade my matter’s status to me too.
the badge is not the lawyer
I want to be precise about what I actually believe, because the vendors keep trying to sell me the opposite.
The 2024 FTC rule is a genuine improvement. It made lying in reviews expensive, and it gave buyers a lever they did not have before. Verified credentials, the real ones that link to authoritative sources, save time and reduce fraud at the margin. Bar records and dockets are free, public, and far more honest than any marketing badge, and most buyers ignore them because clicking through fourteen tabs feels like work. All of that is true and all of it helps.
But none of it substitutes for the boring, unglamorous act of checking. The firm that impressed me most last year had a middling directory presence, no flashy seals, and one partner who, when I asked about a malpractice suit I had already found on PACER, walked me through exactly what happened, what they changed afterward, and why it would not touch my matter. He did not know I had already read the docket. He told me the same story the record told. That is the entire game. Not the badge. The match between what they claim and what the public record proves.
Directories will keep selling seals. Marketers will keep gaming ratings until the FTC makes an example of enough of them. Lawyers will keep leading with slide nine. Fine. I will keep pulling the record, because the buyer who reads the docket beats the buyer who reads the badge every single time, and the firms worth hiring are the ones who assume I already did.