12 questions

What Should a Law Firm Ask an AI Vendor About Client Confidentiality?

Updated November 11, 2026

Short answer: Ask who stores your client's content, for how long, who can see it, and who could be made to produce it, and get the answers in writing. The 12 questions below cover those points, plus training, data location, ethical walls, audit reports, trials and cost. Each one is tied to what ABA Formal Opinion 512 asks lawyers to understand about an AI tool, and each notes what the vendors we checked actually say. Send them before a client's information goes in, and keep the answers with your records.

Why the questions matter

ABA Formal Opinion 512 (July 29, 2024) asks lawyers to "read and understand the Terms of Use, privacy policy, and related contractual terms and policies of any GAI tool they use" and to learn "who has access to the information that the lawyer inputs into the tool" (p. 7). It also says lawyers should determine whether the tool "retains information submitted by the lawyer before and after the discontinuation of services or asserts proprietary rights to the information", and whether the lawyer "will be notified in the event of a breach or service of process regarding production of client information" (p. 11).

The opinion explains the duty; it does not tell you what any vendor's terms say. These questions do that work. For what the opinion means for your practice, and how your state's rules differ, see our companion site: ABA Formal Opinion 512 explained and state-by-state rules. The Model Rules bind no one until a state adopts them, so your state's rules control.

The 12 questions

1. Does the vendor, or any model provider it uses, train on our data? Is that the default, or something we opt into?

Tied to: Opinion 512, p. 7, on self-learning tools. Every vendor we checked says it does not train on your data by default. Harvey says it "contractually guarantees through our Platform Agreement" that it does not; Thomson Reuters says CoCounsel's partners "are contractually prohibited from using any customer data to train their models." Ask for the promise in your contract, and ask whether anyone at your firm could opt in by accident, for example by sending feedback.

2. Who stores our prompts, documents and answers: the vendor, the model provider, or both? For how long, and is it backed up?

Tied to: Opinion 512, p. 11, on retention. This is where vendors differ most. CoCounsel, Clio's built-in AI and Spellbook all have zero retention agreements with their model providers, but store your content themselves: Thomson Reuters hosts "backup data in separate availability time zones in the U.S.", Clio performs "regular automatic data backups", and Spellbook stores data with "cloud providers with data centers in Canada and US". Ask about backups specifically; a deletion policy that does not reach backups is only part of an answer.

3. Is "zero data retention" offered for the product we will actually use, or only for an API?

Anthropic says "Claude Teams and Claude Enterprise product interfaces: These interfaces are not ZDR-eligible." OpenAI offers zero data retention on eligible API endpoints "subject to prior approval by OpenAI", not for the ChatGPT apps. A vendor's zero data retention claim may cover only its contract with the model provider. Ask which company, which product and which features it covers.

4. Who at the vendor can see our content, and under what process?

Tied to: Opinion 512, p. 7, "who has access". Answers vary. Legora says access is "only granted to engineers with written customer approval for support-related issues." Ask for the process in writing, including how you will know when someone looked.

5. If the vendor is subpoenaed or ordered to preserve data, what exists to produce, and will we be told?

Tied to: Opinion 512, p. 11, notice of "service of process regarding production of client information". In NYT v. OpenAI, a court ordered OpenAI in May 2025 to preserve user data it would normally delete; OpenAI says its obligations under that order ended on September 26, 2025. The lesson is that a court can order a provider to keep what it would normally delete. Harvey's public privacy policy reserves sharing to "comply with ... court orders, subpoenas, legal process". Ask what the vendor would have to produce, and whether it will tell you first. The subpoena page covers this in depth.

6. What happens to our data when we leave?

Tied to: Opinion 512, p. 11, retention "before and after the discontinuation of services". Legora says that after the contract, "all of your data ... is permanently deleted", after a chance to export it. Harvey says it will "delete your data in accordance with your Customer Agreement", so the terms are in your contract. Ask how long deletion takes, whether it reaches backups and subprocessors, and whether the vendor will confirm it in writing.

7. Where is our data processed and stored?

Thomson Reuters says "We process all interactions with OpenAI GPT and Google Gemini in the U.S." Clio processes data "in your region (US, Canada, EMEA, or APAC)". Harvey offers storage in the EU or Switzerland, the US, or Australia. Spellbook uses data centers "in Canada and US". Proton is "Built and based in Europe". Some clients, and some matters, care where data sits. Ask before you sign, not after.

8. Can we set retention to match our record-keeping duties, and who keeps the file of record?

Several vendors let you set retention: Harvey says you can "set retention policies, delete data anytime", and Legora that you can "Set and manage data retention periods to align with your internal policies." Shorter retention at the vendor means your firm must keep its own client file. A tool that keeps nothing moves that duty entirely to your own systems. Decide where the record lives before staff start using the tool.

9. What independent audit reports can we see?

Vendors list many certifications on their security pages, and they are the vendors' own statements. Ask for the report itself, under a non-disclosure agreement if needed, and read its scope and date. A logo on a web page is not a report.

10. Does the tool respect ethical walls and matter permissions?

Tied to: Opinion 512, p. 7, on information shared with people inside the firm. Harvey says it enforces the firm's ethical walls. Clio's AI works within the permissions the firm already set up in Clio. Microsoft says Copilot "presents only data that each individual can access" in Microsoft 365. Ask how the tool decides what each user can see, and test it with a walled matter during the trial.

11. Can we use real client data in the trial, and what are the trial's data terms?

Several vendors offer trials: CoCounsel lists "Request free trial", Spellbook lets lawyers "try Spellbook free for 7 days", and Proton offers "Try free for 14 days". Trial terms can differ from paid terms. Ask whether the trial runs under the same data terms you would sign, and if not, test with sample documents only.

12. What will it cost per lawyer per month, and is there a seat minimum or annual commitment?

Many legal platforms publish no price: Harvey, Legora, CoCounsel, Lexis+ with Protégé and Spellbook are sold by demo or quote. Some published terms are useful to compare: Microsoft says for Copilot Business "An annual commitment is required"; Anthropic says "Enterprise is billed annually", with usage charged on top of the seat price; Proton lists Lumo for Business at "$11.99 /user per month" billed yearly. Ask for the full price at your firm's size, including usage charges and any minimum.

How to use the answers

  • Send the questions in writing, and ask for written answers with a date. Keep them with the vendor's contract.
  • Compare the answers to the contract. A marketing page is not a promise. The terms you sign are the ones that count; Harvey's own privacy policy points to the customer agreement.
  • Decide what may go in. If the answers to questions 2, 4 and 5 leave content stored where you are not comfortable, limit what staff may put into the tool.
  • Ask again when the product changes. AI features change quickly, and so do names: Lexis+ AI is now Lexis+ with Protégé, and vLex Vincent is now Vincent by Clio.

The free checklist on this page puts all 12 questions on one page. For what each vendor keeps, see the main comparison.

This guide is general information, not legal advice. Your state's rules of professional conduct control.

About Faradex. Faradex is a private AI workspace for small and mid-sized firms that handle confidential client work. Each firm gets its own Workspace on dedicated infrastructure in the United States. Files and conversations are held in memory and are gone when the Workspace is reset. AI model: Currently Opus via AWS Bedrock, more information is available on our website. AWS does not store prompts or responses, and model providers have no access to them. Pricing: from $120 a month, no seat minimum; see faradex.ai/pricing.