AI Tool Selection Checklist · v1
10 questions to ask before adopting any AI tool at your firm.
Run any vendor through this list. If you can't get a clear answer to a question, that's your answer. Print, fork, or paste into your firm's vendor-intake doc.
1. Bar compliance & confidentiality
- Where does my client data go when I use this tool? (local / third-party model / both)
- Does the vendor disclose which model it sends prompts to, and where that model is hosted?
- Does my state bar permit me to use this tool for the workflow I have in mind? Cite the rule or opinion.
- Will I need to disclose AI usage to clients or in pleadings? What does the engagement letter need to say?
2. Data handling
- Is my data used to train the vendor’s models? Can I opt out without losing features?
- Does the vendor offer Bring-Your-Own-Key (BYOK) so I control the model relationship directly?
- What is the data retention policy — how long do prompts and outputs sit on their servers?
- Does it integrate with my case-management system, or does data have to be copied in by hand?
3. Real-world fit
- Have I tested the tool on three real (anonymized) tasks from last week — not a demo dataset?
- What is the all-in monthly cost at MY firm size, including seats, overage, and required integrations?