
Healthcare AI That Keeps PHI Inside the Boundary
Healthcare has the clearest AI value and the least room for error. An assistant over clinical guidelines, patient records, and administrative knowledge could save enormous time — but protected health information leaking, even once, is the kind of failure that ends programs and triggers penalties. Healthcare AI that works keeps PHI inside the boundary by design: redacted at the wire, processed where the data lives, permissioned per user, and fully recorded.
- Luke SunejaClient Partner
In this article
Healthcare has the clearest AI value and the least room for error. An assistant over clinical guidelines, patient records, and administrative knowledge could save enormous time — but protected health information leaking, even once, is the kind of failure that ends programs and triggers penalties. Healthcare AI that works keeps PHI inside the boundary by design: redacted at the wire, processed where the data lives, permissioned per user, and fully recorded.
The non-negotiable: PHI stays protected
Everything about healthcare AI starts from one constraint: protected health information must stay protected. It can't be sent to an ungoverned service, can't surface to someone without a treatment or business reason to see it, and can't end up in a log that isn't itself protected. This isn't a preference to balance against convenience — it's a hard boundary that determines the whole architecture. An AI approach that treats PHI protection as something to add later has the design backwards.
Redaction at the wire
The first line of defense is that PHI doesn't leave the boundary in the first place. Redaction at the wire masks patient identifiers before a prompt crosses to a model, so the model gets the clinical or administrative context it needs to help without receiving the identity it doesn't. Done well, the assistant can reason about 'the patient' and stay coherent across a conversation while never handling the actual identifiers — which is exactly the minimum-necessary principle healthcare already lives by, enforced mechanically.
Processed where the data lives
Redaction protects what's in a prompt; self-hosting protects the rest. Running the AI inside the healthcare organization's own boundary means patient data, retrieved records, and the derived representations of them don't go to an outside service to be processed. For PHI, keeping processing inside the boundary you control isn't just safer — it's what makes the data-handling defensible, because you can say precisely where the data was and wasn't, and prove it.
Healthcare AI has to keep PHI inside the boundary by construction — redacted before it could leave, processed where it lives, permissioned per user, and recorded. Not as safeguards added on, as the design.
Permissioned to the care relationship
Access in healthcare follows the care and business relationship, and the AI has to respect that. Permission-aware retrieval ensures an assistant answers each person only from what they're authorized to access — a clinician sees what their role and relationship permit, an administrator sees administrative content, and neither sees beyond their scope. An assistant that ignored those boundaries wouldn't be a helpful tool; it would be an access-control failure with a friendly interface, which in healthcare is a reportable event.
A record for accountability
Healthcare runs on accountability, and AI interactions touching PHI need to be as accountable as anything else. A signed record of what the AI was asked, what it drew on, what was redacted, and who accessed it — with sensitive values protected in the record itself — means the organization can account for its AI's handling of PHI completely and verifiably. When the question is 'show us this was handled properly,' the answer is a query against a record, not a hope that it was.
Frequently asked questions
Keep PHI inside the boundary, by design. See how redaction at the wire, self-hosting, permissioned answers, and a protected record let healthcare run AI without risking protected data. Book a walkthrough.
Part of