mirror of
https://github.com/MBombeck/HealthLog.git
synced 2026-11-16 23:33:29 +00:00
fix(documents): close v1.25.1 library QA findings (backend)
Default documentDate at store time. A store-only upload no longer lands with a NULL filing date: when the client omits one, default it to the upload day so the column is always set on a stored row. The library list sorts, groups, and range-filters on the same effective date the UI shows, so undated uploads no longer mis-sort under nulls-last, break date-group headers, or fall through the range filter. The date stays user-editable and may be cleared back to NULL via PATCH. Block re-extraction once any fact is APPROVED. A partially-confirmed document stays EXTRACTED, which the CONFIRMED guard does not catch; re-extracting would delete the approved facts (severing the committed record's provenance) and re-stage them as PENDING, letting a second approval duplicate the committed lab / condition / medication. The extract route now refuses with 409 (documents.inbound.alreadyPartlyConfirmed) when approved facts exist; the user must finish reviewing or discard first. RFC 5987-encode the original-download filename. The Content-Disposition now carries both an ASCII filename= fallback and a filename*=UTF-8'' value so a non-ASCII name survives intact; the stored set is inline-safe by construction, so the dead attachment branch is removed. Add a light per-user rate-limit backstop to the original-read, PATCH, and DELETE routes (generous; self-DoS only — the routes are owner-scoped). Lean the list counts: tally facts for the whole page in one grouped count instead of materialising fact-id rows, and exclude REJECTED facts from factCount. Extend the documentDate index with deleted_at to cover the list scan. Document the deliberate plaintext-title PHI tradeoff at the column and the store site.
This commit is contained in:
1 parent
84543ad540
commit
eb1779d5c1
14 files changed
+317
-94
No files matched your search
@@ -13,8 +13,8 @@
|
||||
-- * `document_date` — user-set filing date (editable). Distinct from
|
||||
-- `report_date`, which stays the model-transcribed
|
||||
-- value.
|
||||
-- * a `(user_id, document_date)` index for date-grouped browse + range
|
||||
-- filter.
|
||||
-- * a `(user_id, deleted_at, document_date)` index for date-grouped browse +
|
||||
-- range filter (the list always filters `deleted_at IS NULL`).
|
||||
-- * `inbound_document_kind` gains LAB_RESULT / IMAGING / PRESCRIPTION /
|
||||
-- INSURANCE / VACCINATION (the existing 3 stay; OTHER stays the fallback).
|
||||
-- * `inbound_document_status` gains STORED, made the column DEFAULT (the
|
||||
@@ -79,6 +79,8 @@ BEGIN
|
||||
END IF;
|
||||
END $$;
|
||||
|
||||
-- CreateIndex: date-grouped browse + document_date range filter.
|
||||
CREATE INDEX IF NOT EXISTS "inbound_documents_user_id_document_date_idx"
|
||||
ON "inbound_documents"("user_id", "document_date");
|
||||
-- CreateIndex: date-grouped browse + document_date range filter. The list
|
||||
-- always filters `deleted_at IS NULL` and sorts by `document_date`, so
|
||||
-- deleted_at leads the sort column to keep the scan covered.
|
||||
CREATE INDEX IF NOT EXISTS "inbound_documents_user_id_deleted_at_document_date_idx"
|
||||
ON "inbound_documents"("user_id", "deleted_at", "document_date");
|
||||
+44
-37
@@ -59,10 +59,10 @@ model User {
|
||||
// without a home set) simply has no environment rows. `homeTimezone` anchors
|
||||
// the day-key an observation is stored under (it can differ from the display
|
||||
// `timezone` above for an account that tracks weather for another locale).
|
||||
homeLat Float? @map("home_lat")
|
||||
homeLon Float? @map("home_lon")
|
||||
homeLabel String? @map("home_label")
|
||||
homeTimezone String? @map("home_timezone")
|
||||
homeLat Float? @map("home_lat")
|
||||
homeLon Float? @map("home_lon")
|
||||
homeLabel String? @map("home_label")
|
||||
homeTimezone String? @map("home_timezone")
|
||||
// v1.25 — effective-from instant for the home location. Stamped the moment a
|
||||
// home is set/updated. Day resolution attributes a past day to home ONLY when
|
||||
// the day is on/after this instant; earlier days are skipped (never fabricated
|
||||
@@ -5581,39 +5581,44 @@ enum ExtractedFactStatus {
|
||||
}
|
||||
|
||||
model InboundDocument {
|
||||
id String @id @default(cuid())
|
||||
userId String @map("user_id")
|
||||
kind InboundDocumentKind @default(OTHER)
|
||||
/// User-given label. Plaintext (like `filename`) so the library list can
|
||||
/// sort + search in SQL. The document BODY stays encrypted; only this
|
||||
/// short, user-authored title is clear-text — it is what makes ILIKE
|
||||
/// search and ORDER BY possible.
|
||||
title String?
|
||||
id String @id @default(cuid())
|
||||
userId String @map("user_id")
|
||||
kind InboundDocumentKind @default(OTHER)
|
||||
/// User-given label. Deliberately plaintext (like `filename`) so the library
|
||||
/// list can ILIKE-search + ORDER BY in SQL. The document BODY stays
|
||||
/// encrypted; only this short, user-authored title is clear-text. Tradeoff:
|
||||
/// a title the user types MAY contain PHI (e.g. "HIV result") and is then
|
||||
/// cleartext at rest / in backups — the same exposure the pre-existing
|
||||
/// plaintext `filename` already carries. Accepted to keep server-side search
|
||||
/// and sort.
|
||||
title String?
|
||||
/// Original filename as uploaded (sanitised, optional).
|
||||
filename String?
|
||||
filename String?
|
||||
/// Magic-byte-sniffed MIME type the document was stored as.
|
||||
mimeType String @map("mime_type")
|
||||
mimeType String @map("mime_type")
|
||||
/// Stored byte length of the original (pre-encryption) document.
|
||||
byteSize Int @map("byte_size")
|
||||
byteSize Int @map("byte_size")
|
||||
/// AES-256-GCM ciphertext of the raw document bytes (base64 of the binary
|
||||
/// → `encrypt()` string → UTF-8 BYTEA), the `*_encrypted` Bytes convention
|
||||
/// shared with the note columns. The original is sensitive and never
|
||||
/// stored in the clear or logged.
|
||||
contentEncrypted Bytes @map("content_encrypted")
|
||||
status InboundDocumentStatus @default(STORED)
|
||||
contentEncrypted Bytes @map("content_encrypted")
|
||||
status InboundDocumentStatus @default(STORED)
|
||||
/// Provider type that ran the extraction (e.g. "anthropic", "openai",
|
||||
/// "local"). Diagnostic only. Null on a store-only document.
|
||||
providerType String? @map("provider_type")
|
||||
providerType String? @map("provider_type")
|
||||
/// The document's stated report/collection date (YYYY-MM-DD at UTC), as
|
||||
/// transcribed by the model — never inferred, never user-set.
|
||||
reportDate DateTime? @map("report_date")
|
||||
/// User-set filing date (editable). Distinct from `reportDate`, which is
|
||||
/// the model-transcribed value. The library shows `documentDate`,
|
||||
/// defaulting to `reportDate` then `createdAt` when the user hasn't set
|
||||
/// one.
|
||||
documentDate DateTime? @map("document_date")
|
||||
reportDate DateTime? @map("report_date")
|
||||
/// Effective filing date the library sorts, groups, and range-filters on
|
||||
/// (editable). Distinct from `reportDate`, which is the model-transcribed
|
||||
/// value. On store it defaults to the upload day (now) when the user does
|
||||
/// not supply one, so a stored row's filing date is never NULL and display
|
||||
/// == sort == filter. It stays user-editable and MAY be cleared back to
|
||||
/// NULL via PATCH (the list then sorts such rows last).
|
||||
documentDate DateTime? @map("document_date")
|
||||
/// Failure reason when status = FAILED (a short code, never the document).
|
||||
errorReason String? @map("error_reason")
|
||||
errorReason String? @map("error_reason")
|
||||
|
||||
facts ExtractedFact[]
|
||||
|
||||
@@ -5626,24 +5631,26 @@ model InboundDocument {
|
||||
|
||||
@@index([userId, createdAt])
|
||||
@@index([userId, deletedAt])
|
||||
@@index([userId, documentDate])
|
||||
// The list always filters `deletedAt: null` and sorts by `documentDate`, so
|
||||
// deletedAt leads the sort column to keep the scan covered.
|
||||
@@index([userId, deletedAt, documentDate])
|
||||
@@map("inbound_documents")
|
||||
}
|
||||
|
||||
model ExtractedFact {
|
||||
id String @id @default(cuid())
|
||||
documentId String @map("document_id")
|
||||
userId String @map("user_id")
|
||||
factType ExtractedFactType @map("fact_type")
|
||||
status ExtractedFactStatus @default(PENDING)
|
||||
id String @id @default(cuid())
|
||||
documentId String @map("document_id")
|
||||
userId String @map("user_id")
|
||||
factType ExtractedFactType @map("fact_type")
|
||||
status ExtractedFactStatus @default(PENDING)
|
||||
/// Overall extraction confidence 0..1 (the lowest per-field score). The
|
||||
/// review screen gates approval of a low-confidence fact behind a manual
|
||||
/// edit (fail-closed).
|
||||
confidence Float @default(0)
|
||||
confidence Float @default(0)
|
||||
/// True when the fact scored below the confidence floor and must be
|
||||
/// reviewed/edited before it can be approved. Cleared once the user edits
|
||||
/// the fact (the values then become user-asserted).
|
||||
needsReview Boolean @default(true) @map("needs_review")
|
||||
needsReview Boolean @default(true) @map("needs_review")
|
||||
/// The FHIR-staged fields, STATED status only, shaped per `factType`
|
||||
/// (Condition / Observation / MedicationStatement). Codes (SNOMED / ICD-10
|
||||
/// / LOINC / RxNorm / ATC) are present only when the document writes them.
|
||||
@@ -5651,20 +5658,20 @@ model ExtractedFact {
|
||||
/// medication names, stated codes) is clinical PHI transcribed verbatim from
|
||||
/// the source document, so it rides the AES-256-GCM `*_encrypted` BYTEA
|
||||
/// convention shared with the note columns rather than as plaintext JSONB.
|
||||
dataEncrypted Bytes @map("data_encrypted")
|
||||
dataEncrypted Bytes @map("data_encrypted")
|
||||
/// Per-field provenance: the verbatim source span the value came from, an
|
||||
/// optional page index, and per-field confidence. Makes "extract what's
|
||||
/// written" auditable against the original. The source span is a verbatim
|
||||
/// excerpt of the clinical document (PHI), so it is stored encrypted with the
|
||||
/// same codec as `dataEncrypted`.
|
||||
provenanceEncrypted Bytes @map("provenance_encrypted")
|
||||
provenanceEncrypted Bytes @map("provenance_encrypted")
|
||||
/// The id of the structured-store row created when the fact was approved
|
||||
/// (LabResult / IllnessEpisode / Medication), or NULL while PENDING /
|
||||
/// REJECTED.
|
||||
committedRecordId String? @map("committed_record_id")
|
||||
committedRecordId String? @map("committed_record_id")
|
||||
/// The structured store the approved fact landed in ("labResult" /
|
||||
/// "illnessEpisode" / "medication"), or NULL.
|
||||
committedRecordType String? @map("committed_record_type")
|
||||
committedRecordType String? @map("committed_record_type")
|
||||
|
||||
document InboundDocument @relation(fields: [documentId], references: [id], onDelete: Cascade)
|
||||
user User @relation(fields: [userId], references: [id], onDelete: Cascade)
|
||||
|
||||
Reference in new issue
Block a user