mirror of
https://github.com/MBombeck/HealthLog.git
synced 2026-11-08 12:32:43 +00:00
Marc-André Bombeck
9eed407ccc
The dense hourly fold only took Apple Health and Health Connect samples, so heart rate from the provider syncs that store one row per sample stayed raw forever. One self-hosted account held about 25 million Google Health pulse rows after a full-history backfill, and every reader and fold that falls back to the raw table paid for it (#1297). The fold now walks a map of sources to the dense types each stores sample by sample: every dense type for Apple Health and Health Connect, heart rate for Google Health and Oura. Their daily SpO2 values are no intraday stream and stay as they are; Fitbit does not sync intraday heart rate, and WHOOP, Withings and Polar write dense types only once per recovery, night or spot check. Each source folds into its own hourly stats rows, and the DAY rollup is still taken from the raw samples before they go. The fold deletes the samples it averages, and the provider syncs write first-write-wins on the externalId, so a backfill or full sync would have put every folded sample back. Google Health would even have re-keyed an hourly row into a sample that fell on its anchor through the natural-key rescue. The folded_window rule now has one hour rule per fold source, and both syncs drop the samples of an hour the fold already took before they write. Recent samples cost no lookup. The boot discovery of the fold probes each account and source for the first raw sample it would take instead of grouping every such row, and the one-time fold repair stays on the two sources it was written for.