Repository navigation
Develop - #2
Merged
Merged
Develop#2
Conversation
…ent into roadmap (ref #1)
…l application of TAXIS (ref #1)
…ependent evaluation protocol (ref #2)
…lowlist, and citations (ref #4)
…SQL pipeline (ref #5)
…ication harness (ref #5)
…verification (ref #5)
…anchor schemas (ref #6)
…cation suite (ref #6)
…LLM prompt framework (ref #6)
…fications (ref #7)
…ce pipeline (ref #7)
… results (ref #7)
…erification suite (ref #7)
…type provenance (REV-061) - Remove unsupported file citation from Section 6 of CONCEPT_AB_MINING_ENGINE_V57.md; clarify that SQL materializes unadjusted dir_ab, DR is calculated in analytical post-processing and verified in test harnesses, and production export transform is unverified (closing REC-060-1). - Expunge historical slide numbers and old case IDs from PHENOTYPE_PHEBRUARY_2026_TAXIS_INTEGRATION.md; establish 7 synthetic clinical archetypes (Archetype AMI-01 to AMI-07) with anticipated tier classifications (closing REC-059-4). - Authorship Consensus: Stephen H. Bandeian (PI), J. Marc Overhage (Co-PI), Gowtham Rao, Shaun Grannis.
…s and document adjudication principles
…te bounded v57 pipeline on PostgreSQL - Deeply cross-link OHDSI Forum Topic 20940 (Workgroup Updates) and Topic 25158 (Phenotype Aphril 2026) in PHENOTYPE_PHEBRUARY_2026_TAXIS_INTEGRATION.md, README.md, and CONCEPT_AB_MINING_ENGINE_V57.md. - Codify Book of OHDSI 2025 4-stage phenotyping loop (Idea -> Implementation -> Iteration -> Trust) and RWD error taxonomy. - Detail Objective Diagnostics (3-knot Poisson spline stability test, >25% deviation threshold), James Weaver measurement error analysis (40-fold MDD variation), Joel Swerdel trial concordance benchmarks (77% vs 23%), and VA CIPHER / DARWIN EU workflows. - Update Docker Synthea CDM fixture with visit_occurrence, device_exposure, and observation tables. - Ingest all 6 CAB vocabulary lookup tables (3.51M rows) into PostgreSQL concept_ab_vocab schema via extras/load_cab_vocab_postgres.py. - Successfully execute released concept_ab pipeline v57 (init, batch, finalize) on PostgreSQL via DatabaseConnector/SqlRender, materializing 43 tables in work_cab_test including cab_s55_pair_all (9,118 pairs). - Add live verification test extras/test_pipeline_v57_postgres_execution.py (all 10 test suites passing 100%).
Collaborator
Quality Assurance Code ReviewExecutive Summary & ScopeThis PR represents a major milestone, establishing the complete TAXIS Tripartite HADES Package Ecosystem across 113 files (~55k lines of additions). The codebase successfully integrates the Concept AB Association Mining Engine (v57), the Phenotype Recreation Engine ( Test Suite Verification ResultsI executed the full automated verification battery across all 7 verification harnesses. All 36 tests passed (100% pass rate):
Review & Architectural Findings
Minor Recommendations for Follow-Up Waves
Looks good for merge. |
… receipts, and harden SQL runners - Document live bounded minimal Pipeline v57 PostgreSQL execution milestone (43 tables, 9,118 mined pairs) across README.md, docs/mining/CONCEPT_AB_MINING_ENGINE_V57.md, and docs/mining/sql/README.md - Add documentation of 6 project reference vocabulary lookups (3.51M rows) in concept_ab_vocab - Implement and document Statement-Splitter & Empty-Statement Filter Protocol (REC-063-1) across R/RunMining.R and docs/mining/sql/concept_ab_run.R - Upgrade extras/test_pipeline_v57_postgres_execution.py with 3 independent known-answer test vectors and run receipt audit - Update extras/CodeToRun.R with schema guidance and parameter options - Maintain 100% SHA256 binary identity across released SQL files - Zero prohibited terms verified
… (DEC-GR-032) - Eliminate conversational metaphors and colloquialisms across all public documentation, study guides, and code comments - Standardize on publication-grade epidemiological and biomedical informatics terminology (empirically co-occur, temporal association, formal ontologies, provisional rule-out diagnostic billing codes) - Codify Dr. Gowtham Rao binding decisions DEC-GR-027 through DEC-GR-032 in Authoritative Decisions Register - Update PostgreSQL execution runner with audited ISO-8601 UTC receipts and source-derived observation person-days denominators - Verify 100% test pass on live PostgreSQL test harness and R package driver suite
…clarify partition semantics (REV-066) - Align SQL rendering and receipt recording in extras/run_cab_pipeline_postgres_minimal.R to ensure exact agreement of effective threshold parameters (0/0.0/0 for diagnostic run) - Record total CDM population and partition person count in run receipt and assert exact values in extras/test_pipeline_v57_postgres_execution.py - Clarify batch partitioning mechanics and runtime expectations in extras/CodeToRun.R, distinguishing full-input single-partition runs on small fixtures from 1/40th partition pre-flight verification on enterprise CDMs - All live PostgreSQL verification tests passed 100%
… specification - Authoritative scientific monograph in docs/knowledge_graph/TAXONOMY_SCIENTIFIC_FOUNDATIONS_AND_SPECIFICATION.md detailing historical provenance (Bandeian AHRQ/CMS episode-of-care foundation, Overhage clinical validation architecture), pathophysiological foundations, 32 semantic families, and complete 112 relation codes. - Architectural specification in docs/phenotyping/TAXIS_COHORT_AND_CONCEPT_SET_BUILDER_ECOSYSTEM.md detailing TAXIS integration across agentic (Pythia, Phenelope, FastOMOP, KEEPER) and programmatic (Capr, ATLAS 3.0, PHOEBE, Aphrodite) ecosystems. - Revert study leadership roster to core investigators per Dr. Rao directive (DEC-GR-033) while preserving scholarly literature citations. - 100% medical and scientific English compliance (DEC-GR-032).
…s and add classifier prototype - Frame clinical taxonomy and phenotype builder ecosystem documents as downstream application blueprints under DEC-GR-027 and DEC-GR-029 - Resolve REC-068-1: map pipeline v57 metrics to cab_s55_pair_all SQL columns, define continuity-corrected Directionality Ratio as a post-processing heuristic, state observational sequence limits, and clarify utilization stratification mechanics - Resolve REC-068-2: delineate external tools from prospective downstream concepts, remove unsupported efficacy claims, and document governance requirements - Resolve REC-068-3: remove ungrounded clinical prevalence percentages, replacing with illustrative scenario descriptions - Add working proof-of-concept concept pair classifier application in extras/applications/concept_pair_classifier/ with Python and R interfaces, cell suppression, and automated test suite
…temporal categories - Resolve REC-069-1: enforce strict privacy protection across Python and R classifiers; withhold rows with total < 5, mask small component cells to -1, suppress derived ratios (DR, dir_ab, lift) to prevent algebraic reconstruction of small counts, mask total count to prevent subtraction leakage, and drop raw unsuppressed columns in R data.frame return - Resolve REC-069-2: replace clinical-role inference labels with descriptive temporal sequence categories (Empirically Preceding, Empirically Following, Empirically Balanced, No Directional Precedence Observed, Directionality Suppressed); replace obsolete ASCII diagram in ecosystem specification with conceptual timeline review workflow - Resolve REC-069-3: align R interface in classifyConceptPairs to accept connection or connectionDetails, update prototype README, and add test_classifier_demo.R verified with DatabaseConnector on live PostgreSQL fixture
…rounding - Archive full 66KB scientific monograph to private manuscripts directory (local-private/manuscripts/) - Author concise, disciplined overview (docs/knowledge_graph/TAXONOMY_OVERVIEW.md) focused on empirical Pipeline v57 grounding (DR, Stratified Lift, temporal lag) and core 5 families - Add operational boundary notices (DEC-GR-027, DEC-GR-029) clarifying TAXIS as an empirical SQL mining engine with taxonomy as an illustrative downstream classification framework - Remove out-of-scope monograph from public repository and update document indexes in README.md and docs/knowledge_graph/README.md
…on classifier verification, and sync SQL binary digests
… federated UDM specs - Define Concept A, B, and AB entities and mathematical formulations in docs/mining/sql/README.md - Add comprehensive mathematical derivations, intermediate schema catalog, and multi-site federation in docs/mining/CONCEPT_AB_MINING_ENGINE_V57.md - Introduce FEDERATED_TAXIS_UNIFIED_DATA_MODEL_AND_META_ANALYSIS.md specifying multi-site data fusion across INPC, MarketScan, Optum, and CPRD with DerSimonian-Laird random effects meta-analysis and 95% prediction intervals - Resolve REV-071 recommendations in docs/knowledge_graph/TAXONOMY_OVERVIEW.md (explicit pair orientation, directionality invariance note, empirical lag bucket boundaries) - Update live pipeline execution run receipt and cross-link documentation
…cientific English, incorporate REV-072 recommendations, and add federated benchmark gate
…ervisory audit, and enforce bimodal progressive disclosure - Refactor root README.md using Bimodal Document Design: intuitive 3-step pipeline (Mining -> Directionality -> Phenotyping Utility), clear Scope Status Matrix separating Released, Demonstration, and Proposed components (DEC-GR-027, DEC-GR-029), and modular technical appendices. - Incorporate Astra-Supervisor audit REV-074 (REC-074-1, REC-074-2): restrict federated synthesis benchmark to ordinary forward-event model (anchor_code == 1), apply symmetric compatibility validation to directional pooling, reconcile prediction interval caveats and governance mappings. - Update verify_hades_conformance.py to recognize on.exit-scoped options and align PheValuator description.
…or low cognitive load
- Replace dense DAG causal inference jargon ('conditioning on intermediate mediators') with clear, accessible language explaining confounders vs. post-treatment steps.
- Streamline downstream utility bullets (richer phenotypes, negative controls, confounder selection, signal context).
- Simplify epidemiological timing note in Step 2.
- Add .Rhistory and .RData to .gitignore.
…ides for low cognitive load - Eliminate dense causal/DAG jargon across symposium deliverables (TAXIS_Brief_Report_v6.md, Poster_Presentation_Guide.md, symposium README.md) and study protocol (TAXIS_NETWORK_STUDY_PROTOCOL_V1.md). - Express confounder selection, baseline timing, and over-adjustment bias in clear, publication-grade English. - Streamline Proposer-Validator architecture and AI agent phenotyping sections in symposium README. - Clarify landmark analysis and immortal time bias in Phenotype Phebruary guide.
…and scope per REV-075/REV-076
…f-justification across documentation
… benchmark phrasing
…tributors and validators (DEC-GR-057)
…ion framework terminology - Incorporate core scientific insights from leadership working papers (DEC-GR-058): * Judea Pearl structural causal inference & automated DAG generation * Bill of Materials (BOM) nested process-of-care architecture (L1/L2/supporting) * Dual-track concept granularity (Anchor Concepts vs. Atomic codes) * Empirical LOINC measurement <-> SNOMED procedure crosswalking - Standardize methodological validation framework to neutral, objective scientific terminology (DEC-GR-059): * Rename to 'The Six-Point Empirical Validation Framework' across protocol, governance, and symposium docs * Eliminate personal over-crediting in headings and narrative descriptions * Maintain formal investigator attributions in author blocks and citation guidelines - Verified 100% PASS across all verification suites; zero prohibited terms.
…rative control architecture - Formalize Condition Sub-Episodes within BOM hierarchy (DEC-GR-060) - Document five-tier laboratory result value categorization (N, L, LL, H, HH) - Detail the table-driven declarative control architecture for repeatable knowledge rediscovery - Add Computable Patient Narrative and Health-Adjusted Life Expectancy (HALE) outcome modeling - 100% PASS across all verification suites; zero prohibited terms; no personal over-crediting
…1) separating released SQL from future roadmap
… BOM, cycles of care, and multi-order cascades (DEC-GR-062)
…rsity, and Regenstrief Institute
…orts, and align inclusion rule names for R-CMD-check
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.