Repository navigation
Develop - #5
Merged
Merged
Develop#5
Conversation
…er, and modernize SQL - Normalize 3.51M-row lookup tables by decoupling repeated string columns from relational join keys, compressing total package assets to ~42.6 MB gzipped across 7 tables (cab_visit_hierarchy, cab_chronic_conditions, cab_device, cab_procedure, cab_meas_obs_test, cab_drug_ing_form, and unified cab_concept_names). - Add exported Taxis::loadReferenceTables() R function for automatic database ingestion with schema creation, skip guards (overwrite = FALSE), streaming insertions via DatabaseConnector::insertTable, indexing, and legacy cab_vocab_all_* compatibility views. - Modernize concept_ab_batch.sql and concept_ab_finalize.sql to directly query normalized integer tables and resolve names through cab_concept_names. - Add pre-flight legacy schema adapter in R/RunMining.R for automatic compatibility when running against un-normalized v57 databases. - Incorporate Supervisor Agent Astra recommendations (REV-084): retain custom CCSR procedures (130000000 series), preserve numeric fractional RVUs, retain 20-row visit hierarchy including level 9, and bundle pre-computed drug crosswalk as verified default. - Add testthat unit tests validating manifest integrity and package exports. All 63 tests pass; R CMD check passes cleanly with Status: OK.
…cks compatibility
SqlRender translates CREATE TABLE to CREATE TABLE ... USING DELTA AS SELECT CAST(NULL AS ...) on Spark/Databricks. An inline comment with a semicolon on the lag_bucket column definition caused SqlRender to misparse the comment as a column ('CAST(NULL AS delta/10) AS --,'), dropping the subsequent n_events column and triggering a ParseException in Spark.
…ab' into feature/normalized-reference-vocab
…-vocab feat: normalize and bundle reference vocabulary, add in-database load…
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
confirmed working at data network #4 (comment)