[ajaits]

Summary

Updates the default check_deleted_records_percent (DELETED_RECORDS_PERCENT) threshold in tools/import_validation/validation_config.json from 0 (0%) to 0.1 (0.1%), and removes the redundant 0.1% check_deleted_records_percent rule from 67 per-import validation_config*.json files (68 files changed, 4 insertions(+), 533 deletions(-)).

Design & Follow-Up Golden Validations Analysis:

• Data Commons Import Golden Validations: Global StatVar & Place Selection and Per-Import Rollout

Changes

1. Default Validation Config (tools/import_validation/validation_config.json):
   • Updated check_deleted_records_percent (DELETED_RECORDS_PERCENT) "threshold" from 0 to 0.1.
2. Per-Import Validation Config Cleanup (67 Files):
   • Removed the identical check_deleted_records_percent ("threshold": 0.1) rule from 64 multi-rule validation_config*.json files while preserving all other import-specific validation rules (GOLDENS_CHECK, LINT_ERROR_COUNT, MISSING_REFS_COUNT, SQL_VALIDATOR, etc.).
   • Emptied "rules": [] in 3 single-rule validation_config.json files (scripts/us_bts/latch/validation_config.json, statvar_imports/cdc/CDCWonder_NNDSS_Infectious_Weekly/validation_config.json, and statvar_imports/us_nces/nces_employed_college_grads/validation_config.json) so manifest.json references remain valid and inherit the default 0.1% threshold cleanly.
   • Preserved all 15 custom-threshold / disabled validation_config*.json files that override check_deleted_records_percent with non-0.1 thresholds (0.05, 0.2, 0.3, 0.5, 0.6, 1.0, 2.0, 2.5, 6.0) or "enabled": false.

[gemini-code-assist]

Code Review

This pull request consolidates the validation configuration by removing the redundant check_deleted_records_percent rule from numerous individual dataset configuration files. Instead, the default threshold for the DELETED_RECORDS_PERCENT validator has been updated from 0 to 0.1 in the global tools/import_validation/validation_config.json file. I have no additional feedback to provide.