Bulk Loader Overview

Owned by Dan King
Last updated: Mar 13, 2019Version comment
1 min read

Overview

  1. Purpose of the Bulk Loader
    • The Bulk Loader is a process that is used to add several new addresses to the EAS at one time. This can be accomplished in a single batch or a series of batches for very large datasets (250,000+ records).
  2. What it Involves
    • There are several stages that make up the Bulk Loader process. Stages include importing raw datasets from CSV, parsing, filtering, geocoding, creating subsets and bulk loading the subsets.
    • Various filtering steps along the way contribute to a secondary set of addresses that were not loaded during the process. These artifacts can be reviewed and reprocessed at a later stage.
  3. Steps to Run
    • Each stage involves a series of steps. These steps are outlined in detail on the page Bulk Loader Process.
  4. EAS Tables Modified
    • address_base
    • address_base_history
    • addresses
    • addresses_history
    • address_sources
    • change_requests
    • cr_change_requests
  5. Artifacts Created
    • Parse stage
    • Geocode stage
    • Bulk Load stage