ArcGIS Blog

Data Management

ArcGIS Solutions

5 great ways to use Data Loading Tools

By Mindy Longoni and Joel Smith and Alix Vézina

“I have loads of extra time!” said No One Ever. Seriously though, who couldn’t use a little more time? In a nutshell, Data Loading Tools—free with ArcGIS Pro—streamlines the process of loading data from a source to a target dataset, and it allows you to transform your data at the same time. Best of all, the process is repeatable: You can transform your data once and reuse that logic again and again.

Here are five ways to use Data Loading Tools:

1. Migrate data

Perhaps this has happened to you: A new data model or schema becomes available with improved features or functionality that your organization really needs—great! But then you realize that you have to migrate your data to take advantage of that functionality—not so great. Data migration is famously time consuming and difficult. That’s where Data Loading Tools comes in.

Let’s say that you’re a utility GIS specialist responsible for moving data from a geometric network to a utility network. Data Loading Tools allows you to map the data logically from source to target datasets using Excel workbooks. Because this mapping is saved in a series of Excel workbooks, you can migrate data in smaller chunks. You’d start with a pilot phase to confirm that the logic is appropriate for your migration, and then you’d use the toolbox to migrate data incrementally into the new data model or schema. You could even apply filters to perform quality assurance checks before you move completely into production or to split data from a single source into different target datasets.

Three stacked Excel workbooks with utility data.
Data Loading Tools helps you map data logically using a series of Excel workbooks.

2. Consolidate data

Another great benefit of Data Loading Tools is that you get the tools that you need to consolidate data from multiple data sources into one workspace.

Say you’re a data aggregator for your state. You regularly receive parcel data from each county that you must load into a statewide aggregated parcel layer. However, you may frequently receive data that is structured differently than your target workspace. With Data Loading Tools, you’d define how data should be loaded to your target database, helping you produce a seamless statewide dataset.

Four grayscale parcel layers with gray arrows pointing to a full-color aggregated parcel layer.
The ability to define how data is loaded to your target workspace helps ensure that your final dataset is exactly how you want it, regardless of how the data you initially received was structured.

3. Transform data

One of the greatest Data Loading Tools superpowers is the ability to transform data. More specifically, if you get data from one supplier, you don’t have to ask your supplier to modify their data to conform to your schema. Instead, you can use Data Loading Tools and an Excel workbook to conform the data on your end. The supplier formats the data as they like, you get what you need, and everyone wins.

Take address data, for example. If you’ve ever received address data from multiple suppliers, you know how messy it can be. One dataset may have the full address in a single field; the second may separate the house number and street name from the rest of the address; and the third may store the house number and street name in one field, the city in a second field, the state or province in a third field, and the postal code in a fourth. To be usable, the data needs to be transformed. The good news is that Data Loading Tools can help you define your data mapping using easy-to-configure Excel workbooks. You can even write calculation expressions to transform data, all within Excel.

Side-by-side maps and their data tables, with the left showing addresses in multiple fields and the right showing them in a single field.
Data Loading tools can help you transform address data that you get from multiple suppliers into one format that works for you.

4. Clean up data

Data is arguably the most important GIS component; an analysis is only as good as the data that goes into it. However, clean and ready-to-use data is as elusive as a unicorn. But with Data Loading Tools, cleaning up your data doesn’t have to be tedious or time consuming.

Remember the address data that Data Loading Tools helped you transform? Your address fields are now in great shape, but your street suffixes need a little help: Some are abbreviated, some are all caps, and some are abbreviated and all caps. No worries! Data Loading Tools can help you turn any st, St, or street to a consistent all-caps STREET, if that’s the format you prefer.

ArcGIS Pro attribute table of street addresses with inconsistent street-suffix formatting.
Variety may be the so-called spice of life, but not when it comes to address suffixes. Why not let Data Loading Tools help you clean up?

5. Archive data

Archiving data can be complicated, but it is especially beneficial if you run analyses cyclically (for example, monthly, quarterly, or yearly). Fortunately, Data Loading Tools can help.

If you’re a utility GIS analyst, you’ll find this functionality useful for your yearly inspection cycle. You’d use Data Loading Tools to define the mapping between your active workspace and your archive. The next time the analysis cycles back, you—or anyone else on your team—could clear the workspace and fill it with new, active data.

But not all cycles are calendar based. If you’re an emergency management professional, you know that disasters can occur at any time and that the data from one emergency offers valuable insight that is vital to preparing for the next. After the first emergency passes, you’d use Data Loading Tools to archive the old data, and then you’d clear the workspace for new incident data.

Map of emergency management data with multicolored point symbology.
Archiving data from one emergency ensures that you have access to that data the next time that a similar emergency occurs.

These five uses are only some of the repeatable and time-saving ways to put Data Loading Tools to work for you. So, how are you going to use all that time you just saved?

Resources

For more information about Data Loading Tools, check out the following resources:

Share this article