Sometimes you’ll need to convert a data value based on information in another data source. Nexla handles this scenario with data maps. A data map is essentially a lookup table that can look up an attribute value and convert it. For example, use a data map to look up an ID value and convert it to a name value.
To use a data map, select the transformation Lookup in the transform editor, then select the correct data map and corresponding value.
How to Create a DataMap
There are two ways to create a data map.
- Send a data set to a data map destination
- Upload a file or manually input values
1. Send a data set to a data map destination
You may connect to any data source and use any data set as a data map. This allows for the possibility of dynamic data maps, which updates values based on the data source. For example, create a data map from an API and the data map will be updated with additional values from the API.
After you've gone through the first steps of preparing your data to send, follow these instructions to send to a Dynamic Datamap.
a. When sending a data set to be used as a data map, select Dynamic Datamap as the destination.
b. Then, create a name for your data map, optional description, and primary key. Once saved, the data map will be available for use in the transformation editor.
c. After transforming and sending, navigate back to My Data Sets. Next to the left menu panel, select To My Destinations.
d. Click on the three blue dots in the right corner of the data set you wish to activate. Select activate.
e. That’s it! Nexla will now continue to process your data and automatically monitor your data and alert you for any schema changes or pauses in activity.
2. Upload a file or manually input values
a. Click on the data maps icon in the left menu and then click on the Create Data Map button.
b. Manually add your data map values or copy-paste key and value separated by colon and spaced by line breaks or tab delimited. Then click save data map to save.
If at any point you need to look up a value that is not found within your data map, tell Nexla how you'd like those records to be noted via default values.