Data Migration: Tools and Techniques for Success (Part 2)

Welcome back to our data migration blog series! In this segment, we will dive into the practical steps of migrating data into D365, if you have already received data in the provided templates. Let us break down the process and explore the key steps to ensure a successful migration.

1. Choosing the Right Migration Tools

For a seamless data migration experience, there are primarily two tools at your disposal: Excel Add-in and Data Migration Framework (DMF). While other tools, such as Logic Apps, can also be used in conjunction with DMF, we will keep things straightforward and focus on DMF.

DMF is highly effective for importing data in batch jobs. It can manage large volumes of data efficiently, and if there are partial successes or errors, DMF provides detailed error reports, pinpointing the records that need correction. This feature allows you to reimport only the failed records from staging, streamlining the process.

2. Preparing Your Files

After receiving the data from the client in the provided templates, the first step is to ensure the files are ready for import. The Functional Consultant (FC) should review the files to verify their readiness. This review is typically done on a skim or sample basis. Once the FC approves the files, the Data Migration (DM) team should create a separate working file. This precaution ensures that any modifications or fixes do not affect the original data file.

3. Creating a DMF Project

With the files prepared, the next step is to set up a DMF project for the data load in D365. If you encounter partial imports or errors that require client fixes, it is beneficial to create a separate DMF project for reimporting the corrected records. This approach preserves the history of previous job executions and helps document the fixes applied, which can be valuable for avoiding similar issues in future loads.

4. Updating Enum Values

Enum values can pose challenges during data migration. Unlike records created at the form level, Enum values in DMF may not update automatically. To address this, follow a two-step approach:

• Step 1: Create the records using a DMF project.
• Step 2: Use a separate DMF project to update the Enum values.

For example, when dealing with released products, first use the data entity to release the product within the legal entity, and then update the Enum values for the released products in that legal entity.

5. Validating Data

Once your data is successfully imported, the next crucial step is validation. With large volumes of data, validating each field at the form level can be impractical. Instead, create a random sample of records and validate these on the form level. For more technical validation, SQL queries can be employed to cross-check data accuracy and integrity.

That concludes this part of our data migration blog series! I hope these insights help streamline your data migration process. Feel free to share your thoughts and any additional tips you might have. Stay tuned for more practical advice and in-depth discussions on data migration strategies!

Regards

Ammad Jawed

D365 Finance Functional Consultant

Email # ammad.jawed95@gmail.com