Your Complete Manual to Prepare Master Data for ERP
A detailed manual for cleaning, coding, approving and migrating products, customers, suppliers, units, warehouses and bills of material—with quality metrics and ongoing governance.
Short answer: preparing master data is not copying Excel files into an ERP. It means agreeing on one trusted identity for every item, customer, supplier, location and unit; defining ownership, required fields, validity rules and survivorship when sources conflict; then testing that data inside real business processes before go-live.
If incomplete, duplicated or inconsistent data enters the new ERP, it does not improve. Its errors spread faster: wrong inventory, duplicate purchases, conflicting reports, weak production plans and users who stop trusting the system.
- DefineKnow what master data isReused business entities: item, customer, supplier, location, unit, account, asset or employee.
- CleanCorrect, do not merely moveRemove duplicates, standardise names and units, complete critical fields and link values to evidence.
- TestExercise the process, not only the fileBuy, receive, store, produce, sell and return a complete sample using candidate data.
- GovernMake quality continuousOwners, approvals, creation and change rules, KPIs and post-launch reviews.
What is master data—and what is not?
Master data describes relatively stable entities reused by many transactions. An item number, unit and category are master data. A sales order is a transaction. Inventory at the cutover moment is an opening balance, not an item master record.
| Data type | Examples | Treatment |
|---|---|---|
| Master data | Items, customers, suppliers, locations, units, BOMs, work centres | Clean, code, own and govern continuously |
| Reference data | Currencies, countries, tax codes, document types, statuses | Controlled list with limited change |
| Transactional data | Sales, purchases, production, movements and invoices | Decide what migrates and what remains archived |
| Opening balances | Stock by location and lot, receivables, payables, cash and WIP | Time-stamped snapshot with financial and operational reconciliation |
| Historical data | Prior transactions, reports and documents | Searchable archive or selective migration based on need |
Why does master data deserve its own workstream?
Every transaction depends on it. One unit-of-measure error can repeat through purchasing, receiving, inventory, production, costing and sales. A wrong supplier address is inconvenient; a wrong bank account can be a financial risk. A wrong case dimension can damage warehousing and shipping plans.
External numbers illustrate the operating burden, but they are not forecasts for your company:
- 82%One or more days every weekRespondents in McKinsey’s 2023 MDM survey spent at least one day per week resolving master-data quality issues.
- 66%Manual reviewRespondents used manual review to assess, monitor and manage master-data quality.
- 62%No defined integration processSurveyed organizations lacked a well-defined process for integrating new and existing sources.
- 59%Do not measure data qualityGartner reports that this share of organizations does not measure quality, obscuring both cost and improvement.
GS1 US illustrates error amplification with a case-dimension example: a quarter-inch error in recorded case height can severely distort pallet and truck calculations. Treat this as a supply-chain illustration, not a universal performance benchmark.
Step 1: define scope before opening files
Start from the business processes included in the first ERP phase, then derive the required data. If phase one includes purchasing, inventory, production and sales, the likely domains include:
- 01Items and servicesRaw material, WIP, finished goods, packaging, spare parts and services.
- 02Units of measureStock, purchase and sales units, conversions, packaging and decimal precision.
- 03CustomersLegal and trading identities, branches, shipping, billing, credit and tax.
- 04SuppliersIdentity, categories, payment terms, currency, tax, approved items and bank details.
- 05Warehouses and locationsPlant, warehouse, zone, bin, receipt, issue and count points.
- 06Bills of materialComponents, quantities, scrap, substitutes, version and effective dates.
- 07Production routingsOperations, sequence, work centre, time, capacity and setup.
- 08Accounts and dimensionsChart of accounts, cost centres, projects, tax and payment methods.
- 09AssetsType, number, location, purchase date, life, depreciation and maintenance.
- 10Users and employeesIdentity, role, department, location, manager and access; isolate sensitive HR data.
Step 2: establish clear governance
Assign roles for every data domain, not merely file owners:
| Role | Responsibility | Example |
|---|---|---|
| Data owner | Defines meaning, policy and acceptable quality | Head of procurement owns supplier data |
| Data steward | Reviews, creates, corrects and follows exceptions daily | Authorised employee reviews a supplier request |
| Domain expert | Defines business meaning and exceptions | Engineer validates item specification or BOM |
| Technical custodian | Implements validation, integration, access and audit | ERP or data team |
| Approver | Approves high-impact changes | Finance approves bank or tax changes |
| Consumer | Uses data and reports operational impact | Planning, warehouse, sales and accounting |
- Who requests a new record?
- Who checks for duplication?
- Who completes fields?
- Who approves?
- What is the expected service time?
- Who may change an approved record?
- How is a record retired without deleting history?
- Who reviews KPIs and exceptions?
If you cannot name the owner and approver, the domain is not ready—however tidy its spreadsheet looks.
Step 3: create a data dictionary and a decision for every field
Maintain one dictionary containing:
- Arabic and English field names.
- Business definition, not only technical description.
- Data type, length and precision.
- Whether it is required, and under which condition.
- Allowed values or reference list.
- Validation rule.
- Authoritative source.
- Field owner and steward.
- Sensitivity and visibility.
- Accepted and rejected examples.
- Mapping from the legacy system.
- DefinitionWhat does the field mean?Is lead time confirmation-to-receipt, or creation-to-inspection?
- SourceWhere is truth?Contract, supplier, physical measurement, finance, engineering or legacy system?
- RuleWhat is accepted?Format, range, list, relationship or a condition based on another field.
- OwnershipWho resolves conflict?The person holding the file is not always the decision owner.
Step 4: define coding and naming standards
Codes
Keep codes stable, unique and scalable. Avoid embedding too much meaning that can change. A code such as FG-Cairo-Red-2026 becomes misleading when location, colour or classification changes.
Store characteristics in separate attributes and use the code as a stable identity. If readable codes are operationally important, define a short structure with documented limits and generation rules.
Names
A useful name distinguishes the record in search and print:
Type + distinguishing attribute + size/capacity + material/grade + pack when needed.
Marble slab — Carrara — 20 mm — polished is better than white marble, but do not repeat every attribute inside the name.
Define Arabic and English rules, abbreviations, spacing, symbols and word order. Do not let each department invent a convention.
Status and lifecycle
Do not delete a record that has been used. Use states such as draft, under review, active, purchase-blocked, sales-blocked, blocked and expired. Define the transaction effect of each state.
Step 5: prepare every domain in detail
A. Item and product master
For every item, review:
- Unique code and clear Arabic/English name.
- Type: stock, non-stock, service, asset, expense, manufactured or purchased.
- Category, classification and technical attributes.
- Stock unit, purchase and sales units, and exact conversions.
- Fractional quantity, precision and rounding.
- Weight, dimensions, volume and measurement method.
- Lot, serial and expiry tracking where relevant.
- Inventory policy: reorder point, lead time, safety stock and negative stock.
- Costing method, accounts and taxes.
- Approved supplier or alternatives and supplier item number.
- Purchase, sales and production lifecycle status.
- Approved specification, drawing or document.
B. Customers
- Legal and trading names.
- Unique identity and duplicate prevention using tax ID or another appropriate identifier.
- Customer group, industry and region.
- Billing and shipping addresses as separate entities when needed.
- Registration and tax numbers with validity.
- Currency, payment terms, credit limit and block status.
- Price list, discount and tax treatment.
- Contacts with roles instead of one long text field.
- Parent, branch and relationship structure.
- Evidence source for sensitive fields.
Do not merge customers on name similarity alone; they may be distinct legal entities. Do not keep three records for one entity merely because branches entered its name differently.
C. Suppliers
- Legal and trading name and tax identifier.
- Category and approved materials or services.
- Ordering, payment and shipping addresses.
- Currency, payment terms and lead time.
- Approval, evaluation, documents and expiry status.
- Bank account, beneficiary and verification reference.
- Contacts and roles.
- Relationship to a customer or another party in the company.
Bank-detail changes require dual verification, segregation of duties and a complete audit trail. Deduplication never justifies copying financial details without review.
D. Bills of material
For each product and version:
- Code, revision, status, effective start and end.
- Base quantity and unit.
- Components, quantities, units and conversions.
- Allowed scrap and where it is recorded.
- Substitutes and usage rule.
- Co-products or by-products where relevant.
- Plant or production line where the version applies.
- Drawing, specification and engineering change reference.
- Engineering, production or quality approval owner.
Test multi-level explosion and ensure that no loop makes a product its own direct or indirect component.
E. Routings and work centres
- Operation sequence and description.
- Primary and alternative work centre.
- Setup time, run time and time unit.
- Production rate, capacity, calendar and shift.
- Yield, scrap and inspection points.
- Required tools and skills.
- Relationship between operation and component or stage.
- Overlap, queue and transfer rules.
Do not migrate a historical duration before deciding whether it is standard time, actual average or estimate. That definition changes schedules, capacity and cost.
F. Warehouses and locations
Create a hierarchy: company → site → warehouse → zone → bin when needed. For each location define:
- Code, name and type.
- Receipt, issue, production or quarantine permission.
- Allowed materials and restrictions.
- Lot, serial and expiry policy.
- Putaway and picking priority.
- Negative-stock permission.
- Transit location and accountable owner.
G. Finance, tax and dimensions
- Chart of accounts, hierarchy, level and type.
- Control accounts that reject manual journals.
- Cost centres, projects, branches and process relationships.
- Tax codes, rates, effective dates and accounts.
- Currencies, exchange rates and source.
- Payment terms, methods and banks.
- Item, customer and supplier category account mappings.
Finance must sign off this domain and test a journal, invoice, return and reconciliation—not only review the spreadsheet.
Step 6: inventory sources and define survivorship
Create a source register:
| Source | Potential strength | Risk |
|---|---|---|
| Legacy system | History and actual use | Old rules, free text and duplicates |
| Department spreadsheet | Operational detail | Multiple copies without ownership or change history |
| Contract or official document | Approved identity and terms | May be stale or difficult to read automatically |
| Physical measurement | Actual weight, dimensions and condition | Incomplete sample or uncalibrated tool |
| Supplier or customer | Latest information | Requires validation before approval |
| Business expert | Knows meaning and exceptions | Knowledge may be undocumented or differ across experts |
Step 7: profile the current data automatically
Measure before changing:
- Record count by source and status.
- Missing rate per field.
- Unique values, distribution and outliers.
- Duplicate codes and similar names.
- Unknown units or conflicting conversions.
- Invalid formats and out-of-range dates.
- Broken relationships: item without category, supplier without terms, BOM with missing component.
- Records unused for an agreed period.
- Sensitive values scattered through text columns or unprotected files.
Build a heat map: domain × quality dimension × business impact. Do not clean the easiest field first; start with the field that threatens the process.
Step 8: measure the right quality dimensions
Gartner lists nine common dimensions. GS1 guidance also emphasises completeness, timeliness, accuracy and physical verification. Use what matters to the process:
- AccuracyDoes the value match reality or the approved source?
- CompletenessAre required fields and instances present?
- ConsistencyIs the same value represented consistently across systems?
- UniquenessDoes each entity have one record inside the defined scope?
- ValidityDoes the value satisfy its rule, list and format?
- TimelinessDoes a change arrive before the data is used?
- IntegrityAre relationships between records complete and correct?
- PrecisionAre quantity, weight and conversion recorded with suitable rounding?
- AccessibilityCan an authorised consumer retrieve it when needed?
Useful formulas
- Completeness = populated required fields ÷ expected required fields.
- Validity = values passing rules ÷ values tested.
- Uniqueness = accepted unique records ÷ total records under the entity definition.
- Sample accuracy = values matching evidence or reality ÷ values inspected.
- Timeliness = changes completed within the agreed target ÷ total changes.
Do not compress everything into one score that hides risk. Quality may be 98%, while the missing 2% contains bank accounts or unit conversions.
Step 9: detect duplicates and build the golden record
Begin with deterministic matching: tax ID, GTIN, registration number, email, phone or a trusted external ID. Add fuzzy matching for names and addresses, but do not auto-merge ambiguous results.
For every duplicate cluster:
- Decide whether it is one entity or related entities.
- Select the surviving record or create a new identity.
- Choose the winning value per field using source, recency and approval.
- Preserve old-to-new code mapping.
- Move relationships and transactions under control.
- Record who merged, why and when.
- Test that reporting and balances remain intact.
Step 10: clean the defect and prevent its return
Cleaning without prevention creates a repeating project. Address root causes:
| Defect | Correction | Prevention |
|---|---|---|
| Inconsistent name | Transform and review | Naming template and controlled attributes |
| Duplicate customer | Controlled match and merge | Duplicate check before creation |
| Wrong unit | Evidence, approval and conversion | Unit list, required field and range test |
| Missing field | Complete from source | Conditional requirement and request owner |
| Stale value | Update with effective date | Periodic review and expiry alert |
| Untraceable change | Rebuild from evidence | Approval, audit trail and permissions |
Step 11: design the load file as a controlled product
Do not use an ad-hoc file that changes every day. Create a versioned template with:
- Instruction sheet, scope and version.
- Column definition and example.
- Type, length and allowed values.
- Required fields and conditions.
- Source, old-code and new-code columns.
- Validation result, error message and owner.
- Record state: new, corrected, approved, rejected or deferred.
- Extract date and freeze time.
- Data-owner sign-off.
Protect reference columns and formulas, use controlled lists and never circulate bank or personal data in an unprotected file.
Step 12: run migration rehearsals
Do not make the first complete load the production load:
- Cycle 0Small sampleTest template, coding, fields and basic rules.
- Cycle 1Early full scopeReveal real duplicate, missing-data and relationship volume.
- Cycle 2Corrected scopeTest performance, reports, processes and printed documents.
- Cycle 3Cutover simulationUse the timing, roles and reconciliation expected on launch night.
- Final cycleFrozen and approved dataLoad, reconcile and sign off before transactions open.
Step 13: test data through end-to-end scenarios
Select high-risk and high-frequency samples, then execute:
- Purchase request → approval → receipt → inspection → invoice → payment.
- Sales order → reservation → shipment → invoice → collection or return.
- Production order → material issue → operation and scrap → finished receipt → costing.
- Stock transfer across locations, units and lots.
- Count and adjustment with financial impact.
- Price, tax or bank change with effective date and approval.
Observe name, unit, quantity, account, tax, cost, report and printed document. The defect may not appear on the item card; it may appear at the end of the chain.
Step 14: separate master data from the cutover snapshot
After master records are approved, prepare the cutover snapshot.
Opening inventory
- Item, location and bin.
- Quantity and unit.
- Lot, serial and expiry.
- Quality or reservation status.
- Value and reconciliation method against the general ledger.
Open business data
- Remaining sales and purchase orders.
- Production orders and work in progress.
- Receivables and payables.
- Assets, bank and cash balances under the finance plan.
Define a freeze time, transaction handling during cutover and approval for any post-load difference.
Step 15: define acceptance gates
There is no universal quality percentage for every company. Set thresholds by field impact. An example requiring domain-owner approval:
- 100%Critical fieldsUnique identity, base unit, tax, control account, approved bank account and active BOM component.
- ≥99.5%Active-record completenessSuggested target for mandatory fields before launch, with approved exceptions.
- 0Unresolved confirmed duplicatesEvery confirmed cluster has a documented merge, separation or deferral decision.
- 100%Financial balance reconciliationLoad-to-source and general-ledger difference is zero or formally explained and approved.
Data-owner sign-off
- I reviewed definition, scope and source.
- I understand merge and survivorship rules.
- I reviewed quality KPIs and exceptions.
- Agreed scenarios passed.
- Count and balance differences are explained.
- I know who owns creation and change after launch.
- I approved deferred records and their remediation plan.
Step 16: govern after go-live
Data quality decays when products, people or systems change without process change. GS1 recommends regular master-file, governance and training reviews and physical product sampling because item accuracy can deteriorate over time.
A useful monthly dashboard includes:
- First-time-right creationSource qualityRequests approved without rework ÷ total creation requests.
- Request cycle timeService speedFrom request to approval and publication.
- Defects per 1,000 recordsQuality trendBy domain, rule and owner—not only a total number.
- New duplicatesPrevention effectivenessClusters created after launch and their source.
- Expiry and reviewData currencyRecords requiring review or documents approaching expiry.
- Business impactValueBlocked transactions, corrections or variances caused by master data.
An eight-week working plan
Week 1: scope and ownership
- Connect ERP phases to data domains.
- Name owners, stewards and approvers.
- Inventory sources and versions.
Week 2: dictionary and standards
- Define fields, values, units, names and codes.
- Set authority and survivorship rules.
- Classify sensitive data.
Week 3: profiling and baseline
- Analyse completeness, validity, duplication and integrity.
- Create the heat map and baseline.
- Rank defects by process impact.
Weeks 4 and 5: cleansing and approval
- Correct and standardise values.
- Review duplicate clusters.
- Collect evidence and physical measurements.
- Approve critical records.
Week 6: trial migration and testing
- Run a full trial load.
- Execute end-to-end scenarios.
- Correct rules, not only output.
Week 7: cutover simulation
- Freeze a source copy.
- Run roles, timing, reconciliation and sign-off.
- Test rollback and transaction handling during cutover.
Week 8: final load and handover
- Load approved data.
- Reconcile counts, balances and relationships.
- Hand over quality dashboard, creation/change workflow and support.
Eight weeks is an organising example. A narrow domain may take less; multiple plants or deep BOM structures may take longer. Never remove testing simply to fit the date.
Common master-data mistakes
- Migrating every record “just in case.”
- Leaving data decisions to technology or the vendor alone.
- Cleaning names while ignoring units, accounts and relationships.
- Merging records by name only.
- Encoding too many changeable meanings inside identifiers.
- Mixing master data, balances and history in one file.
- Measuring completeness while ignoring real-world accuracy.
- Assuming a populated field is correct.
- Running only one migration before go-live.
- Accepting unexplained count or balance differences.
- Giving everyone master-data edit access after launch.
- Ending the cleanup without an ongoing governance process.
How FLAPP experts can help
A FLAPP expert should not take your files and decide their meaning away from your team. The role is to structure decisions, expose defects and translate business rules into templates, ERP controls and tests, while approval remains with your internal data owners.
FLAPP can support:
- 01Data-discovery workshopsConnect ERP phases to domains, fields, risks and business ownership.
- 02Dictionary and standardsDefine fields, codes, names, units and reference values.
- 03Automated profilingMeasure missing data, duplicates, outliers and broken relationships before editing.
- 04Transformation mappingMap legacy fields and codes to FLAPP with documented rules.
- 05Cleansing supportRank duplicate clusters and exceptions and route them to the right decision owner.
- 06Controlled load templatesLists, validation, error messages and review and approval states.
- 07Migration cyclesRepeated trial loads with rejection, variance, count and reconciliation reports.
- 08Process testingExercise purchasing, inventory, production, sales and finance on real candidate data.
- 09Cutover planningFreeze, load, balances, approvals, rollback and temporary transaction handling.
- 10Post-launch governanceCreate/change access, approvals, KPIs, monitoring and steward training.
What FLAPP needs from you
- A business owner for every domain.
- Controlled access to required sources.
- Experts who know the real process and exceptions.
- Documents or measurements supporting critical fields.
- Time for review and approval.
- A clear decision when speed conflicts with quality.
FLAPP can accelerate profiling, transformation and migration and provide implementation experience. It cannot independently guess which legal identity, unit conversion or BOM represents your factory. The strongest result is a partnership: FLAPP experts structure and execute; your business owners define and approve.
Frequently asked questions
When should master-data preparation begin?
At the start of ERP design, not a few weeks before launch. Rules and ownership take time, and migration rehearsals need early data.
Should every historical transaction move to the new ERP?
Not always. Move what operations, law or analysis requires and consider a searchable archive for the rest. Moving everything adds cost and can transfer errors without value.
Does business or IT own master data?
Business owns meaning, quality and decisions. Technology manages structure, rules, integration and protection. Success requires both.
Can AI clean the data?
It can suggest matches, classifications, standardised names and anomalies. It should not merge sensitive records or decide business truth without evidence and approval. Use AI to accelerate review, not hide it.
What is the most important pre-launch metric?
There is no single metric. Focus on process-critical fields, scenario success, explained count and balance differences and clear ownership of every exception.
Sources and benchmark limitations
- Gartner: poor-data cost, measurement rates and quality dimensions.
- McKinsey: 2023 Master Data Management Survey.
- GS1: Data Quality Framework and product-master accuracy measures.
- GS1 US: operational impact of product-data quality.
- GS1 US: governance, ownership, measurement, verification and maintenance guidance.
External figures cover different organizations, sizes and industries. Do not use a survey percentage or average cost as your project ROI. Measure your own correction time, blocked transactions, inventory, variances, returns and manual work, then establish a baseline and risk-appropriate target.