Data Synchronization Strategies For Digital Transformation

Digital Platform Part 9 Of 10

Behind the scenes of your new Progressive Digital Platform, it is likely that you will be aggregating data from multiple legacy systems and issuing instructions across various systems. For example, retrieving complete information about a customer may require retrieving information from a CRM system, ERP system, web shop and others. All of this requires a strategy for bringing that information together and keeping it all up to date.

For the purposes of this article, we will focus on data retrieval, however, the same principles apply for updating data.

There are two primary data synchronization strategies: periodic synchronization of data and real-time switchboard.

Switchboard

A “real-time switchboard” system deals with requests for information (e.g. the customer information explained above) by providing a single point of contact that queries the sub-ordinate systems (CRM, ERP, etc) in real-time for each inbound request for information. This has the advantage of providing the latest, up to date information to the requester. This approach is only suitable where the systems being contacted have some kind of API access and are reasonably stable and quick to respond. In environments with a large number of legacy systems, this approach is unlikely to work well.

data-synchronization-strategies

Sync

Where systems are unstable, slow to respond or lack a good API, a periodic synchronization of data may be a superior approach. In this approach at set intervals (once per hour / day etc) a synchronization Data Broker requests data about different data items (such as Orders) from all the different systems. The Data Broker collates all the results from the different systems and updates its own internal database containing a copy of the received data.

This means that users making requests do not have to wait for unreliable systems that may not respond (the Data Broker database will be cloud-based and very reliable). It also means that the data provided will always be out of date. If the synchronisation job runs once per day, then data could be 24 hours out of date.

Digital Adapters

In either approach Digital Adapters are typically built that front the legacy systems and provide modern access for the Data Broker. Typically these are required as the legacy systems typically do not play well with more modern systems!

Hybrid

In a more sophisticated platform a mix of both approaches may be suitable to accommodate the variance of reliability of the legacy systems that contain the data being request.

After learning about the various data synchronization strategies, the final stage in this series is to become familiar with access logging, legal issues and debugging.

For more information on any of the topics discussed in any of our digital platform blog series, please contact us.

Nick McKenna
Since 2004, Nick McKenna, BSc, MBCS Biography has been the CEO of McKenna Consultants. McKenna Consultants is a bespoke software development based in North Yorkshire, specialising in Cloud development, mobile App development, progressive web App development, systems integration and the Internet of Things development. Nick also holds a First Class Degree in Computer Science (BSc) and wrote his first computer program at the age of nine, on a BBC Micro Model B computer. For the last 21 years, Nick has been a professional computer programmer and software architecture. Nick’s technical expertise includes; Net Core, C#, Microsoft Azure, Asp.Net, RESTful web services, eProcurement, Swift, iOS mobile development, Java, Android mobile development, C++, Internet Of Things and more. In addition, Nick is experienced in Agile coaching, training and consultancy, applying modern Agile management techniques to marketing and running McKenna Consultants, as well as the development of software for clients. Nick is a Certified Enterprise Coach (Scrum Alliance), SAFe Program Consultant (SAI), Certified LeSS Practitioner (LeSS) and Certified Scrum@Scale Practitioner. Outside the office, Nick is a professional scuba diver and he holds the rank of Black Belt 5th Dan in Karate.