Precisely Managing Metadata Changes in KingswaySoft Components
The components we developed at KingswaySoft generally discover metadata automatically whenever possible - That is, our software retrieves metadata information made available by the API itself in order to properly populate our ETL components. In most cases, the metadata in our components is generally accurate, provided the target system has a reliable metadata API. This includes services like Dataverse/Dynamics 365 CE, Salesforce, SharePoint, etc. Accurate metadata is vital for data integrity in ETL processes. However, there are occasional cases where some ETL metadata fine-tuning may be necessary due to unique situations. For instance, you might encounter cases where a text field contains more data than what is indicated by its metadata, potentially causing the source extraction to fail. In such instances, manual editing of the metadata will be required in order for the ETL process to work. In this blog post, we will show you how such changes can be made properly for your ETL components.