Handling In-Memory File Download and Parsing using KingswaySoft

29 May 2025
KingswaySoft Team

Downloading JSON or XML files typically requires saving them to a local staging area first. With KingswaySoft’s SSIS Productivity Pack, you can skip that step by processing the data entirely in memory. In this blog post, we demonstrate how this can be achieved.


Using Premium File Watcher Task to Monitor File Changes in an ETL Process

30 March 2023
KingswaySoft Team

In the general integration practice, it is a very common use case to monitor a folder path for any file changes, and as soon as a file with certain criteria lands in the folder or gets modified, a process should kick off or otherwise, an email notification should be sent via email. With the new Premium File Watcher Task added to our SSIS Productivity Pack in our most recent v23.1 release, this can be easily achievable in an automated fashion. In this blog post, we will demonstrate the design and configurations required to watch a file path on a continuous basis and send an email notification when a specific change happens in it.


Split and Parse Through JSON Structures using KingswaySoft

30 September 2022
KingswaySoft Team

Having a JSON response that needs to be properly parsed is a very common use case. This can be an advanced JSON structure like arrays, key-value pairs, etc. Our KingswaySoft JSON components can easily parse through them using the various settings and options available. However, there could be cases in which a JSON design is such that it could have records that need to be handled separately. In this blog post, we will discuss such a case.


Unzip and Read Files from Cloud Storage for Transparent ETL Processing

28 July 2022
KingswaySoft Team

In cases where you have a set of files compressed as a zipped folder in a cloud location, you might have requirements where you need to unzip these files first and then read them one by one to parse the data out to a destination database table or another set of files. To perform this manually wouldn't be as simple as it sounds. However, by using solutions provided by us, this can be easily automated.


Working with Concur API to Close Batches and Retrieve Report Files using KingswaySoft Components

28 June 2022
KingswaySoft Team

SAP Concur is a widely popular service for travel, expense, and invoice management, and there are many use cases in which you would need to access the endpoints to process a request and get the response back. One such business case would be finding and closing batches based on processed batch numbers, downloading a report, and storing the data in a database system. We will see how this can be done using KingswaySoft components.


Incremental Read of Email Messages when Working with POP3 Connections

28 September 2021
KingswaySoft Team

KingswaySoft provides Email Source component in our SSIS Productivity Pack product which can be used to read email messages from your mailboxes. And this component supports EWS, IMAP and POP3 protocols, it can be used to read emails from various email systems, including Microsoft Office 365, Exchange Server, Gmail, and almost all other major email services. It is fairly easy to read messages when working with EWS and IMAP protocols. However it is not very straightforward to achieve so when working with the POP3 connections. In blog post, we will show you how we can achieve such incremental reading using POP3 connections.


Announcing Migration Starter Pack v4.0 for Microsoft CDS and Dynamics 365/CRM

17 December 2020
Chen Huang

Our CRM migration starter pack has been widely used by many clients worldwide. We have just made some further enhancements to cover some important migration tasks.


Migrating Dynamics CDS/CRM Quote with Revisions in SSIS

16 September 2020
Chen Huang

In a prior blog post, we explained how to migrate quotes from one Dynamics CRM system to another however it only focused on the most recent quote. In this post, we expand on that migration and show you how to use our software to migrate Dynamics CDS/CRM quotes with revisions in SSIS.


Real-Time Salesforce Integration with Virtually Any Application or Database System

10 September 2020
KingswaySoft Team

Real-time data integration is now essential for immediate decision making by businesses across the world. With modern-cloud based services such as Salesforce and our Integration Gateway solution, integrate your Salesforce data with any application or database system in real-time.


Salesforce Attachments Integration with Microsoft Team Foundation Server

17 August 2020
KingswaySoft Team

Extracting and integrating attachments from Salesforce or Azure DevOps (formally Team Foundation Server) can be useful when moving attachments to different cloud storage or syncing the attachments between different systems. In this blog post, we detail how to extract attachments from both systems as well as write attachments to them.


Real-Time Integration: HubSpot to Dynamics CE/CRM

23 June 2020
Chen Huang

KingswaySoft Integration Gateway allows developers to set up webhook listeners to receive messages from modern cloud applications, and publish them to one or more message queues or file system. We'll show you how you can take it a step further by integrating HubSpot with Dynamics 365 CE/CRM in real-time.


Manipulate CRM ActivityParty Field Values

12 May 2020
KingswaySoft Team

Manipulating input data can be challenging when working with the JSON format of CRM's ActivityParty fields. Let us take you through the process.


Manage Dynamics 365 Documents in SharePoint via Server-Based SharePoint Integration

28 June 2018
KingswaySoft Team

With Dynamics 365 CE, you can leverage server-based SharePoint integration for document management. In this blog post we demonstrate how to work with server-based SharePoint integration to accomplish your document integration job.


Announcing Migration Starter Pack v3.0 for Microsoft Dynamics 365 Customer Engagement and CRM On-Premise

13 March 2018
Daniel Cai

Our CRM migration starter pack has been widely used by many clients worldwide. We have just made further enhancements to cover some important migration tasks.


How to Work with RESTful Endpoints in your SSIS ETL Process

27 February 2018
KingswaySoft Team

Connecting to an integrating with a REST API in SSIS can be a tricky process. In this blog post we will walk you through how our SSIS Productivity Pack can be used to simplify the development process. We will be working with ZenDesk as an example to demonstrate integration with a REST API feeding data in JSON format.


Integration between Magento and Microsoft Dynamics 365/NAV

05 December 2017
KingswaySoft Team

In this blog post we will discuss how you can integrate your commerce platform (Magento) with your ERP (Microsoft Dynamics 365/NAV) to provide seamless data transfers between the two systems.


Dance with CRM Statuses In ETL Project

31 March 2017
Daniel Cai

Microsoft Dynamics 365/CRM entities often have some special statuses that would prohibit update of the entity record when there are any other fields involved but the record itself is in a certain status. One of such entities is the CRM case entity which has a physical name of incident in the system. If a case is resolved, you can't make any further updates to the record, otherwise you will receive an error indicating the case has been resolved, it needs to be reopened in order to make changes. This applies to other entities that might have similar restrictions, and it imposes a challenges to data integration (or ETL) development. In this blog post, I will show you how to work around this situation.


Archive

May 2025 2 April 2025 3 March 2025 1 February 2025 1 January 2025 2 December 2024 1 November 2024 3 October 2024 1 September 2024 1 August 2024 2 July 2024 1 June 2024 1 May 2024 1 April 2024 2 March 2024 2 February 2024 2 January 2024 2 December 2023 1 November 2023 1 October 2023 2 August 2023 1 July 2023 2 June 2023 1 May 2023 2 April 2023 1 March 2023 1 February 2023 1 January 2023 2 December 2022 1 November 2022 2 October 2022 2 September 2022 2 August 2022 2 July 2022 3 June 2022 2 May 2022 2 April 2022 3 March 2022 2 February 2022 1 January 2022 2 December 2021 1 October 2021 1 September 2021 2 August 2021 2 July 2021 2 June 2021 1 May 2021 1 April 2021 2 March 2021 2 February 2021 2 January 2021 2 December 2020 2 November 2020 4 October 2020 1 September 2020 3 August 2020 2 July 2020 1 June 2020 2 May 2020 1 April 2020 1 March 2020 1 February 2020 1 January 2020 1 December 2019 1 November 2019 1 October 2019 1 May 2019 1 February 2019 1 December 2018 2 November 2018 1 October 2018 4 September 2018 1 August 2018 1 July 2018 1 June 2018 3 April 2018 3 March 2018 3 February 2018 3 January 2018 2 December 2017 1 April 2017 1 March 2017 7 December 2016 1 November 2016 2 October 2016 1 September 2016 4 August 2016 1 June 2016 1 May 2016 3 April 2016 1 August 2015 1 April 2015 10 August 2014 1 July 2014 1 June 2014 2 May 2014 2 February 2014 1 January 2014 2 October 2013 1 September 2013 2 August 2013 2 June 2013 5 May 2013 2 March 2013 1 February 2013 1 January 2013 1 December 2012 2 November 2012 2 September 2012 2 July 2012 1 May 2012 3 April 2012 2 March 2012 2 January 2012 1

Tags