Handling In-Memory File Download and Parsing using KingswaySoft
Downloading JSON or XML files typically requires saving them to a local staging area first. With KingswaySoft’s SSIS Productivity Pack, you can skip that step by processing the data entirely in memory. In this blog post, we demonstrate how this can be achieved.
Using Premium File Watcher Task to Monitor File Changes in an ETL Process
In the general integration practice, it is a very common use case to monitor a folder path for any file changes, and as soon as a file with certain criteria lands in the folder or gets modified, a process should kick off or otherwise, an email notification should be sent via email. With the new Premium File Watcher Task added to our SSIS Productivity Pack in our most recent v23.1 release, this can be easily achievable in an automated fashion. In this blog post, we will demonstrate the design and configurations required to watch a file path on a continuous basis and send an email notification when a specific change happens in it.
Split and Parse Through JSON Structures using KingswaySoft
Having a JSON response that needs to be properly parsed is a very common use case. This can be an advanced JSON structure like arrays, key-value pairs, etc. Our KingswaySoft JSON components can easily parse through them using the various settings and options available. However, there could be cases in which a JSON design is such that it could have records that need to be handled separately. In this blog post, we will discuss such a case.
Unzip and Read Files from Cloud Storage for Transparent ETL Processing
In cases where you have a set of files compressed as a zipped folder in a cloud location, you might have requirements where you need to unzip these files first and then read them one by one to parse the data out to a destination database table or another set of files. To perform this manually wouldn't be as simple as it sounds. However, by using solutions provided by us, this can be easily automated.
Working with Concur API to Close Batches and Retrieve Report Files using KingswaySoft Components
SAP Concur is a widely popular service for travel, expense, and invoice management, and there are many use cases in which you would need to access the endpoints to process a request and get the response back. One such business case would be finding and closing batches based on processed batch numbers, downloading a report, and storing the data in a database system. We will see how this can be done using KingswaySoft components.
Incremental Read of Email Messages when Working with POP3 Connections
KingswaySoft provides Email Source component in our SSIS Productivity Pack product which can be used to read email messages from your mailboxes. And this component supports EWS, IMAP and POP3 protocols, it can be used to read emails from various email systems, including Microsoft Office 365, Exchange Server, Gmail, and almost all other major email services. It is fairly easy to read messages when working with EWS and IMAP protocols. However it is not very straightforward to achieve so when working with the POP3 connections. In blog post, we will show you how we can achieve such incremental reading using POP3 connections.
Announcing Migration Starter Pack v4.0 for Microsoft CDS and Dynamics 365/CRM
Our CRM migration starter pack has been widely used by many clients worldwide. We have just made some further enhancements to cover some important migration tasks.
Migrating Dynamics CDS/CRM Quote with Revisions in SSIS
In a prior blog post, we explained how to migrate quotes from one Dynamics CRM system to another however it only focused on the most recent quote. In this post, we expand on that migration and show you how to use our software to migrate Dynamics CDS/CRM quotes with revisions in SSIS.
Real-Time Salesforce Integration with Virtually Any Application or Database System
Real-time data integration is now essential for immediate decision making by businesses across the world. With modern-cloud based services such as Salesforce and our Integration Gateway solution, integrate your Salesforce data with any application or database system in real-time.
Salesforce Attachments Integration with Microsoft Team Foundation Server
Extracting and integrating attachments from Salesforce or Azure DevOps (formally Team Foundation Server) can be useful when moving attachments to different cloud storage or syncing the attachments between different systems. In this blog post, we detail how to extract attachments from both systems as well as write attachments to them.
Real-Time Integration: HubSpot to Dynamics CE/CRM
KingswaySoft Integration Gateway allows developers to set up webhook listeners to receive messages from modern cloud applications, and publish them to one or more message queues or file system. We'll show you how you can take it a step further by integrating HubSpot with Dynamics 365 CE/CRM in real-time.
Manipulate CRM ActivityParty Field Values
Manipulating input data can be challenging when working with the JSON format of CRM's ActivityParty fields. Let us take you through the process.
Manage Dynamics 365 Documents in SharePoint via Server-Based SharePoint Integration
With Dynamics 365 CE, you can leverage server-based SharePoint integration for document management. In this blog post we demonstrate how to work with server-based SharePoint integration to accomplish your document integration job.
Announcing Migration Starter Pack v3.0 for Microsoft Dynamics 365 Customer Engagement and CRM On-Premise
Our CRM migration starter pack has been widely used by many clients worldwide. We have just made further enhancements to cover some important migration tasks.
How to Work with RESTful Endpoints in your SSIS ETL Process
Connecting to an integrating with a REST API in SSIS can be a tricky process. In this blog post we will walk you through how our SSIS Productivity Pack can be used to simplify the development process. We will be working with ZenDesk as an example to demonstrate integration with a REST API feeding data in JSON format.
Integration between Magento and Microsoft Dynamics 365/NAV
In this blog post we will discuss how you can integrate your commerce platform (Magento) with your ERP (Microsoft Dynamics 365/NAV) to provide seamless data transfers between the two systems.
Dance with CRM Statuses In ETL Project
Microsoft Dynamics 365/CRM entities often have some special statuses that would prohibit update of the entity record when there are any other fields involved but the record itself is in a certain status. One of such entities is the CRM case entity which has a physical name of incident in the system. If a case is resolved, you can't make any further updates to the record, otherwise you will receive an error indicating the case has been resolved, it needs to be reopened in order to make changes. This applies to other entities that might have similar restrictions, and it imposes a challenges to data integration (or ETL) development. In this blog post, I will show you how to work around this situation.