In our ETL development, we don't always receive the data in the exact format that we expect it to be. For instance, there might be cases that the incoming data is a string value while we expect an integer, or in some other cases, there might be unexpected whitespaces which can make the lookup difficult. This blog post will specifically cover the lookup scenario and show you how to achieve the lookup functionality without additional extra work.

It’s a very common practice to receive news updates using RSS feeds. Even though users are shifting to social media for getting news and headlines that are prominent, these platforms are controlled by algorithms that decide what news goes to which user, and users may see the headlines which the platform decides. RSS feeds provide all the contents that are published by the sources that can be subscribed to. Now, when it comes to integration, extracting RSS feeds data can be a challenging task without a proper tool. In our blog post here today, we will show how you could leverage KingswaySoft SSIS Productivity Pack to achieve this with ease, so that you could possibly consume the data in your ETL process with great control.

There are cases where you might need to work with a custom token for your HTTP connection's authentication. This is not very straightforward to achieve for your HTTP-based service calls. In this blog post, we will show you how you may leverage the Custom Token option offered in the KingswaySoft HTTP Connection Manager to extract such custom token and then use it in subsequent HTTP service calls.

KingswaySoft provides Email Source component in our SSIS Productivity Pack product which can be used to read email messages from your mailboxes. And this component supports EWS, IMAP and POP3 protocols, it can be used to read emails from various email systems, including Microsoft Office 365, Exchange Server, Gmail, and almost all other major email services. It is fairly easy to read messages when working with EWS and IMAP protocols. However it is not very straightforward to achieve so when working with the POP3 connections. In blog post, we will show you how we can achieve such incremental reading using POP3 connections.

Our Dynamics 365 toolkit offers an in-place lookup feature that provides many unique capabilities in supporting various lookup requirements. While the feature is extremely flexible and easy to use, there are certain limitations, such as it cannot be used in a transformation component, and it can support up to 2 different fields you can look up against for reach lookup configuration. In this blog post, we will demonstrate how you can use our recently released Premium Service Lookup component to perform some more advanced lookup scenarios when working with Dynamics 365 CDS/CRM/CE/Dataverse connections.

There might be cases where you would be receiving emails with some tables contained in the email body and you are tasked to extract data from those tables and transform them into a flat file or otherwise a database table. This can be a challenging situation without proper tools. In this blog post, we will demonstrate how to extract tables structures from an email using the Email Source component and HTML Table Source component from the KingswaySoft SSIS Productivity Pack.

Many of our clients are switching their Authentication to OAuth for their connections in our CDS and Microsoft Dynamics 365 CRM components. OAuth provides a better security infrastructure to protect your Dynamics data. The process of switching to OAuth authentication can be a bit confusing in the beginning if you have never worked on the concept before. In this post, we will walk you through the process with some great details to help you understand what is required and how OAuth works for our CDS/CRM connections.

This post will demonstrate how to perform file existence check in SSIS without writing a single line of code by using KingswaySoft Premium File Properties Task.

This post will give examples of how to query the SharePoint REST API data with filters and expanded properties, invoke functions using Premium OData Source component.

Excel has a rich set of options to write and save values for DateTime and currency data, in order for them to be presented in a meaningful way. However writing such data in a correct format isn't always straightforward in an ETL process, and it can be challenging when there are some special business requirements. In this blog post, we will show you how to write a proper currency format leveraging the power of the Premium Excel Destination component. 

When working with REST API, a common scenario may arise where there could be additional information returned from the API response and user needs to process and handle, in some cases it is extremely value to save such results. The challenge is the response returned by the service call is different from service to service. This blog post will demonstrate how to configure KingswaySoft JSON Destination component to send out JSON formatted request and extract API response and associate the response back to the original input rows to provide the most accurate reporting and troubleshooting.

While our Dynamics 365 toolkit supports Microsoft Dynamics 365 BC/NAV for reading and writing data, but the toolkit does not currently support Codeunit services. In this blog post, we will show you how to call Dynamics BC/NAV Codeunit services using the OData components that we have in the SSIS Productivity Pack product.

The major advantage of using the bulk load features is a significant improvement in data load performance. In this blog post we will be discussing about the bulk loading capabilities of the Snowflake Destination component that is available in our SSIS Productivity Pack product, which helps facilitate high-throughput writing to Snowflake data warehouse utilizing the Snowflake API.

In this blog post, we will be discussing the bulk loading capabilities in our Amazon Redshift Destination component that are available in the SSIS Productivity Pack product offering. The blog post shows you how to leverage the features to enable a high throughput data load utilizing the Amazon Redshift API.

In this blog post, we will discuss how to perform file upload using HTTP multipart/form-data format in SSIS without having to write a single line of code.

In this blog post, we will be going through some complex JSON document structures and demonstrate how to configure KingswaySoft JSON Source/Extract component to extract data from those JSON documents efficiently.

Explore working with Amazon Marketplace Web Service API by using HTTP Connection Manager and XML Source component offered in our SSIS Productivity Pack without writing a single line of code.