Working with Form-Urlencoded Request Body Using KingswaySoft
Discover how to handle unique client cases that require both authentication and payload data sent in the body using the x-www-form-urlencoded format. Set up authentication in Postman, configure the SSIS data flow, and utilize the XML Source component for parsing out data efficiently. In this blog post, we'll show you step-by-step how to achieve this seamlessly using KingswaySoft's SSIS Productivity Pack.
Writing Formulas to Excel Files in ETL Process
KingswaySoft’s Premium Excel Destination component not only allows you to write values to an Excel file but also supports formulas. By using formulas in your Excel file, it can open up your data flows to many more possibilities. In this blog post, we will demonstrate one example of using formulas to create hyperlinks in an Excel file.
Setting Up an OAuth Connection to Business Central Online
OAuth offers clear advantages over basic authentication, establishing it as the superior choice for data integration projects that involve processing or consuming your Dynamics 365 Business Central data. In this blog post, we will explore the secure and flexible nature of OAuth, its advantages over basic authentication, and its role in data integration projects. By following the steps outlined in this concise guideline, you will be able to create a connection manager using OAuth authentication for integration with Dynamics 365 Business Central online.
Bypass Power Automate Flows in Dynamics 365 Data Load Process
When loading data into Dynamics 365 using any API-based tools, any of your Power Automate flows you have defined will be triggered as the load occurs. This can result in unnecessary overhead for the data load. In this blog post, we will show you how to bypass Power Automate flows during data loading by leveraging the new features introduced in our latest v23.1 release.
Periodically Clean Up File Folders Using SSIS Productivity Pack
Applications and processes often rely on external resources, which can be expensive to retrieve or obtain. Therefore, modern applications often employ cache strategies to save these external resources in the local file system and achieve improved performance. In some other cases, you might have an application that keeps creating random temporary files to facilitate certain system requirements which cannot be achieved otherwise. However, as every coin has two sides, these caches or temporary files, in the long run, can build up in the system and occupy large disk space, which could have adverse effects and result in volume deficiency in the system. Implementing a scheduled cleanup of the cache folder by removing those files that are older than a certain age can become necessary in your ETL process.
Secure Your Integration Connection Using SharePoint Custom App Authentication
SharePoint Custom App (or Add-in app) option is a popular OAuth authentication method to connect to the SharePoint API. In our recent version, we have added support for Custom App in KingswaySoft SharePoint connection manager. In this blog post, we will go over its prerequisites, and how to configure it within our connection manager.
Using Premium File Watcher Task to Monitor File Changes in an ETL Process
In the general integration practice, it is a very common use case to monitor a folder path for any file changes, and as soon as a file with certain criteria lands in the folder or gets modified, a process should kick off or otherwise, an email notification should be sent via email. With the new Premium File Watcher Task added to our SSIS Productivity Pack in our most recent v23.1 release, this can be easily achievable in an automated fashion. In this blog post, we will demonstrate the design and configurations required to watch a file path on a continuous basis and send an email notification when a specific change happens in it.
Working with Embedded XML Content in an ETL Process
In some unique cases, we may receive an XML document that needs to be processed in the ETL process, which might contain general XML content but includes some embedded XML content made of escaped characters. The integration requires the embedded XML content to be fully parsed and processed. In this blog post, we will show you how to properly handle and transform mixed XML content with escaped characters to ensure the successful parsing of API responses and files.
Handle HubSpot Enumeration Field Options with KingswaySoft
Enumeration fields or optionsets need to be handled well in a migration scenario. And it is easy to not have an option in a target system, which was a legacy option in your Source data set. One such example would be currency options. Currency abbreviations can easily be missed, incomplete, or need to be changed to better reflect the destination system. In this business case, we are working with an old database system and have now been tasked to create the contact information in HubSpot.
Manage Unlicensed Users in CRM Using KingswaySoft
While migrating from CRM to CRM, or any other Source system to CRM, in an ETL, records will need to be associated with users. And since the Source and Target Systems are different, there may not be a guarantee that some users may still exist in the organization. And in such cases, such users become either unlicensed, or stub users. These type of users have restrictions when it comes to being set as an owner of records, and in this blog post, we will see how this can be handled efficiently.
Preserving Sensitive Properties in SSIS Packages
In SSIS, the sensitive credentials have to be handled in a special way to ensure that they get preserved and decrypted while the packages run in an unattended way. There are a few means to do this, and in this blog post, we will discuss some popular ways this can be done.
Switching to SharePoint OAuth Using KingswaySoft
With the recent news of SOAP basic authentication deprecation, it becomes imperative to start using the OAuth authentication for your SharePoint integration process. In response to this deprecation, we have recently added support for OAuth in the latest (v22.1) of our SharePoint toolkit, which offers a paralleled feature set as the SOAP service endpoint. It also includes some enhanced capabilities that were not possible using the SOAP service endpoint. This blog post will demonstrate the process involved in order to start using the OAuth authentication type in your integration.
Implementing Retry Logic in Custom HTTP Requests Using KingswaySoft
There are many reasons you might need to send retries on failed HTTP-based service requests, particularly when you are working with API integration in an ETL process. Now, a simple retry can easily be done in the HTTP Connection Manager using its built-in Retry on Intermittent Errors option. In addition, there might be cases in which you would want to implement a more customized retry on additional HTTP errors to facilitate a more resilient integration process. In this blog post, we will see how KingswaySoft can help in both scenarios.
Introducing the Metadata Source Type in CRM/CDS Source Component
It is not unusual to run into a business requirement that you need to extract Dynamics 365 metadata during your ETL process. We used to believe that this is not a general requirement until we have recently announced our DES deprecation replacement solution, in which it is important to have a way to retrieve the list of Option Set values along with their label values in the system since Dynamics Entity Changes feature only returns integer values for those option set/picklist options. In this blog post, we will discuss this scenario and how to work with our DES deprecation replacement solution.
Introducing User Multiplexing Feature in CDS/CRM Connection Manager
When working with Dynamics 365 online, your integration performance is subject to what is allowed by the server infrastructure managed by Microsoft. In particular, Microsoft has a throttling strategy in place to prevent exhaustive resource usage on the server-side from each individual tenant. This is for the good reason of making sure that the servers operate in a healthy environment, so that it does not degrade the overall performance of all other tenants in the same server group, while one tenant is performing a high-paced data load. However, this can create challenges when your data load has to be completed in a particular time window, in which case you might have exhausted all of your options to speed up the data load performance. In this blog post, we will discuss a new feature that can be used to overcome this limitation and boost data load speed.
Split and Parse Through JSON Structures using KingswaySoft
Having a JSON response that needs to be properly parsed is a very common use case. This can be an advanced JSON structure like arrays, key-value pairs, etc. Our KingswaySoft JSON components can easily parse through them using the various settings and options available. However, there could be cases in which a JSON design is such that it could have records that need to be handled separately. In this blog post, we will discuss such a case.
Using KingswaySoft to Work with Salesforce Bulk API
If you have a large number of records, you need to read and the process is taking longer than anticipated you may benefit from using Salesforce’s Bulk API. Salesforce Bulk API benefits you when you have many records (Salesforce states data operations with 2000+ records make a good candidate) in the Salesforce system and these records are being read synchronously. Today we will look at the features in Salesforce Bulk API and how KingswaySoft components make Bulk jobs easier.