Preserving Sensitive Properties in SSIS Packages
In SSIS, the sensitive credentials have to be handled in a special way to ensure that they get preserved and decrypted while the packages run in an unattended way. There are a few means to do this, and in this blog post, we will discuss some popular ways this can be done.
Switching to SharePoint OAuth Using KingswaySoft
With the recent news of SOAP basic authentication deprecation, it becomes imperative to start using the OAuth authentication for your SharePoint integration process. In response to this deprecation, we have recently added support for OAuth in the latest (v22.1) of our SharePoint toolkit, which offers a paralleled feature set as the SOAP service endpoint. It also includes some enhanced capabilities that were not possible using the SOAP service endpoint. This blog post will demonstrate the process involved in order to start using the OAuth authentication type in your integration.
Implementing Retry Logic in Custom HTTP Requests Using KingswaySoft
There are many reasons you might need to send retries on failed HTTP-based service requests, particularly when you are working with API integration in an ETL process. Now, a simple retry can easily be done in the HTTP Connection Manager using its built-in Retry on Intermittent Errors option. In addition, there might be cases in which you would want to implement a more customized retry on additional HTTP errors to facilitate a more resilient integration process. In this blog post, we will see how KingswaySoft can help in both scenarios.
Introducing the Metadata Source Type in CRM/CDS Source Component
It is not unusual to run into a business requirement that you need to extract Dynamics 365 metadata during your ETL process. We used to believe that this is not a general requirement until we have recently announced our DES deprecation replacement solution, in which it is important to have a way to retrieve the list of Option Set values along with their label values in the system since Dynamics Entity Changes feature only returns integer values for those option set/picklist options. In this blog post, we will discuss this scenario and how to work with our DES deprecation replacement solution.
Introducing User Multiplexing Feature in CDS/CRM Connection Manager
When working with Dynamics 365 online, your integration performance is subject to what is allowed by the server infrastructure managed by Microsoft. In particular, Microsoft has a throttling strategy in place to prevent exhaustive resource usage on the server-side from each individual tenant. This is for the good reason of making sure that the servers operate in a healthy environment, so that it does not degrade the overall performance of all other tenants in the same server group, while one tenant is performing a high-paced data load. However, this can create challenges when your data load has to be completed in a particular time window, in which case you might have exhausted all of your options to speed up the data load performance. In this blog post, we will discuss a new feature that can be used to overcome this limitation and boost data load speed.
Split and Parse Through JSON Structures using KingswaySoft
Having a JSON response that needs to be properly parsed is a very common use case. This can be an advanced JSON structure like arrays, key-value pairs, etc. Our KingswaySoft JSON components can easily parse through them using the various settings and options available. However, there could be cases in which a JSON design is such that it could have records that need to be handled separately. In this blog post, we will discuss such a case.
Using KingswaySoft to Work with Salesforce Bulk API
If you have a large number of records, you need to read and the process is taking longer than anticipated you may benefit from using Salesforce’s Bulk API. Salesforce Bulk API benefits you when you have many records (Salesforce states data operations with 2000+ records make a good candidate) in the Salesforce system and these records are being read synchronously. Today we will look at the features in Salesforce Bulk API and how KingswaySoft components make Bulk jobs easier.
Archiving and Deleting Dynamics CRM/CE Audit Logs for Efficient Space Management
Audit logs take up a lot of space in your CRM/CE instance, and there are cases where you would want to have a way to archive the audit logs and have them removed from the system after archiving, to reclaim the space in an automatic manner. Using KingswaySoft, this can be easily achieved.
Using KingswaySoft to Send Emails with Attachments Dynamically
Sometimes we need to attach files with specific conditions to one email and send it. In this blog post, we will show how you can quickly do it by using our components.
Extracting CRM Entity Metadata using Premium OData Components
In this blog, we are trying to get the metadata information from Dynamics 365 CRM API and save the entities and attributes in different tables. This is useful in many use cases where you wish to get a list of all the present entities and their corresponding metadata as a part of your integration - especially for further parameterization plans.
Unzip and Read Files from Cloud Storage for Transparent ETL Processing
In cases where you have a set of files compressed as a zipped folder in a cloud location, you might have requirements where you need to unzip these files first and then read them one by one to parse the data out to a destination database table or another set of files. To perform this manually wouldn't be as simple as it sounds. However, by using solutions provided by us, this can be easily automated.
Use KingswaySoft Components as the Replacement of the Deprecated DES Service
As you all know, Microsoft is deprecating their Data Export Service (DES), which has been used by many enterprise clients for data archiving purposes. There isn't a proper replacement option offered by Microsoft after the deprecation. In this blog post, we will discuss how you can use our SSIS Components to achieve the same purposes.
Working with Concur API to Close Batches and Retrieve Report Files using KingswaySoft Components
SAP Concur is a widely popular service for travel, expense, and invoice management, and there are many use cases in which you would need to access the endpoints to process a request and get the response back. One such business case would be finding and closing batches based on processed batch numbers, downloading a report, and storing the data in a database system. We will see how this can be done using KingswaySoft components.
Download Document Version History from SharePoint in SSIS
SharePoint Document Library supports version histories, so you can store and track different versions of each document file within the library as changes are made to the file. Such version control infrastructure provides many unique benefits. For instance, if something went wrong with one of the files because of a recent accidental/unintended change, you can easily restore it to a prior version as needed. Also, in your ETL development, you might often run into the requirements that you need to extract all previous versions of a file. In this blog post, we will show how to achieve this using our SharePoint Source component to download document library file versions and using the Premium File System Destination component (offered in SSIS Productivity Pack) to save them to a local file system in SSIS.
Working with NetSuite Custom Fields using KingswaySoft SSIS Components
NetSuite Custom fields are fields that you can add to records and transactions which can be used to save some additional information. This provides quite some flexibility when working with the NetSuite application if we have some special business requirements which cannot be accomplished using those out-of-box fields. Once added, those fields require some special attention in order to use use them in SSIS ETL data flows. In this blog post, we will show you how this can be done easily by using KingswaySoft components.
Extracting CRM entity metadata using KingswaySoft JSON Components
In this blog, we are trying to get the metadata information from Dynamics 365 CRM API and save the entities and attributes in different tables. This is useful in many use cases where you wish to get a list of all the entities that are present, and its corresponding metadata as a part of your integration - Especially for further parameterization plans.
Action Required for HubSpot Connections to Stay Compliant with Contacts Scope Updates
HubSpot has announced some recent security enhancements in their APIs which now provide more granular CRM scopes. With this change, you will need to update your HubSpot connections in order to stay compliant.