Handling In-Memory File Download and Parsing using KingswaySoft
Downloading JSON or XML files typically requires saving them to a local staging area first. With KingswaySoft’s SSIS Productivity Pack, you can skip that step by processing the data entirely in memory. In this blog post, we demonstrate how this can be achieved.
Capture and Work with Output Parameters from SQL Stored Procedures using KingswaySoft
In SQL, Stored procedures provide the option to use Output parameters as a way to return back data to the query which has called the procedure, and this can in turn, be beneficial for improved code organization and better performance. With our latest version of SSIS Productivity Pack, we have introduced Output parameter handling support to a few of our component tasks. In this blog post, we will be looking specifically at our Premium SQL Server components and how they can manage this.
Working with Shopify API using KingswaySoft GraphQL Components
GraphQL offers significant advantages over REST, making it the preferred choice for Shopify integrations. In this blog, we'll show how to configure KingswaySoft's GraphQL components to efficiently connect, read, and write data to Shopify's GraphQL API. From authentication and pagination to querying nested data, we'll cover key setup steps and best practices for optimizing your integration.
Achieve Incremental/Delta Data Load Logic in Any Data Flow with KingswaySoft
Having an incremental load or capturing delta changes is crucial for any integration scenario. This increases efficiency and allows to reduce the load during each package execution run by reading only the changes that occurred after the last execution from the Source system. In this blog post, we will show you a simple design using KingswaySoft components that can be applied to almost any data flow requiring incremental load capabilities.
Connect to Your Azure SQL Instance in SSIS ETL Process Using Modern Authentication
This blog post will walk you through various methods we have implemented for working with OAuth in our Premium SQL Server components, providing secure access for applications and users.
Introducing Firestore NoSQL Component for Handling Complex Data Structures
Firestore is a popular NoSQL database and offers some advantages over traditional relational database models. With its scalability, querying, and indexing capability, complex data structure can be easily handled for real-time business requirements. KingswaySoft offers Firestore components to connect, read, and write to it. In this blog post, we will delve into such a scenario for handling the data.
Silent Installation for KingswaySoft Toolkits
Msiexec allows you to install MSI files silently without user interaction, which can be useful for deploying KingswaySoft's SSIS Integration components. In this blog post, we'll cover how to use this feature with our toolkits, to enable unattended installations in your environment, making automated deployments and installations more efficient.
Extracting Information with Ease Using KingswaySoft JSON/XML Extract Task
In your ETL integration development, you might run into a situation where you need to obtain some information from a JSON or XML file served by an HTTP service endpoint via either SOAP or REST framework. Without a proper strategy, this process design can impose some interesting challenges. In this blog post, we will showcase how to use our HTTP Requester Task and JSON Extract Task to accomplish this with ease.
Build a More Resilient Message Queue Processing Flow Using KingswaySoft
Message queues are pivotal when it comes to communicating within a system or between multiple systems. It allows different parts of a system to communicate and process operations asynchronously. A message queue provides a lightweight buffer that temporarily stores messages and endpoints, which allow client components to connect to the queue and send and receive messages. KingswaySoft has various message queue components and control flow tasks that can be used in your integration workflow. Today, we will be looking into a specific constraint that queues could cause with higher volumes of messages, and how these can easily be handled within SSIS with KingswaySoft.
Automate Exporting and Emailing Power BI Reports with KingswaySoft
Power BI reports are a great way to get quick and detailed snapshots of data sources. In this blog post, we will discuss how to export reports in your preferred offline format (such as PDF) and send them to any email address required, all within a single data flow. Additionally, you will be able to dynamically set how frequently to send the report and to add or remove recipients receiving this email.
Parsing Through Hybrid API Responses Using KingswaySoft
APIs are typically based on either SOAP (XML) or REST (JSON) service calls. However, there are cases where you might receive an XML snippet from a REST service endpoint that primarily serves a JSON document. In such situations, you need a proper strategy for working with the embedded XML snippet. In this blog post, we will show you how this can be achieved effectively.
Effective Use of KingswaySoft Email Destination to Send Emails with Attachments
Sending emails is a common scenario in integrations, whether for logging a process status, sending a periodic report, job monitoring, etc. Handling this within the SSIS package can be advantageous in many ways, and with KingswaySoft's Email Destination Component, we make it as easy as possible.
Working with HubSpot CRM Associations with Ease Using KingswaySoft
Associations are used in HubSpot to define a relationship between objects and activities. It is critical to have these properly defined to keep your data and relationships as intended. In this blog post, we will show you how to use KingswaySoft components to easily create and maintain HubSpot associations.
Using KingswaySoft to Secure and Use Secrets from Azure Key Vault
Azure Key Vault is a popular key and secrets management solution from Microsoft, and it can be beneficial to use it for storing your sensitive SSIS connection credentials for runtime job execution. In this blog post, we will see how KingswaySoft can be used to store and retrieve such sensitive connection information from Azure Key Vault to facilitate a secure connection seamlessly.
Advanced Use of Custom Access Token in HTTP Requests
Custom access tokens are commonly used to obtain authorization tokens. Sometimes, they process requires using one of the parsing and extraction strategies. In this blog post we will illustrate some advanced use cases for this feature when using the HTTP connection manager offered in our SSIS Productivity Pack product.
Precisely Managing Metadata Changes in KingswaySoft Components
The components we developed at KingswaySoft generally discover metadata automatically whenever possible - That is, our software retrieves metadata information made available by the API itself in order to properly populate our ETL components. In most cases, the metadata in our components is generally accurate, provided the target system has a reliable metadata API. This includes services like Dataverse/Dynamics 365 CE, Salesforce, SharePoint, etc. Accurate metadata is vital for data integrity in ETL processes. However, there are occasional cases where some ETL metadata fine-tuning may be necessary due to unique situations. For instance, you might encounter cases where a text field contains more data than what is indicated by its metadata, potentially causing the source extraction to fail. In such instances, manual editing of the metadata will be required in order for the ETL process to work. In this blog post, we will show you how such changes can be made properly for your ETL components.
Working with Form-Urlencoded Request Body Using KingswaySoft
Discover how to handle unique client cases that require both authentication and payload data sent in the body using the x-www-form-urlencoded format. Set up authentication in Postman, configure the SSIS data flow, and utilize the XML Source component for parsing out data efficiently. In this blog post, we'll show you step-by-step how to achieve this seamlessly using KingswaySoft's SSIS Productivity Pack.