KingswaySoft - Data Integration Made Easy

Version 23.1.1 - May 19, 2023

This release is mainly a service release, which comes with the following updates and fixes:

Big Data
- Fixed: Some field might be missing in the designer when writing to X12 EDI format file.
- Fixed: CDM source component may make repetitive failed service calls to retrieve the list of partitions when the specified path does not exist for the chosen ADLS connection.
Cloud Storage
- Fixed: When downloading an empty file from an Azure Data Lake Storage Connection Manager with Fail Bulk Download Behavior option enabled, you might run into an error complaining about the file's etag has changed.
- Fixed: Azure Blob Storage source component may not properly download the file content when not all fields are selected in the component.
- Fixed: Azure Blob Storage source component may not return any metadata field values if none of the x-ms fields is selected.
HTTP/Web Services
- Fixed: In certain situations, HTTP service calls could possibly create a large number of concurrent open sockets, which could crash the runtime.
JSON & XML Processing
- Fixed: When writing to an XML file in a XML Merge or XML Destination component that involves a parent-child relationship where the component's Value Null Mode is set to xsi:nil but no namespaces have been specified, the component might report a NullReferenceException error during runtime.
Message Queuing
- Kafka
  - New: A new 'Receive Message Timeout' property has been added to the Kafka source component.
  - Fixed: In some occasions, you may run into an unexpected "Confluent.Kafka.KafkaException: Local: Broker transport failure" error.
Premium ADO.NET
- Fixed: Command Timeout setting may not be applied to the metadata calls during design time.
Premium Data File
- Fixed: When creating a Paraquet file that has a smallint field, the created file might not be readable by other Parquet utility or software programs.
REST Services
- Acumatica
  - Fixed: Custom endpoints may not be properly discovered.
- Clickup
  - Fixed: The parent field was missing in the GetFilteredTeamTasks operation.
  - Fixed: In the GetTasks operation/service endpoint, the subtasks query parameter was missing.
  - Fixed: Array type filter parameters may not been sent correctly.
  - Fixed: Pagination may not work properly in the source component when reading from the Tasks object.
- ConstantContact
  - Fixed: When using the Bulk Activities > Import Contacts using a JSON Payload operation, its child input is redudant.
- DocuSign
  - Fixed: allowEditingEnvelopesOnBehalfOfOthers and related fields were missing.
- Facebook
  - Fixed: When using the Events > Create Event By OfflineConversionDataSet operation, the data filter is sent as a comma-separated string instead of as a JSON string as required.
  - Fixed: When using the Events > Add Event by AdsPixel operation, the data filter is sent as a comma-separated string instead of as a JSON string as required.
- Freshservice
  - Update: Basic authentication option has been removed as it has been deprecated by the vendor.
- LinkedIn
  - Update: 'UGC Post API' has been removed and it has been moved to the 'Post API'.
  - Update: 'Share API' has been removed and it has been moved to the 'Post API'.
- ServiceNow
  - Update: Update action is now using the PATCH method instead of PUT previously. This is to be consistent with general industry standard.
- Shopify
  - Fixed: 'sort_value' in Collect object should be a string field.
  - Fixed: The compare_at_price field should be using a data type of decimal instead of nvarchar.
- SmartSheets
  - Fixed: The default batch size for some operations might be too high to cause URL length related errors during runtime.
  - Fixed: A default row location was not set when the option is not specified in the destination component, which can cause the writing to fail.
- TikTok
  - Update: As per TikTok documentation, we have updated the create a US lead download task operation to create a lead download task.
  - Update: As per TikTok documentation, the Leads > Create a non-US lead download task endpoint has been removed.
- Trello
  - Fix: A couple of custom field changes, including changing id to _id for the Get the options of a Dropdown Custom Field operation and adding the idValue field for the Get the Custom Field Items for a card operation.
- Zoho Books
  - New: We have added support for Japan data center.
- Zoom
  - Update: JWT authentication option has been removed.
- Zuora
  - Update: WSDL version has been updated to 124 for Create and Update actions.
  - Fixed: X-Zuora-WSDL-Version header was missing for Delete action.
  - Fixed: X-Zuora-WSDL-Version header was missing for non-custom objects, when using a bulk action by having a BatchSize greater than 1.

Version 23.1 - March 17, 2023

This release comes with the following updates and enhancements - Note that this will be our last version that supports SSIS 2008 (SQL Server 2008):

General
- Update: The auto-update form now displays a warning message about required maintenance for software upgrade.
- Update: We have removed the dependency on Microsoft.NetEnterpriseServers.ExceptionMessageBox.dll assembly.
- Fixed: KingswaySoft License Manager might report an incorrect grace period when the license is running under the grace terms.
New Components
- Big Data
  - Tableau Hyper Connection Manager
  - Tableau Hyper Publish Task
  - Tableau Hyper Source
  - Tableau Hyper Destination
- NoSQL Components
  - Couchbase Connection Manager
  - Couchbase Source
  - Couchbase Destination
- Premium Data Flow Components
  - Premium Recordset Source
- Premium File Pack
  - Premium File Watcher Task
- New services in the REST framework
  - Airtable
  - Authorize.NET
  - BambooHR
  - Duo Security
  - Emarsys
  - Google Calendar
  - Google Maps
  - OneLogin
  - Ping Identity
  - RingCentral
Big Data
- New: We added Output Time Zone support to CDM source component.
- New: Premium Data File destination component now supports "Skip Write On No Rows" option.
Cloud Storage
- New: We added "Bulk Download Behavior" support to Azure Data Lake Storage Connection Manager when working against ADLS Gen2, the property can be used to detect or prevent file modification when downloading the file.
- Fixed: You may run into a 403 Forbidden error when listing items in File Chooser for a connection that uses Azure Storage Emulator.
- Fixed: Azure Blob destination component may fail with "403 Server failed to authenticate the request" error when If-Modified-Since filter is provided.
- Fixed: You may get error "XML specified is not syntactically valid" in Azure Blob destination component when If_None_Match is provided while the file already exists in Azure Blob.
- Fixed: Azure Blob destination component may report "An item with the same key has already been added" error when working with Append/Page blobs.
- Fixed: Azure Blob destination component may not set the "Content-Type" properly when working with Append blobs.
- Fixed: Azure Files destination component may not send the x-ms header values properly.
Data Warehousing
- New: We added a "Fail On No Affected Records" option to the PostgreSQL and Google BigQuery destination components. When enabled, Update or Delete action would fail if no matching rows are found in the target database table when Row-By-Row writing mode is chosen, which is the default behavior in previous versions. This can now be suppressed by unchecking this option, in which case the the component would succeed even no matching records were found for the intended action (Update or Delete).
- Fixed: You may receive an error "cannot write DateTime with Kind=Unspecified to PostgreSQL type 'timestamp with time zone'" when working with PostgreSQL type 'timestamp with time zone' in PostgreSQL components.
- Fixed: For some particular PostgreSQL servers, Upsert action in PostgreSQL destination component may fail with an error "Version string portion was too short or too long".
- Fixed: Connecting to PostgreSQL through SSL Tunnel may fail with an error "An attempt was made to access a socket in a way forbidden by its access permissions".
Google Services
- Fixed: Google Sheets destination component may write empty string values to unmapped columns when performing SPREADSHEETS.SHEETS.VALUES - UPDATE action.
HTTP/Web Services
- New: We added support of Windows Integrated Authentication authentication mode in HTTP Connection Manager.
- New: We added a "Drop Authorization Header On Redirects" property to HTTP Connection Manager,
- Enhancement: Web Service components no longer encode data in a CDATA Section.
- Enhancement: Better metadata detection when loading WSDL files in Web Service components.
- Update: Default "Field Expansion Depth" is now set to 5 in Web Service components.
- Fixed: You may get "Status Reason: NotFound" error when loading some specific WSDL files in Web Service components.
- Fixed: Loading WSDL file in Web Service components with an HTTP Connection Manager may not use the specified authentication mode correctly.
JSON & XML Processing
- New: We added a "Link Ids Are Scrambled" option to JSON/XML Merge/destination component. When the option is disabled, the component will have some substantially better performance when working with multi-level JSON/XML document structure provided the link ID values inside the document are not scrambled.
- Enhancement: Better error handling and reporting when importing an invalid JSON file to JSON Extract/Merge/source/destination component.
- Update: Default Value Null Mode is now set to "xsi:nil" in XML Merge/destination component.
- Fixed: HTTP Connection Manager used in an XML destination component may not send the specified credentials properly when the Credentials authentication mode is used.
- Fixed: You may run into "System.Exception: "Is Repeated" node does not support sharing relative path with other nodes" error in JSON Extract/source component when working with repeated array of values in an array of objects.
Marketing Intelligence
- New: Customer Account Id in Google Ads source component now supports listing account hierarchies.
- Update: We updated the default API Version to latest version (v13) in Google Ads Connection Manager.
- Update: Login Customer Id property in Google Ads Source has been updated as Customer Account Id.
Mail Components
- New: We added OAuth 2 authentication support to SMTP Connection Manager.
- New: We added OAuth 2 authentication support to IMAP and POP3 protocols in Email Connection Manager.
- New: SMTP Connection Manager provide a Test Connection button now.
- New: We added "Send Email By ID" action support to Email destination component when working with EWS protocol.
- New: Email destination component now outputs Change Key ID when working with "Upload Message" and "Add Attachment" actions through an EWS connection.
- Enhancement: "Send Raw Email" action in Email destination component has some updated metadata when working with EWS protocol.
- Update: SMTP Task no longer requires Reply To Address to be specified.
- Fixed: "Is Body HTML" property in SMTP Task may get unchecked when upgrading from a prior version to a recent version.
Message Queue Components
- New: Azure Service Bus now supports working with TCP proxy.
- New: We added "Move to Dead Letter" action support to Azure Service Bus destination component.
- Enhancement: Better error handling when an invalid queue name is provided in Azure Service Bus source component.
- Fixed: Operation Timeout setting may not work properly in Azure Service Bus connection manager.
- Fixed: Azure Service Bus source component may output different number of records when working with a Dead Letter queue.
- Fixed: "Receive and Delete" mode in Azure Service Bus source component may output incomplete result when working with a Dead Letter Queue.
- Fixed: You may run into "The requested session cannot be accepted" error when working with session required queues in Azure Service Bus source component.
NoSQL Components
- Fixed: MongoDB source component may not output datetimeoffset value correctly when Output Timezone is set to Local.
- Fixed: MongoDB destination component may not escape some input values properly.
- Fixed: You may get "JSON reader was expecting ':' but found '","'." error in MongoDB destination component when working with a value that contain quote characters.
Premium Data Flow Components
- New: Premium Derived Column component now includes support for the following new functions:
  - FileExists()
  - FolderExists()
- New: We added a "Fail On No Affected Records" option to Premium ADO NET destination component. When enabled, Update or Delete action would fail if no matching rows are found in the target database table when Row-By-Row writing mode is chosen, which is the default behavior in previous versions. This can now be suppressed by unchecking this option, in which case the the component would succeed even no matching records were found for the intended action (Update or Delete).
- New: Premium ADO NET destination component now supports Bulk Update/Upsert/Delete and Full Sync actions against Oracle database though ODP.NET Managed data provider.
- Update: Post Command in Premium ADO NET source/destination/task component is split into Success Post Command and Error Post Command.
- Update: Pre Command in Premium ADO NET source/destination component is moved to be the first action of the Execute method, rather than being executed in the pre-execute stage previously.
- Update: "Autofit Column Width" property in Premium Excel destination component now takes decimal percentage values.
- Fixed: Premium ADO NET destination component would silently truncate the string values when the input value length is larger than the target column length.
- Fixed: Premium ADO NET destination component may not write numeric values properly when working with IBM DB2 database.
- Fixed: Temporary tables may not get dropped properly if working with Bulk Update/Upsert/Delete and Full Sync actions in Premium ADO NET destination component against Oracle database through ODP.NET Unmanaged data provider.
- Fixed: The big numbers with length of 16 and more may get rounded in Premium Derived Column component, for instance, value like 321825482218.2038 may get output as 321825482218.2040 previously.
- Fixed: Premium Derived Column component may report an "Invalid binary expression specified" error when testing expression with changed test value.
- Fixed: Output columns in a Premium Service Lookup component may get dropped when it is copied and pasted as a new component.
- Fixed: Premium Service Lookup component may report HRESULT: 0xC0047072 error when replacing an input column in Output Columns page.
- Fixed: Premium Lookup component may reports SSIS validation error when the upstream column's data type has changed.
- Fixed: You may get an upgrade error which complains about duplicate output alias '_average_similarity_score'" in Premium Lookup component when the data flow task was created using an earlier version of SSIS Productivity Pack (v21.2.1) that has multiple Premium Lookup components chained together, but upgraded to v22.1.
Premium File Pack
- Fixed: You may get null values on CreationTime property when working with an SFTP connection in Premium File Pack components.
- Fixed: Premium Flat File source component may not output the data row properly when the data row starts with "#" character.
- Fixed: You may run into an "Object reference not set to an instance of an object" error in Premium Flat File source component when reading from the <File Content in variable> option.
- Fixed: Premium Flat File source component may report "The method or operation is not implemented" error when loading metadata using the <File Content in variable> option.
- Fixed: You may get "Already connecting to the server" error when running multiple Premium File Pack components simultaneously while working against the same SFTP server.
- Fixed: Premium File Pack components may report an "Invalid character: '_'." error when performing Advanced Filtering with an SSIS variable and the variable name contains "_".
Premium Task
- New: We added renaming support to Azure Blob/Google Cloud Storage/S3 service in Premium Properties Task.
- Update: Premium Properties Task now outputs the variable default value when reading a datetime type property and output to a datetime type variable.
REST components
- General
  - New: We added a "Link Ids Are Scrambled" option to REST destination component when the component requires multiple inputs. The option is disabled by default, which can be used to improve the performance when working with multi-level JSON structures that have unscrambled ID values.
- Acumatica
  - New: We added Company support to OAuth authentication mode in Acumatica REST Connection Manager, it can be used to retrieve the API reference of a certain company.
- Ceridian Dayforce
  - Fixed: "IsValidateonly" field is missing in Ceridian Dayforce REST destination actions.
- Facebook Business
  - New: We added filtering parameter support to "Read Lead By Ad" and "Read Lead By LeadgenForm" endpoints in Facebook Business source component.
  - Update: We updated the default API Version to v16.0.
- Facebook Messenger
  - Update: We updated the default API Version to v16.0.
- Freshservices
  - New: We added support for discovering type fields when working with Asset object in REST source/destination component of a Freshservices connection.
- LinkedIn
  - New: We added various new API support including Post, InMailContents, Conversation Ads, Images and Videos.
  - Update: LinkedIn REST components now use the new versioned APIs.
  - Fixed: LinkedIn REST destination component may report an "object is not mapped to an input" error when working with an action that has child inputs.
- Microsoft Teams
  - Enhancement: Updated metadata for Shift object.
- Pipedrive
  - Enhancement: Better handling when downloading files from Pipedrive REST source component but the file download url is not found.
  - Enhancement: Updated metadata.
  - Fixed: Discovering custom fields in Pipedrive REST source/destination component may not perform paging properly.
- ServiceNow
  - New: ServiceNow REST source component now supports reading from database views.
  - Update: ServiceNow REST source/destination component no longer reports errors at design time when the connection user doesn't have permission to the data_policy table.
- Shopify
  - New: Shopify REST source and destination component now support working with collection_reference, list.collection_reference and money types of meta fields.
  - New: We added Fulfillment Order object support to Shopify REST destination component.
  - Enhancement: Updated metadata for Product/Order/Fullfilment/Metafield object.
  - Fixed: Updating a metadata field to NULL may not work properly in Shopify REST destination component.
  - Fixed: Reading metadata field values at runtime may not perform pagination properly in Shopify REST source component.
- Square
  - Enhancement: Updated metadata.
  - Update: We have updated our KingswaySoft Square OAuth app to the latest API version.
  - Fixed: Square REST source component may not send array type filter parameter values properly.
- SurveyMonkey
  - Enhancement: Updated metadata for "Survey Page Question" object.
- TikTok
  - Update: We have updated the TikTok REST components to use the latest v1.3 API endpoints. Existing components may require reconfiguration since TikTok v1.3 API is dramatically different from v1.2 API and TikTok v1.2 API will be deprecated in August, 2013.
- Wordpress
  - Fixed: You may run into error "startIndex cannot be larger than length of string. Parameter name: startIndex" when loading objects in Wordpress REST source/destination component if the target Wordpress instance has some special third-party plugins installed.
- Xero
  - Fixed: "If-Modified-Since" filter parameter was missing in Xero REST source component.
- Zoom
  - New: We added "Server-to-Server OAuth" authentication support to Zoom REST connection manager.
- Zuora
  - New: We added Invoice Items object support in Zuora REST destination component.
  - Update: We updated X-Zuora-WSDL-Version header to the latest 124 version when working with Query in Zuora REST source component.

Version 22.1 - November 2, 2022

This release comes with the following updates and enhancements - Note that this will be our last version that supports SSIS 2008 (SQL Server 2008):

General
- New: We have added support for SQL Server 2022 (SSIS 2022).
- Enhancement: We have updated the license manager program to make it more resilient in obtaining new license files or renewals should there be intermittent networking issues. The enhancement mainly applies to unattended license requests or updates using command line via Windows script, it is particularly helpful when you run our software on Azure SSIS IR as it involves license activation requests each time when the instance is started or restarted.
- Update: The entire program has received some major branding updates in various UI elements.
New Components
- Data Warehousing
  - Google AlloyDB Command Task
  - Google AlloyDB Connection Manager
  - Google AlloyDB Source
  - Google AlloyDB Destination
- Mail Components
  - Email Destination
- Message Queue Components
  - Azure Queue Storage Connection Manager
  - Azure Queue Storage Source
  - Azure Queue Storage Destination
  - Kafka Connection Manager
  - Kafka Source
  - Kafka Destination
- New services in the REST framework
  - Auth0
  - Bill.com
  - Calendly
  - Ceridian Dayforce
  - Chargebee
  - Chargify
  - ClickUp
  - Discord
  - Drift
  - Expensify
  - Google Forms
  - Jotform
  - Mailjet
  - Okta
  - PowerBI
  - PrestaShop
  - ShipStation
  - Typeform
Big Data
- New: EDI source component can now import multiple EDI files to create a generic data design for those chosen files, which can greatly improve development productivity when used properly.
- New: EDI source and destination components now support Filter Nodes on the Design page.
- New: CDM source component now supports lookup column names at runtime when the data file has no column header.
- Fixed: Premium Data File destination component was writing deprecated INT97 data type for dates and timestamps.
- Fixed: Flatten Segment Loops in EDI source may not work properly with some particular X12 files.
- Fixed: EDI destination component may not generate the target EDI file properly when the child input has multiple rows.
- Fixed: CDM components may not detect partition properly when dataPartitions has globPattern specified.
- Fixed: CDM source component may not output number values correctly when system locale setting uses "," as number delimiter.
- Fixed: You may run into "An existing connection was forcibly closed by the remote host" when working with multiple partition files in CDM source component.
Cloud Storage
- New: We added a new "Download Chunk Size" option in the Google Cloud Storage Connection Manager.
- New: We added a new "Download Chunk Size" option in the Google Drive Connection Manager.
- New: Dropbox Connection Manager now supports refreshing access_token.
- New: We added a Container option in Azure Blob Connection Manager, which can be used to specify a particular Azure Blob container to work with.
- Update: The Dropbox Connection Manager starts to use a token file going forward for better security and portability.
- Update: Upload Chunk Size in Box Connection Manager is changed to a checkbox named "Upload Chunk".
- Update: "WebDAV Host", "Port" and "Use HTTP" properties in WebDAV Connection Manager have been deprecated and they are now replaced with one single property called "Server Url" - Note that this should be considered a breaking change if any of the deprecated properties are used in parameterization.
- Update: "WebHDFS Host", "WebHDFS Port" and "Use HTTP" properties in Hadoop Connection Manager have been deprecated and they are now replaced with one single property called "WebHDFS Server URL" - Note that this should be considered a breaking change if any of the deprecated properties are used in parameterization.
- Enhancement: Some UI performance enhancement when listing Azure Blob items.
- Enhancement: Some UI performance enhancement when listing Amazon S3 items.
- Fixed: You may receive a "S3 Endpoint is not in correct format" error when testing connection in an Amazon S3 Connection Manager if it has the S3 Endpoint specified.
- Fixed: You may run into an UnsupportedHeader error in Premium Flat File destination component when writing large flat file to Azure Files using chunk upload.
- Fixed: You may receive a "System.FormatException" when listing WebDAV items that have no Content-Length.
Data Quality and Comparison
- New: We added a "License" option in Address Verification Connection Manager when working with SmartyStreet service, which can be used to specify the license or licenses (comma separated) to use for the address verification service.
- New: We added a new "Record Ranking Strategy" feature in Duplicate Detector component, which can be used to define the winning strategy among the duplicate groups.
Data Warehousing
- New: We have added support for RootCertificate, SslCertificate and SslKey parameters in the PostgreSQL Connection Manager.
- New: Google BigQuery source/destination component and Google BigQuery Command Task now support specifying a new Billing Project option.
- New: We added an "Authenticator" property in Snowflake Connection Manager when working with Basic Authentication type, this property can be used to specify the URL for SSO providers such Okta.
- Update: ClientCertificate is no longer supported in PostgreSQL Connection Manager, it's replaced by SslCertificate property.
- Update: Default Poll Throttle Rate is now set to 1 in Google BigQuery Command Task.
- Update: Amazon Redshift/PostgreSQL destination and task components will now show an asterisk indicator if pre or post command is specified.
- Fixed: Google BigQuery Command Task may report the error "Value cannot be null. Parameter name: source" when the query result is empty.
- Fixed: You may run into "42601: syntax error" in Amazon Redshift/PostgreSQL destination component when the target table name contains space.
Encryption and Compression Tasks
- Fixed: Decrypt action in PGP Task component may not work properly when the private key file contains multiple keys.
Google Services
- General Update: We have updated the redirect url to "http://localhost" in the KingswaySoft App provided in Google Connection Managers when generating a token.
- General Update: Default Key File Type is now set to JSON when working with Service Account authentication mode in Google Connection Managers.
- New: We added Shared Drive support to Google Drive components.
- New: We added PKCE OAuth authorization code flow support when generating Google OAuth token file.
- New: Google Ads Connection Manager now supports infinite timeout by setting the Timeout value to 0.
- New: We added FormatString property support in Google Sheets destination component.
- Update: We updated the default API Version to version v11 in Google Ads Connection Manager.
- Update: We updated the discovering Customer Id API call to use the Google Ads API when listing Customer Ids in Google Ads Connection Manager.
- Update: Google Ads source component now uses DT_DECIMAL data type for number fields.
- Update: We have deprecated Google AdWords API support because the AdWords API is no longer supported by Google.
- Update: Google Sheets destination component now writes DT_DBDATE value in "YYYY-MM-DD" format.
- Update: Metadata update in Google Analytics source component for Google Analytics Data API.
- Fixed: The provided Property Id value may not work properly in Google Analytics source component when working with Google Analytics Data API.
- Fixed: You may run into a "Batch Loading failed" error when running multiple Google BigQuery destination components in parallel and all of them are performing Bulk actions.
- Fixed: Google Ads source component may report a 'Fields cannot be used in SELECT' error when reading from the asset report.
- Fixed: Google Ads source component may not output number values correctly when the system locale setting uses "," as the number delimiter.
- Fixed: Reset Columns button in Google Sheets destination component may not set precision and scale numbers properly for upstream number type fields.
- Fixed: Google Sheets source component may report an "Object reference not set to an instance of an object" error when reading from an empty sheet.
- Fixed: Google Sheets destination component may not write column data properly when the metadata column positions are moved to the Columns page.
- Fixed: Google Sheets destination was writing empty values to unmapped fields when performing SHEETS_VALUES_UPDATE action.
HTTP/Web Services
- New: Custom Token Authentication Mode in HTTP Connection Manager now supports manually entering the cURL command and saving it in the HTTP Connection Manager.
- New: We added a new Allow Auto Redirect option in HTTP Connection Manager.
- New: We added additional algorithms supported in HTTP Connection Manager for JWT authentication mode, including RS384, RS512, ES256, ES384, ES512, PS256, PS384, PS512.
- New: We added WSSE authentication mode support in HTTP Connection Manager.
- New: We added PKCE OAuth authorization code flow support in OAuth Token Generator.
- New: Web Service components now support loading WSDL file from a given HTTP Connection Manager setting, this can be used for services that require authentication when downloading the WSDL file, which would be otherwise impossible to do.
- New: We added support for working with a certificate file stored in Azure Blob Storage by specifying an Azure SAS URL as the Path to Certificate in AS2 Connection Manager.
- Enhancement: Better metadata detection when loading WSDL files in Web Service components.
- Fixed: Loading WSDL in Web Service and XML components may miss detecting repeated elements when the element has an attribute.
- Fixed: Specifying invalid custom SOAP headers in Web Service Task component may cause Visual Studio to crash.
- Fixed: Web Service components failed to load WSDL file when the referenced XSD file is specified in a relative path.
- Fixed: "@Connection[AccessToken]" token may not work properly in Request Headers in HTTP Requester Task when the corresponding HTTP Connection Manager is configured to use Custom Token authentication mode.
- Fixed: Multipart cURL command may not work properly in HTTP Connection Manager when working with Custom Token authentication mode.
JSON & XML Processing
- Enhancement: Better nodes detection when loading JSON document with a mixed of null value and JObject value in JSON Source/Destination/Merge/Extract component.
- Update: JSON destination/Merge component no longer outputs empty values when working with empty JSON object values or empty JSON array values while the Null Mode is set to Don't Show.
- Update: Default Null Mode in XML destination and XML Merge components has been set to Empty String.
- Update: Component generated _RowIndex and _ParentKeyField fields are now starting from 1. This may be considered as a breaking change if the index base matters.
- Fixed: Document Designer Diagram View may not work properly in JSON/XML destination/Merge component when working in Visual Studio 2019.
- Fixed: Encoded "%2f" value in relative path may get decoded at runtime when working in JSON/XML source component.
- Fixed: Relative URL path ends with a dot character may not work properly in JSON/XML source component.
- Fixed: JSON/XML destination component may output url-decoded value in the default HttpRequestUrl column.
- Fixed: You may run into a "Stream was not readable" error in JSON source component when the @[ResponseBody] token is inside of an expression.
- Fixed: JSON destination component may report an "Input string was not in a correct format" error when the Error Handling is set to Redirect Error Rows.
- Fixed: JSON Extract component may report an "Object reference not set to an instance of an object" when default output is not attached.
- Fixed: You may receive a "The buffer is no longer accessible" error in XML Extract component when a very small DefaultMaxBufferRows value is used in the data flow property setting.
- Fixed: XML Extract component didn't direct the default output rows when an invalid XML document is received.
- Fixed: You may run into a "For security reasons DTD is prohibited in the XML document" error when importing XSD files that contain DTD lines in XML components.
Mail Components
- New: We added a new "Reply To Address" property in SMTP destination component.
- Fixed: SMTP Task and SMTP destination component may not dispose attachments after sending email properly when executing the component in a Foreach Loop Container.
Marketing Intelligence
- Update: OAuth scope is updated when generating Bing Ads token per the most recent API changes.
Message Queue Components
- New: We added OAuth 2 authentication mode support in Azure Service Bus Connection Manager.
- New: We added an Entity option in Azure Service Bus Connection Manager, which can be used to specify a particular queue/topic to work with.
- New: We added HTTP proxy support in Azure Service Bus Connection Manager.
- Update: Metadata update in Azure Service Bus source/destination component.
- Update: Custom fields in Azure Service Bus source/destination component are now prefixed with "Custom.".
- Update: Custom fields are now retained in Azure Service Bus source/destination component metadata when refreshing the component.
- Update: SSL Server Name is removed from ActiveMQ/AMQP Connection Manager since it's not needed for configuring the connection.
- Fixed: Amazon SQS destination component may send "Microsoft.SqlServer.Dts.Pipeline.BlobColumn" value as message body when input column is DT_NTEXT/DT_TEXT type.
NoSQL Components
- New: MongoDB destination component now supports specifying if a field Is Object ID, when the option is set to true, the value will be wrapped in ObjectId() format.
- New: We added support for setting readConcern to NULL when writing to MongoDB using MongoDB destination component.
- New: We added HTTP proxy support in CosmosDB Connection Manager.
- New: CosmosDB source component now supports using variable in the query.
- Update: We have updated the CosmosDB components to use the latest v3 SDK.
- Fixed: You may get "Import Failed" error in MongoDB components when importing from a collection and the documents in the collection is larger than the scan number.
- Fixed: Mongo datetime value "0000-01-01" may not work properly in MongDB components.
- Fixed: MongoDB destination component may report "A write operation resulted in an error" when performing Delete action if the input matching key value is NULL.
- Fixed: You may run into "Exception from HRESULT: 0xC020401" when selecting or deselecting a column in DynamoDB source/destination component.
- Fixed: DynamoDB source component may return invalid JSON documents when working with some special tables if the "Output as JSON" option is enabled.
Premium Data Flow Components
- New: Premium ADO NET destination component now supports "Disable Foreign Key Checks" when performing Bulk Insert action against MySQL/MariaDB database through the MySQL data provider, this option allows to disable foreign key checks while loading data in the target database table during the ETL process.
- New: Premium ADO NET destination component now supports "Ignore Unique Constraints" when performing Bulk Insert action against Oracle database through the Oracle ODP.NET Unmanaged data provider.
- New: We added an Update Table button in Premium ADO NET Destination component that can be used to generate delta schema update script for execution.
- New: We have added renaming output columns support in Premium Lookup component.
- New: Premium OData source component now supports additional bindings towards a function.
- New: We added additional bindings support to Premium OData destination component.
- New: We added OData Actions support in Premium OData source component. Now OData Actions are supported in both Premium OData source and destination components.
- Enhancement: Better metadata detection in Premium OData component when working with openType properties and base entity fields.
- Enhancement: Significant performance improvement when performing Upsert action in Premium ADO NET destination when using Row by Row write mode.
- Enhancement: Error column name is now reported in Premium ADO NET destination component SQL Bulk InvalidOperationException is hit,
- Update: Premium ADO NET destination and task components now show an asterisk indicator if pre or post command is specified.
- Update: Create Table command in Premium ADO NET destination component now defaults to use NUMERIX(p,s) data type for number fields.
- Update: Create Table command in Premium ADO NET destination component now shows a warning message that reminds developers to review the command before executing in the Create Table dialog.
- Fixed: You may run into "DatabaseServiceException: 42601: syntax error at or near {column_name}0" error when performing Batch Insert action in Premium ADO NET destination if the target table column name contains space.
- Fixed: Premium ADO NET destination component may report a "Conversion failed for command parameter[0]" error when working with datetime value through the SQL OLE DB connection
- Fixed: You may run into a "42601: syntax error" in Premium ADO NET destination component when the target table name contains space while working with MySQL data provider.
- Fixed: You may get a NULL value output row when Group By operation is used in Premium Aggregate component while there are no input rows.
- Fixed: You may get an SSIS validation error "The package contains two objects with the duplicate name of "Premium Conversion. Outputs[Error Output].Columns[ErrorCode]" and "Premium Conversion.Outputs[Error Output].Columns[ErrorCode]"." when attaching an error output to Premium Conversion component.
- Fixed: You may run into error "A value in the 'Column1' column failed to convert" when converting a NULL value to DT_TEXT/DT_NTEXT/DT_IMAGE data type.
- Fixed: Premium Lookup component may fail with a "The given key was not present in the dictionary" error when upstream metadata has duplicate columns.
- Fixed: You may receive an "Index was out of range" error in Premium PDF component when the specified SkipTable number is greater than the available table number.
- Fixed: Excel destination component may not write data properly when "Write Column Header on First row" and "Append at end" both options are enabled.
- Fixed: "Write Access Password" value in Premium Excel destination may overwrite the "Open Password" value when both password values are provided.
- Fixed: No file was created when Skip Writing on No Rows is enabled in Premium Excel destination component.
- Fixed: You may get a "The package contains two objects with the duplicate name" error when opening a Premium Conversion component while the component is linked from an error output.
- Fixed: Premium Derived Column component may generate duplicate values when using Random() function across multiple columns.
Premium File Pack
- New: We added Move Items operation support in Premium File Transfer Task.
- New: We added WILD_CARD_MATCH operator support in Filter conditions in Premium File Transfer Task/Premium File Properties Task/Premium File System Source component.
- New: We added Copy action support in Premium File System Destination component.
- New: We added Auto Increment Format String support in Premium File System destination component when working with Auto Increment Overwrite Mode.
- New: An optional Base Path is supported in Premium File System destination component.
- New: Premium File System destination component now supports Auto Create Missing Folders when the provided PathToParent doesn't exist.
- New: We added Count Items operation support to Premium Properties Task component.
- New: We have added local file system detail properties support to Premium File System source/destination and Premium Properties Task components when working with a local file.
- New: We added support of updating column properties for all columns in Premium Flat File Source and Destination components.
- New: We added encoding support in FTPS Connection Manager.
- Update: Send Files action in Premium File Transfer Task is renamed to Copy Items operation.
- Fixed: Local network share folders and files may not sort properly in the tree view file browser in the Premium File Pack components.
- Fixed: Downloading SFTP files using Premium Transfer Task or Premium File System component may not be downloaded completely when "Use Async Data Transfer" and the server connection is lost
- Fixed: Files may not be completely downloaded when downloading SFTP files to a network share location using the Premium File Transfer Task.
- Fixed: Parameterizing SFTP Connection Manager's ConnectionString and executing in a Foreach Loop may not work properly.
REST Services
- General
  - New: REST Connection Manager now provides a tree view UI that is designed to select required scopes before generating an OAuth token.
  - Update: REST Connection Manager no longer has the Show/Hide button to view a sensitive property.
- Active Campaign
  - New: Active Campaign REST Source component now supports retrieving related link data from the link urls.
- ADP
  - New: Updated metadata for Time Cards object.
  - Fixed: ADP REST source component may not send the correct request when $expand and $filter parameters are specified while working with the Time Cards object.
- Asana
  - Fixed: You may receive an "Object reference not set to an instance of an object" error in Asana REST destination component when uploading an attachment.
- Azure Application Insights
  - Enhancement: Better error handling when an invalid query is provided in Azure Application Insights REST source component.
- Azure Table
  - New: We added OAuth Authorization Code and OAuth Client Credentials authentication modes support in Azure Table REST Connection Manager.
  - New: We added Create/Delete/Set ACL Table actions support in Azure Table REST destination component.
  - Fixed: You may run into a "The given key was not present in the dictionary" error when parameterizing the Source Object in Azure Table REST source component.
- Constant Contact
  - New: We added Constant Contact v3 API support.
- Elasticsearch
  - New: We added a Create Index button in Elasticsearch REST destination component, the button will launch a Create Index dialog, which you can create an index mapping based on the input columns from upstream components.
  - Enhancement: Better data type detection for nested properties.
  - Fixed: You may get a "Sequence contains no elements" error when listing objects in Elasticsearch REST source/destination component if there are indexes with empty mappings.
  - Fixed: Elasticsearch REST Connection Manager may report a "Test connection succeeded" message when the test connection API call fails with 404 Not Found error.
- Facebook Business
  - New: We added 'System User Access Token' authentication mode support in Facebook Business REST Connection Manager.
  - Update: We updated the default API Version to v14.0.
- Facebook Messenger
  - Update: We updated the default API Version to v14.0.
- Freshdesk
  - New: Metadata update for Contact object.
  - Update: Freshdesk REST source component no longer fails the SSIS data flow, but rather it would report a warning message in SSIS log when the List All Tickets service endpoint reaches the maximum 300 pages API limit.
- Jira
  - Fixed: Jira REST Source component may send an invalid json request when working with the Issues object if the provided jpl query contains a quote.
- LinkedIn
  - New: We added PKCE OAuth authorization code flow support when generating a LinkedIn OAuth token file.
  - New: We added Standardized Data API support in LinkedIn REST source component.
  - Update: Metadata update for Organization Follower Statistics and Organization Page Statistics objects.
  - Fixed: You may get an "Object reference not set to an instance of an object" error when generating a token file in an existing LinkedIn REST Connection Manager when the connection manager is saved with Access Token.
  - Fixed: LinkedIn REST source component may send invalid timeIntervals parameter values when working with “Get Page Statistics” endpoint.
  - Fixed: You may run into "syntax error" when working with "Get Comments on Comments" endpoint or "Get Statistics for Specific Shares" endpoint or "Search Creatives" endpoint in LinkedIn REST source component.
- Magento
  - Update: Magento service has been renamed to Magento/Adobe Commerce to reflect the vendor's recent branding changes.
- Pipedrive
  - Update: Metadata update.
- Salesforce Pardot
  - New: We added Pardot v5 API support.
- ServiceNow
  - Enhancement: Better error handling when the status value in the API response body is "failure".
- Shopify
  - New: We now support working with Shopify custom fields in Shopify REST source/destination component.
  - New: We added Collection endpoints support in Shopify REST source component when working with Product.
  - Update: Default API version is set to the 2nd most recent version when using <Default> API Version in Shopify REST Connection Manager.
  - Update: We have some updated metadata for Customer Object.
- Smarsheet
  - New: We have added Row Location properties support when working with discovered sheet object in Smartsheet REST destination component.
  - Fixed: Smarthseet REST source component may not read report data properly when working with discovered report objects.
  - Fixed: Pagination may not work properly when reading from discovered report object in Smarsheet REST source component.
- Xero
  - New: We added PKCE OAuth authorization code flow support when generating an Xero OAuth token file.
  - Update: Default and maximum Throttle Rate in Xero REST Connection Manager is now set to 60 requests/minute.
- Zoho CRM
  - New: Zoho CRM REST destination component now supports uploading file content to FileUpload/ImageUpload fields.
  - Update: Zoho CRM API support has now been updated to v3.
  - Update: We updated the paging strategy to use the "page_token" when paging through Zoho CRM records.
- Zoom
  - New: We added API support to Zoom REST source/destination component, available values are: Zoom Meeting, Zoom Meeting Master Account, Zoom Phone, Zoom Phone Master Account, Zoom Video, Zoom Chat.
  - Update: We have updated the Zoom metadata.
- Zuora
  - Update: We updated X-Zuora-WSDL-Version header to the latest 115 version when working with Query in Zuora REST source component.
  - Update: Zuora REST source/destination component no longer reports an error at design time when the metadata discovery call fails with permission error.
  - Fixed: Specified Zuora Entity Ids value in Zuora REST Connection Manager may not get set properly in the API request.