What's New

SSIS Productivity Pack

Detailed changelog for every release of KingswaySoft SSIS Productivity Pack

Version 10.0 - October 3, 2019

This release comes with the following updates and enhancements:

  • New Components
    • Big Data
      • Hadoop Connection Manager
      • HDFS Source
      • HDFS Destination
      • Premium Data File Source
      • Premium Data File Destination
    • Cloud Storage
      • Azure Data Lake Storage Connection Manager
      • Azure Data Lake Storage Source
      • Azure Data Lake Storage Destination
    • Data Warehousing
      • Snowflake Connection Manager
      • Snowflake Source
      • Snowflake Destination
    • Message Queue
      • AMQP Connection Manager
      • AMQP Source
      • AMQP Destination
    • Miscellaneous Components
      • Value Mapping
    • NoSQL Components
      • CosmosDB Connection Manager
      • CosmosDB Source
      • CosmosDB Destination
    • Premium Data Flow Components
      • Premium Conversion
  • New Services in REST
    • Asana
    • Facebook Business
    • Infusionsoft
    • Microsoft Teams
    • MYOB
    • Twillio
    • Yammer
    • Zuora
  • [All] Enhancement: There are some updates to the License Manager program that provide better tracking of license installation and easier license management by our client services team.
  • [All] Enhancement: Improved Azure SSIS-IR licensing to avoid unexpected unsuccessful activations upon restart.
  • NoSQL Components
    • DynamoDB
      • Fixed: Amazon DynamoDB Source component may output empty JSON arrays values "[,,]" when reading from DynamoDB list type attribute and the list is a collection of maps.
      • Fixed: Amazon DynamoDB Destination component may not report error properly when performing Upsert/Delete action with a batch size greater than 1.
      • Fixed: Amazon DynamoDB Destination component did not report error when Error Handling set to "Fail on error".
    • MongoDB
      • New: We added Null Mode support in MongoDB Destination component, which can be used to specify how to handle NULL values.
      • Fixed: You may get "Index was outside the bounds of the array" error in MongoDB Destination component when writing to MongoDB _id field.
  • Cloud Storage
    • Box
      • Fixed: Box Connection Manager may crash when clicking on "Add User ID (In App)" button and the selected location had no existing tokens.
    • Amazon S3
      • New: We added support for multi-threaded file upload in Amazon S3 Connection Manager.
      • Fixed: You may get "SignatureDoesNotMatch. The request signature we calculated does not match the signature you provided" error when deploying package with Amazon S3 components.
    • Azure Blob Storage
      • Fixed: Azure Blob Storage may fail with "System.DivideByZeroException: Attempted to divide by zero." error when performing Create action to Append Blob object with a chunk size of 0.
      • Fixed: You may run into "The MAC signature found in the HTTP request '' is not the same as any computed signature" error in Azure Blob Storage Destination component when performing Delete action.
    • Dropbox
      • Update: We removed Authorize In App option in Dropbox Connection Manager.
    • Google Cloud Storage
      • Update: We added an option called "Upload Chunk Size" in Google Cloud Storage Connection Manager which helps the support of uploading large files.
      • Fixed: Google Cloud Storage Destination component may fail with "System.ArgumentException" error when writing to 'labels' field.
      • Fixed: Downloading Google Cloud Storage files using Premium File Transfer Task may not retain the original hierarchical structure.
    • OneDrive
      • New: We added an "Impersonate As" option in OneDrive Connection Manager for OneDrive for Business connections, which can be used to access other user's OneDrive for Office global admins.
      • New: We added support of using My Own App in OneDrive Connection Manager.
      • Enhancement: The OneDrive connection manager starts to use the Azure AD app and the Graph API once authorized in the new version, and it will be using a token file going forward for better security and portability. Existing connection manager should still function by using registry-based token and old API service endpoints, we do however recommend moving to the new token file option.
      • Update: We have updated our OneDrive components to use Microsoft Graph API for both OneDrive Personal and OneDrive Business connections.
      • Update: We have updated our KingswaySoft OAuth app to Azure AD app.
      • Update: We now use token files to save OneDrive tokens.
      • Fixed: You may get a validation error "Please select a file" in Premium Flat File/Premium Excel components when selecting an OneDrive SharedWithMe file.
  • Message Queue
    • IBM MQ
      • Fixed: You may get NULLReference exception when testing connection in IBM MQ Connection Manager if the authorized user doesn't have a password.
    • Azure Service Bus
      • New: Azure Service Bus Source component now supports specifying a maximum number of messages to retrieve messages.
    • Amazon SQS
      • New: We added support of Change Message Visibility action in Amazon SQS Destination component.
      • Fixed: Amazon SQS Source component may output expired ReceiptHandle value if the message was retrieved more than once.
      • Fixed: Extend Automatically option in Amazon SQS Source was not working properly.
      • Fixed: Amazon SQS Destination component may fail sending MessageDeduplicationId if the input column is non-string type when sending messages.
      • Fixed: Amazon SQS Destination component may send empty message body if the Body Column Type is set to Text when performing Send Message action.
  • Premium Data Flow Components
    • Premium Excel
      • New: We added support for Excel 2019 in Premium Excel components.
      • New: Premium Excel Source/Destination component now supports working with hyperlinks.
      • New: We added formatting support in Premium Excel Destination component.
      • New: We added support of specifying sheet name in Premium Excel Destination component, the component will create the sheet if the specified sheet name not exist in the target file.
      • Fixed: Premium Excel Source component did not save the column data type changes when using "Start Row" for the column names.
    • Premium Slowly Changing Dimension
      • New: Premium Slowly Changing Dimension component now supports writing to a Snowflake table directly through a Snowflake Connection Manager.
      • Fixed: Premium Slowly Changing Dimension component may report "System.ArgumentNullException: Value cannot be null. Parameter name: key" error if the component was executed from an SSIS Execute Package Task.
    • Premium Lookup
      • Fixed: You may run into error "NullReferenceException: Object reference not set to an instance of an object" when using fuzzy match with special match types in Premium Lookup component.
      • Fixed: You may get "Generic.KeyNotFoundException" error in Premium Lookup component when using fuzzy match with special match types and the Lookup table is empty.
    • Premium ADO.NET
      • New: We added Implicit Transaction Type support in Premium ADO.NET Source/Destination component.
      • New: Premium ADO.NET Destination component now supports using a permanent temporary table when performing Bulk Update/Upsert/Delete and Full Sync actions.
      • Enhancement: Significantly performance improvement with the writing actions in Premium ADO.NET Destination component in non-bulk mode.
      • Enhancement: Performance enhancement in Premium ADO.NET Destination component when no output attached while performing Bulk Update/Upsert/Delete and Full Sync actions.
      • Fixed: You may run into "[DB2/NT64] SQL0104N An unexpected token "[" was found following "SELECT * FROM "." error in Premium ADO.NET components when loading DB2 metadata with DB2 OLEDB provider.
    • Premium Derived Column
      • New: We added the following functions in Premium Derived Column component: JoinStringArray(), EscapeUriDataString(), UnescapeUriDataString(), FormContentUrlEncode(), FormContentUrlDecode(), Sleep().
      • New: We added format string support in string cast functions: DT_WSTR, DT_STR, DT_TEXT, DT_NTEXT.
      • New: (DT_BOOL) cast function now supports more string values (case insensitive): "y", "n", "yes", "no", "t", "f".
      • Enhancement: Better data length detection for functions with static results.
      • Fixed: Milliseconds works improperly in DateTime functions, you may get 0 for function DatePart( "ms", GETDATE() ).
      • Fixed: Casting DT_DBTIMESTAMPOFFSET data types in Premium Derived Column may fail with "Unable to cast object of type 'System.DateTimeOffset' to type 'System.IConvertible'" error for expressions like (DT_DBDATE)[DateTimeOffset].
  • REST
    • New: We added an Expand Fields feature in REST Source component, which can be used to select additional outputs or fields from the returned object from the server.
    • New: We have updated the child outputs name in REST Source component to a name foramt of "{parent_output_name} -> {child_output_name}", so that the output names will be shown in a hierarchical tree structure in SSIS. This change should be considered as a breaking change, as a prior version (v9.0 or earlier) would not be able to open or process an SSIS package saved by the new version.
    • New: We have introduced a new token file format when using OAuth authentications in REST Connection Manager when working with Act-On, MailChimp, ServiceNow, Smartsheet, Square, Zendesk services. The new token file is json formatted and only has the sensitive information encrypted, a prior version (v9.0 or earlier) of Productivity Pack would not be able to open or process the new format token file.
    • New: Various UI enhancements.
    • ServiceNow
      • New: We added support for _attachment object in ServiceNow REST Source component by utilizing ServiceNow Attachment API.
      • New: ServiceNow REST Destination component now supports working with system fields by setting sysparm_suppress_auto_sys_field value accordingly.
      • Enhancement: We have improved the quality of metadata in ServiceNow REST components to support extend tables.
      • Enhancement: Better metadata detection to support Delete actions for ServiceNow objects in REST Destination component.
      • Fixed: You may find "[SSIS.Pipeline] Error: No object exists with the ID -1." error in SSIS Execution Results when executing a ServiceNow REST Source component.
    • Slack
      • Fixed: You may get error "Unexpected character encountered while parsing value: [. Path 'definitions.objs_user_profile.properties.fields.type'" when getting Slack metadata in Slack REST component.
    • Zendesk
      • New: We added support of downloading attachment content when working with Attachment object in Zendesk REST Source component.
      • New: We added comment.uploads field to Ticket object when performing Update action in Zendesk REST Destination component, which can be used to attaching files to ticket.
      • New: Upload Attachment action in Zendesk REST Destination component now supports outputting _AttachmentToken in its default output.
    • Trello:
      • New:We added support of downloading attachment content when working with Attachment object in Trello REST Source component.
      • New: Reading from Action and Card objects in Trello REST Source component now supports pagination.
    • Square
      • Enhancement: Updated metadata.
      • Update: We have updated our KingswaySoft Square OAuth app to the latest API version.
    • ADP
      • New: We added a Mask Data option in ADP REST Source component, which can be used to get unmasked sensitive data from ADP.
      • Fixed: ADP REST Source component may report NullReferenceException error when reading from workers with pagination.
  • HTTP/Web Services
    • New: We added Preview support in HTTP Requester Task and Web Service Task components.
    • New: HTTP Requester component now supports working with HTTP Multipart response.
    • New: We added a new option called ThrottlingRateUnit in HTTP Connection Manager.
    • New: We addes support of compressing the request body by specifying a Content-Encoding header in HTTP Connection Manager.
    • New: We have added the ability to remove the Accept-Encoding header from requests by adding Accept-Encoding as a default custom header in the HTTP Connection Manager
    • New: You can now use SSIS variables in the Input Parameters grid in Web Service Source component and Web Service Task.
    • New: Web Service Destination component now supports output response columns from the WSDL file.
    • New: We added a "Field Expansion Depth" option in Web Service components (Source, Destination and Task).
    • New: The HTTP connection manager now supports selecting a list of pre-defined HTTP headers.
    • New: We have introduced a new token file format in HTTP Connection Manager when using OAuth authentications, the new token file is json formatted and only has the sensitive information encrypted. A prior version (v9.0 or earlier) of Productivity Pack would not be able to open or process the new format token file.
    • Enhancement: Better metadata detection when importing WSDL in Web Service components.
    • Update: We updated the default HTTP Method to POST in Web Service Task component.
    • Update: We removed Export Settings button in the OAuth Token Generator. Token file created in the new format will be used as the settings file as well. Settings file created in a prior version (v9.0 or earlier) of Productivity Pack continues to work when importing in the OAuth Token Generator.
    • Fixed: Web Service Source and Web Service Task components may not show any input parameters if the selected operation in the WSDL file has no input columns.
    • Fixed: You may get error "Unable to cast object of type 'System.Xml.XmlElement' to type 'System.Web.Services.Description.ServiceDescriptionFormatExtension'" in Web Service components when importing some specific WSDL files.
    • Fixed: Web Service Destination may output NULL ResponseBody value if RequestBody column is not enabled.
    • Fixed: HTTP Requester component may report error "Stream was not readable" when 'ResponseBodyError' column is enabled in Error Output and the corresponding error response has an empty body.
  • JSON & XML Processing
    • New: We introduced a new Document Designer in JSON/XML components, which supports more complex structure of the JSON/XML file. This change should be considered as a breaking change, as a prior version (v9.0 or earlier) would not be able to open or process an SSIS package saved by the new version.
    • New: We added format string support in JSON/XML Merge/Destination component.
    • New: We added encoding support in JSON Extract/Merge component.
    • Enhancement: Significantly performance improvement when working with large JSON/XML files in JSON/XML components.
    • Enhancement: Better memory usage when processing large JSON/XML files in JSON/XML components.
    • Update: JSON/XML Source/Extract component no longer output the raw _json and _xml fields, packages designed using these _json and _xml columns need to be updated to remove using them.
    • Fixed: You may get NULLReferenceException in XML Extract/Source component when the imported XML file has no schemaLocation defined.
  • Premium File Pack
    • SFTP
      • New: Key authentication Method in SFTP Connection Manager now supports specifying password.
      • Fixed: You may run into "Channel closed" error when using Streamed Download to download files from SFTP server.
    • Premium Flat File
      • New: We added decompress/compress the file support in Premium Flat File Source/Destination component.
      • New: We added format string support in Premium Flat File Destination component.
      • New: We added support of specifying Text Qualifier at the columns level in Premium Flat File Destination component, the default option is 'Auto'.
      • Enhancement: More efficient memory usage when working with large files whether on cloud or on premise.
      • Fixed: Premium Flat File Destination component may not respect the system locale setting when writing datetime values.
      • Fixed: Premium Flat File Source component may output 0 rows when Row Filter "Skip Last Rows" is used.
    • Premium File Transfer Task
      • Fixed: Premium File Transfer Task may report "The item already exists" error when performing Send Files action to a cloud storage service while the source file doesn't exist at the specified destination path.
  • Data Generation and Anonymization
    • New: We have added the following new spawn/anonymization types to the Data Spawner and Data Anonymizer components: Name Prefix, Name Suffix.
    • Fixed: Data Spawner/Anonymizer may generate duplicate Firstname and Lastname pairs when using Person entity with a seed.
    • Fixed: You may get random State value in Data Spawner/Anonymizer with a specific Country setting when the State column is part of an Address entity.
  • Data Quality and Comparison
    • Enhancement: Some code refactoring for better performance in Diff Detector component when the Business Key field uses exact First Name Match.
  • Google Services
    • New: We added Google Service Account authentication support in all Google Connection Managers and Google Token Manager.
    • New: We added support of specifying redirect_url when using "My Own" authentication type mode in all Google Connection Managers and Google Token Manager.
    • New: We added Authorize In Browser support in all Google Connection Managers and Google Token Manager.
    • Fixed: You may get "invalid request" error in Google components after the access token is expired.
    • Google Big Query
      • Fixed: Google BigQuery Destination component may fail inserting TableData if the input column value contains new line characters.
      • Fixed: Table drop-down list in Google BigQuery component may not list all tables if the specified dataset has more than 50 tables
  • Encryption and Compression Tasks
    • New: We added support for specifying Key Size when generation PGP key pairs in PGP Task.
    • Fixed: PGP Task may fail with "System.Exception: exception decrypting secret key" error when decrpting a file and the a key ring contains multiple private keys.

Version 9.0 - February 21, 2019

This release comes with the following updates and enhancements:

  • [All] New: We have added support for SQL Server 2019.
  • [All] Enhancement: Various UI enhancements and performance improvements.
  • [All] Deprecation: We removed support for SQL Server 2005.
  • Cloud Storage
    • New: We added the following new components:
      • Google Cloud Storage Connection Manager
      • Google Cloud Storage Source
      • Google Cloud Storage Destination
  • REST
    • New: We have added the following services to REST components:
      • ADP
      • PayPal
      • Salesforce Pardot
      • ServiceNow
      • Shopify
      • Smartsheet
      • Stripe
      • Trello
      • WordPress/WooCommerce
      • Wunderlist
    • New: You can now search for objects & endpoints in the REST source and destination components
    • Enhancement: We have added icons to help distinguish REST services when selecting a service from the REST Connection Manager editor, or select and Connection Manager from the REST Source or Destination component editors.
    • Enhancement: We have improved error messages during failed authentication in Jira REST components.
    • Enhancement: We have improved the quality of metadata in Zendesk REST components.
    • Enhancement: We have improved the quality of metadata in Freshdesk REST components.
  • HTTP, JSON, XML, Web Service
    • New: We have added the ability to define HTTP error codes and set them as retryable or not retryable in the HTTP Connection Manager.
    • New: We have added the ability to remove the Expect: 100-continue header from requests by manually specifying it in the HTTP connection manager
    • New: We added support for more HTTP related additional output columns in JSON and XML Destination components.
    • New: We added support for specifying static values underneath array nodes in JSON Merge and Destination components.
    • New: We have added a ‘Qualified Output Names’ checkbox to the JSON Extract, JSON Source, XML Extract, and XML Source components. This will make sure output names are unique when importing documents
    • New: JSON Extract and Source components now support importing JSON Schema documents.
    • New: We have added the ability to import YAML files into JSON Extract and Source Components
    • Enhancement: JSON and XML Extract components now pass through upstream columns to the root output.
    • Enhancement: We have made headers case insensitive when working with HTTP components (e.g. JSON Destination) and the ‘GetValueFromPreviousResponseHeaders’ function
    • Enhancement: We have improved the error message when errors occur during expression evaluation in JSON Source, JSON Extract, XML Source, and XML Extract components.
    • Enhancement: We have improved the ability to parse different types of WSDL files in Web Service Components.
    • Enhancement: Web Service Source components can now send valueless parameters.
    • Enhancement: The JSON Source, JSON Extract, XML Source, and XML Extract components now support more than 1 logical root output.
    • Fixed: The JSON Source, JSON Extract, XML Source, and XML Extract components may not have correctly generated outputs when importing settings.
    • Fixed: The JSON Source, JSON Extract, XML Source, and XML Extract components may have failed if executed in optimized mode and not all outputs were attached.
    • Fixed: The XML Extract component may have failed if input XML was NULL.
  • Premium ADO.NET
    • New: We added support for Transaction Isolation Level in the Premium ADO.NET Source and Destination components.
    • New: We added support for Pre and Post commands in Premium ADO.NET Destination component.
    • Enhancement: The Premium ADO.NET Destination component now maintains the scale of DateTime2 fields over a SQL client connection manager.
    • Deprecation: We have removed the Identity Insert option in the Premium ADO.NET Destination component because we now handle it internally as needed.
  • Data Spawner/Anonymizer
    • New: We have added the following new spawn/anonymization types to the Data Spawner and Data Anonymizer components:
      • Address Line 1
      • Address Line 2
      • Country (ISO Alpha 2)
      • Country (ISO Alpha 3)
      • Country (ISO Numeric)
      • Credit Card CVV
      • Credit Card Number
      • Credit Card Type
      • Email (Business)
      • Email (Personal)
      • Facebook URL
      • Gender
      • Identification Number
      • Regex
      • State/Province
      • State/Province Abbreviation
      • Static Value
      • Street Name
      • Twitter Url
      • Zip/Postal Code
    • New: We have added support for specifying a random seed at the column level for both the Data Spawner and Data Anonymizer components.
    • New: We have added the ability to generate connected data in the Data Spawner and Data Anonymizer components via Entities.
    • Enhancement: We have added expression support for anonymization type specific custom properties. (e.g. MinYear and MaxYear properties for the Date Time anonymization type).
    • Deprecation: We have removed the following spawn/anonymization types from the Data Spawner and Data Anonymizer components because they have been replaced with better ones:
      • CountryAbbreviated
      • Email
      • StreetAddress
      • UkCountry
      • UkPostalCode
      • UsState
      • UsStateAbbreviated
      • ZipCode
  • Premium Derived Column
    • New: We have added support for comments (both single and multi-line) in Premium Derived Column expressions.
    • Enhancement: We now maintain line breaks and whitespace in Premium Derived Column expressions.
    • Fixed: Your Premium Derived Column component may have failed if one of the expressions was using a string function that contained a NULL parameter.
  • Message Queue
    • New: We have added throttling to Rabbit MQ connection managers.
    • New: We have added SSL support to IBM MQ connection managers.
  • MongoDB
    • New: We have added the ability to control how to handle UUID fields by specifying the BinData subtype (3 or 4) in the MongoDB Connection Manager.
    • Fixed: Your MongoDB source component may have returned NULL for multi-level (dot-delimited) fields.
  • Premium File Pack
    • New: We have added the ability to preserve timestamps when sending files in the Premium File Transfer Task over supported Connection Managers.
    • New: We have added row filtering options in the Premium Flat File Source component.
  • SFTP/FTPS
    • New: We have added the ability to output the log in the SFTP Connection Manager.
    • New: We have added the ‘Transfer Type’ option in the FTPS Connection Manager.
    • New: We have added support for logging in the FTPS Connection Manager.
  • PGP
    • New: We have added the ability to rename files after being decrypted in PGP Tasks.

For other releases click on the respective year:
2023 - 2022 - 2021 - 2020 - 2018 - 2017 - 2016