InterSystems IRIS for Health™ Upgrade Checklist and Change Notes (2022.1.2)

DP-415197

CWE: CWE-84: Improper Neutralization of Encoded URI Schemes in a Web Page
Severity: Medium
CVSS Score: 4.3
Version: 2022.1.2

FIXED: An attacker may be able to craft a malicious link to the class reference documentation application to execute arbitrary JavaScript.

DP-416493

CWE: CWE-250: Execution with Unnecessary Privileges
Severity: Medium
CVSS Score: 6.3
Version: 2022.1.2

FIXED: Due to a code path that executes with unnecessary privileges, a user with developer privileges may be able to execute arbitrary commands with %All privilege.

DP-416789

CWE: CWE-459: Incomplete Cleanup
Severity: Medium
CVSS Score: 6.3
Version: 2022.1.2

FIXED: In rare circumstances, a user may be able to use administrative options such as NOCHECK, %NOLOCK, %NOINDEX, %NOTRIGGER, or %NOJOURN on SQL queries that they are otherwise authorized to run without those options.

DP-417169

CWE: CWE-862: Missing Authorization
Severity: Medium
CVSS Score: 4.3
Version: 2022.1.2

FIXED: An authenticated user would be able to use particular Ensemble/Interoperability application pages to view the file system contents and files themselves without proper permissions.

DP-417313

CWE: CWE-200: Exposure of Sensitive Information to an Unauthorized Actor
Severity: Medium
CVSS Score: 4.3
Version: 2022.1.2

FIXED: JWKS values could be logged in plaintext in ^ISCLOG data.

DP-404692: Support string with exponent value in ADO Fast Insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

Before this change, System.Convert.ToInt64 and System.Convert.ToDecimal accepted strings but errored out if the strings held exponent presentation, like 1e10. Now, such strings are handled appropriaately.

DP-404743: Preserve data arrays in cached statement in ADO.NET Fast Insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

This change fixes an issue in ADO.NET Fast Insert. The issue caused the message: System.NullReferenceException : Object reference not set to an instance of an object.

DP-404823: Support truncation in ADO.NET Fast Insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

With this change, for string and binary datatypes, fast insert will check if inserted value exceeds column precision. If it does and column truncate is enabled, then the value will be truncated. If column truncate is disabled (0), the driver will throw a validation exception.

DP-404913: Correct validation of date/time fields

Category: ADO.NET
Platforms: All
Version: 2022.1.1

This change corrects the validation of date/time fields for ADO.NET Fast Insert.

DP-404946: Correct setting default values for large array in ADO.NET Fast Insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

This change corrects an issue with Fast Insert, where a row with many default values was incorrectly handled.

DP-405124: Validate temporal types using default MIN/MAX values for ADO Fast Insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

With this change, ADO.NET Fast Insert validates temporal types even if server does not have min/max values defined. These are the default MIN/MAX values (in $HOROLOG values):

DATE_MAXVAL = 2980013;
DATE_MINVAL = -672045;
TIME_MAXVAL =  86399.999999999;
TIME_MINVAL = 0;
POSIX_MAXVAL = 1406323805406846975;
POSIX_MINVAL = -6979664624441081856

DP-406739: Throw validation exception when double value too big for ADO.NET Fast Insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

ADO Core converts large numbers to Infinity, and non core throws an exception. With this change, ADO.NET Fast Insert throws an exception in both cases to be compatible with server behavior.

DP-406779: Accept Infinity or INF as valid input for double in ADO.NET Fast Insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

With this change, the ADO.NET Provider will accept string "Infinity" or "INF" in any case as valid input for double parameters.

DP-406791: Correctly handle Boolean values when inserting into binary or character columns (ADO.NET Fast Insert)

Category: ADO.NET
Platforms: All
Version: 2022.1.1

After this change, when you insert Boolean values into binary- or character-based columns, the value inserted is 1 or 0, rather than true or false.

DP-406803: Use custom format for DateTime for ADO.NET Fast Insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

For compatibility with server formatting, ADO.NET Fast Insert now uses custom format 

yyyy-MM-dd HH:mm:ss[.ffffff]

DP-406829: Allow reading of $list type 6 and 7 as valid date values from InterSystems IRIS

Category: ADO.NET
Platforms: All
Version: 2022.1.1

This change correctly converts date values that stored on the server as type 6 or 7.

DP-406871: Validate MIN/MAX value for date and time passed as literal in ADO.NET Fast Insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

With this change, if you pass a numeric value as a literal to date/time field, the value is validated against min/max values for $HOROLOG.

DP-406895: Validate POSIX MIN/MAX when passed int value passed as string in ADO.NET Fast Insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

With this change, if you pass int or long values to a POSIX field, InterSystems IRIS validates using the MIN/MAX values.

DP-406957: Insert string to Binary will be performed as a string (ADO Fast Insert)

Category: ADO.NET
Platforms: All
Version: 2022.1.1

With this change, when you insert a string to Binary legacy code - including Java, ADO slow insert, and SMP - the string is passed without conversion.  While technically this is incorrect because Unicode strings will be saved as type 2, we do the same in Fast Insert to maintain backward compatibility.  It is up to user to convert string to byte[] and set it as byte[] if they choose to do so.

For example:

byte[] bytes = new byte[str.Length * sizeof(char)];
System.Buffer.BlockCopy(str.ToCharArray(), 0, bytes, 0, bytes.Length);

DP-406983: Clean up conversions to Boolean (BIT) value for ADO.NET Fast Insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

This change corrects conversions from string to Boolean to insert into BIT columns.

DP-406988: Relax conversion to Integer types for ADO.NET Fast Insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

Before this change, literal values such as 1.2345 and 3.45 were accepted by slow-insert, but not by fast-insert, for a bigint field.

DP-407026: Perform Min/Max field validation in ADO.NET Fast Insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

Before this fix, ADO.NET Fast Insert did not perform Min/Max field validation.

DP-407038: Use same precision for datetime values for ADO fast insert as for slow insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

With this change, both slow insert and fast insert for ADO.NET use the same precision for datetime values.

New format: yyyy-MM-dd HH:mm:ss[.fffffff]

DP-407046: Disable Shared Memory by default on non-Windows

Category: ADO.NET
Platforms: UNIX®
Version: 2022.1.1

There are issues with shared memory on Linux, where the InterSystems IRIS process does not have the correct permissions to kill processes started by root, leaving orphaned processes stuck in a READ state when the .NET program has finished. 

The full fix for this issue will come later, but for now this change disables shared memory by default on non-Windows systems so that .NET projects will work properly.

DP-407107: Limit possible conversions to binary for ADO.NET Fast Insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

With this change, when inserting value into a binary field, Fast Insert will accept only byte[], char[] or string. Attempt to insert any other datatype will generate exception "Unsupported type conversion for Byte[]"

DP-407169: Allow $HOROLOG values to be inserted into %Timestamp and %PosixTime for ADO.NET Fast Insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

For consistency with slow insert and with the InterSystems IRIS server, this change enables Fast Insert to insert integer values into timestamp fields (%Timestamp and %PosixTime). The integer values will be treated as $HOROLOG and converted to timestamp.  The code also checks validity of actual %PosixTime values, requiring them to be in two ranges:

between 1152921504606846976(1970-01-01) and 1406323719006846976 (9999-12-31)

between -6917529114041081856(1969-12-31) and -6979664624441081856 (0001-01-01)

DP-407196: Allow only 1 or 0 to convert to Boolean for ADO.NET Fast Insert

Category: ADO.NET
Platforms: All
Version: 2022.1.1

ADO converts any integer not equal to 0 to Boolean 'true'; however InterSystems IRIS supports only 0 or 1 as a valid values.  With this change, ADO.NET Fast Insert will report a validation error if the passed numeric value (for a Boolean field) is not 1 or 0.

DP-407677: Correct ADO.NET resolve lock issues in updateCache() method

Category: ADO.NET
Platforms: All
Version: 2022.1.1

This change corrects the updateCache() method in IRISADOConnection for .NET 5.  Before this fix, it was possible to receive the exception "A read lock may not be acquired with the write lock held in this mode".

DP-408764: Correct adjusting date to server time zone if date missing

Category: ADO.NET
Platforms: All
Version: 2022.1.1

With this change, when inserting into TIMESTAMP value with DATE missing, we substitute the current server date, not the client date.

DP-409804: Correct ADO.Net logging of continuation logic messages

Category: ADO.NET
Platforms: All
Version: 2022.1.1

Before this change, when there were multiple messages with the same sequence number and statement ID (due to data larger than the TCP/IP buffer), the log did not correctly show the multiple headers. Instead the last header was shown with all the data from the prior payloads. This change just shows the messages as they are received with their header.

DP-410421: Changes for Timestamp validation

Category: ADO.NET
Platforms: All
Version: 2022.1.1

With this change, ADO.NET validates timestamp values against MIN/MAX values. The minimum value is 1840-12-31 and the maximum value is 12/31/9999 12:00:00 AM.

DP-410996: Allow DDL commands to be prepared before execution in ADO.NET

Category: ADO.NET
Platforms: All
Version: 2022.1.1

Before this change, within ADO.NET, DDL commands such as "CREATE TABLE..." would throw an error on execution if they had been prepared before execution. While calling Prepare() on these commands is not necessary because the commands do not get cached, it is better to avoid throwing the error.

This change allows users to call Prepare() and then Execute() on a DDL command without seeing an error.

DP-411899: Revert default TCP port to 1972 for ADO.NET

Category: ADO.NET
Platforms: All
Version: 2022.1.1

This change reverts the default TCP port to 1972 for ADO.NET.

DP-413772: Allow ExternalThaw to cancel a pending ExternalFreeze request

Category: Backup/Restore
Platforms: All
Version: 2022.1.1

This change corrects an issue that caused ##class(Backup.General).ExternalThaw() to fail to interrupt a hanging ##class(Backup.General).ExternalFreeze().

DP-408943: Default to showing all results in dashboard widgets

Category: Business Intelligence
Platforms: All
Version: 2022.1.2

This change allows the pivot widget to respond to a setting that influences the preview behavior on load. By default, widgets will now show all results on first load without truncation. If this is still proving to lead to extended load times, this behavior can be changed and saved with the widget definition using the setting Widget > Widget Settings > Pivot Preview = On This setting is stored as part of the .dfi definition once saved as part of a dashboard.

Analyzer behavior should be the same as before.

The message that tracks the job progress should display numbers more consistently and no longer toggles between a reset state and the actual current progress.

DP-409762: Fix internal logic used by %OR

Category: Business Intelligence
Platforms: All
Version: 2022.1.2

This change modifies the internal logic (in GetSpecForAxisNode()) used by %OR so that it can apply across a wider variety of constructs.

Before this change, %GetFiltersForCellRange returned incorrect results in some cases.

DP-410200: Fix listing export for Excel export

Category: Business Intelligence
Platforms: All
Version: 2022.1.2

This change fixes the Excel export of listings from pivot tables.

DP-410644: Reduce global references in axis loading for %ExecuteForBucket

Category: Business Intelligence
Platforms: All
Version: 2022.1.2

This change improves the performance of MDX queries, in the %ExecuteForBucket() phase.

DP-411270: Restore support for direct-to-Excel MDX export via API

Category: Business Intelligence
Platforms: All
Version: 2022.1.1

The change that made is possible to reopen an MDX result set during Excel export broke the MDX-text based %DeepSee.Utils API. This change restores the API functionality.

DP-411542: Correct handling of a %List property used in a cube listing

Category: Business Intelligence
Platforms: All
Version: 2022.1.2

Before this change, if you used a %List property from a cube's sourceClass within detail listing, certain errors were possible. Now, if the property includes the ", " delimiter used in conversion from %List type to a %String, that is displayed. Also, there is no error if the %List contains a null value.

DP-412648: Improve handling of AGGREGATE in crossjoins

Category: Business Intelligence
Platforms: All
Version: 2022.1.2

Before this change, two calculated members used in a crossjoin could lose track of the dividing line between two virtual members when the AGGREGATE function is used to create one or both of those members. This fix supports the rule that if it is possible to determine the Aggregate is defined to look like a member, it will be converted to a %OR to truly behave like a singular member. This will not apply when the Aggregate defines a measure to apply to target set, in which case the function is acting like a metric.

DP-414702: Fix unload behavior of pivotTable, Analytics pages to avoid nuisance confirmation

Category: Business Intelligence
Platforms: All
Version: 2022.1.1

This change fixes a bug in which a pivot table would prompt for confirmation when the user was not actually leaving the page.

DP-415407: Protect %SetAncestorLockKeys from undefined argument

Category: Business Intelligence
Platforms: All
Version: 2022.1.2

Protect %DeepSee.ResultSet:%SetAncestorLockKeys from an <UNDEFINED> error when no argument is supplied.

DP-417737: Correct vulnerability in Analytics User Portal

Category: Business Intelligence
Platforms: All
Version: 2022.1.2

This change corrects a vulnerability in the Analytics User Portal. The vulnerability would allow authenticated users with access to the User Portal page to execute user-specified ObjectScript commands on the server using their current security context. There are limitations; the string would be converted to uppercase before being executed, and it cannot contain any periods. There are also length limitations. 

This vulnerability has been corrected.

DP-418010: Fix detection of stale cell cache for cube relationships

Category: Business Intelligence
Platforms: All
Version: 2022.1.2

A query involving cached cell results derived from related cube subqueries could produce incorrect results if any of those related cubes were updated with new dimension members that were inserted into any dimension used in that query.

DP-414558: Correct error in WebGateway kit

Category: Cloud
Platforms: All
Version: 2022.1.2

This change fixes the following issue in the WebGateway kit: When installing a cluster in containerless mode with a WS node, the WS node failed to install.

DP-415796: InterSystems IRIS container: Restore deprecated option (--check-caps) and disable it

Category: Cloud
Platforms: All
Version: 2022.1.1

The previous removal of the option --check-caps caused compatibility issues for a number of our products whose older versions required this option, products (such as ICM and IKO) which deploy a combination of instances in which some require the option and some do not (e.g. SAM 1.x vs. IRIS 2022.3.x), upgrade from a product that requires it to one that doesn't, and customer scripts as well. With this change, we restore the option and do nothing with it.  We do not generate a deprecation warning because such a warning is not useful.

DP-414415: Pass original data in storage when using parameternonce to communicate parameters between pages

Category: Compatibility Features
Platforms: All
Version: 2022.1.2

%DeepSee.Utils:%CreateParmeterNonce is used to store information in a global with a nonced ID assigned to it so that it can be communicated to exports without risk of violating the max length of browser URLs. The pages which receive this use %DeepSee.Utils:%GetParameterNonce to retrieve the information from temporary storage.

There is no need for this communication to contain any sort of translation, so the $ZCVT(tText,"I","UTF8") is removed from the store procedure. Any translation that might be necessary can and should be done by the functions actually writing the data to files if it is deemed necessary.

This also makes sure the deepseeCSVProvider uses UTF-8 encoding when creating files so these characters are correctly written to the .csv file.

DP-415588: Update Apache Ant from 1.7.1 to 1.10.12

Category: Compatibility Features
Platforms: All
Version: 2022.1.2

This change updates Apache Ant from 1.7.1 to 1.10.12 (the latest version) to resolve 2 high severity and 4 medium severity security vulnerabilities. Ant is still used to build severl modules that are part of Zen Reports, and that are included in the installation under the lib directory.

DP-416806: Fix encoding error in CSP server for short name-value pairs

Category: CSP Server
Platforms: All
Version: 2022.1.2

This change corrects a bug in which the CSP Server did not correctly handle the name property of an <input> on a CSP page. Before this change, if the name contained non-ASCII characters, it was encoded incorrectly.

DP-412872: Intercept SYSTEM methods before Python dispatch

Category: Embedded Python
Platforms: All
Version: 2022.1.1

Prior to this change, if a %SYSTEM method that returns something is implemented in C/C++, calls to such a method using embedded Python Shell() will return empty.

This change fixes the issue. Now embedded Python can properly call %SYSTEM methods implemented in C/C++ and get the return value if there is any.

DP-413645: Correct error handling in embedded Python

Category: Embedded Python
Platforms: All
Version: 2022.1.1

This change makes multiple corrections to error handling in embedded Python.

DP-413866: Corrected invoking internal %SYSTEM methods from embedded Python

Category: Embedded Python
Platforms: All
Version: 2022.1.1

Embedded python now has access to all methods defined in the following classes:

• %SYSTEM.DocDB
• %SYSTEM.Encryption
• %SYSTEM.Error
• %SYSTEM.Event
• %SYSTEM.Monitor
• %SYSTEM.Process
• %SYSTEM.Python
• %SYSTEM.Security
• %SYSTEM.Semaphore
• %SYSTEM.SQL
• %SYSTEM.Status
• %SYSTEM.SYS
• %SYSTEM.Util
• %SYSTEM.Version

With this change, the product also now converts an underscore character (_) in Python method names to a percent character (%) for ObjectScript.

DP-413982: Corrected frame cleanup when embedded Python raises an error in an ObjectScript method or routine.

Category: Embedded Python
Platforms: All
Version: 2022.1.1

When embedded Python (or other code using the same code path) called ObjectScript method or routine, and that raised an error, the error handler on return with value, didn’t clean up properly. 

Based on what was left on the frame stack, the code continued and executed with incorrect information, which caused unpredictable behavior.

DP-414013: Added support for property getter methods implemented in Python

Category: Embedded Python
Platforms: All
Version: 2022.1.1

This chage adds support for property getter methods implemented in Python.

DP-414205: Modified iris.system.* python services to handle static $system, class, and instance methods consistently

Category: Embedded Python
Platforms: All
Version: 2022.1.1

Before this change, from embedded Python, we treated all %system methods as $system or a class method. With this change, we now check if the method is invoked on an instance of the class, if so to invoke the instance method.

DP-414279: Correct reporting of errors raised by InterSystems IRIS in embedded Python

Category: Embedded Python
Platforms: All
Version: 2022.1.1

This change modifies the way that embedded Python handles errors raised or thrown in InterSystems IRIS.

DP-414434: Fix To2DListTyped wstring handling on macOS

Category: Embedded Python
Platforms: macOS
Version: 2022.1.2

Before this change, To2DListTyped assumed wide character takes two bytes on all platforms, while it can take four bytes on macOS. This resulted in string truncation on macOS.

This change properly handles the case if wide character type takes four bytes on certain platforms.

DP-415680: Corrected InterSystems IRIS method invocation from embedded Python

Category: Embedded Python
Platforms: All
Version: 2022.1.1

Before this change, if embedded Python called a class method, Python would throw the runtimeError 'Class not found'.

DP-415831: Corrected instance method invocation from embedded Python

Category: Embedded Python
Platforms: All
Version: 2022.1.2

This change corrects an error in which calling an instance method from embedded Python resulted in a runtime error of 'Method not found'.

DP-419409: Corrected embedded Python out-of-memory handling

Category: Embedded Python
Platforms: All
Version: 2022.1.2

This change corrects an error in which embedded Python received an out-of-memory error.

DP-409708: Add support for .NET 6

Category: Gateways - .NET
Platforms: All
Version: 2022.1.1

This change adds support for .NET 6 for all .NET features.

DP-411455: No longer convert $char(0) to empty string in IRISNative and Gateway

Category: Gateways - .NET
Platforms: All
Version: 2022.1.1

As of this change, IRISNative and Gateway no longer convert $character(0) to an empty string. This conversion was intended only for SQL data.

DP-414366: Correct closing of Gateway

Category: Gateways - .NET
Platforms: All
Version: 2022.1.1

This change corrects a bug in which when a variable containing a Gateway is left around until after a new Gateway is created, the delayed destruction of the first Gateway can potentially close the device that's used by the second Gateway.

DP-414468: Update StartGateway confirmation logic to use SSLConfigurationClient

Category: Gateways - .NET
Platforms: All
Version: 2022.1.1

Before this change, StartGateway with confirmation set to 1 returned failure because it was not using SSLConfigurationClient.

DP-415975: Ensure Gateway to grant access to %SYS globals

Category: Gateways - .NET
Platforms: All
Version: 2022.1.1

This change ensures that the user account that starts the Gateway and connecting to it has the permissions needed for those actions.

DP-416104: Change to how passphrase is passed to Gateway

Category: Gateways - .NET
Platforms: All
Version: 2022.1.1

This change modifies how the passphrase is passed to the Gateway process.

DP-416108: Fix bug that Gateway hangs during system shutdown

Category: Gateways - .NET
Platforms: All
Version: 2022.1.1

This change corrects a bug that caused the Gateway to hang during system shutdown.

DP-416405+DP-416125: Internal calls now use server name

Category: Gateways - .NET
Platforms: All
Version: 2022.1.1

This change modifies the %Net.Remote classes to use the Gateway server name rather than host+port.

DP-416960+DP-41705: Can use gateway if hold %Admin_ExternalLanguageServerEdit resource

Category: Gateways - .NET
Platforms: All
Version: 2022.1.1

With this change, if a user has %Admin_ExternalLanguageServerEdit resources, which permits the user to edit the external language server definitions, the user can also use any language Gateway.

DP-418539: Correct toDao() method of %Net.Remote.ObjectGateway

Category: Gateways - .NET
Platforms: All
Version: 2022.1.2

This change corrects the toDao() method of %Net.Remote.ObjectGateway so that it only creates properties that do exist in Config.Gateways. This change makes it possible to create remote gateways.

DP-419265: Restore %Net.Remote.Service::PingGateway

Category: Gateways - .NET
Platforms: All
Version: 2022.1.2

This change restores the method PingGateway() to %Net.Remote.Service. This method now simply calls the %Ping() method of %Net.Remote.Gateway.

DP-413359: JDBCGateway to load third-party JAR files into system class loader

Category: Gateways - JDBC
Platforms: All
Version: 2022.1.2

This change forces all JDBC third party JAR files to be loaded into system class loader. This will resolve the problem of unchecked memory leak.

DP-415600: FIX - upgrade iODBC version for ODBC gateway support on Mac M1

Category: Gateways - ODBC
Platforms: AIX,macOS
Version: 2022.1.1

This change updates the iODBC version from 3.52.04 to 3.52.15.

DP-406468: External Server - fix <UNDEFINED> error encountered when starting a Python gateway

Category: Gateways - Python
Platforms: All
Version: 2022.1.2

This change fixes a bug in %Net.Remote.ObjectGateway that resulted in an <UNDEFINED> error when starting a Python gateway.

DP-413814: Activate Python SSL support in IRISPython 3.2

Category: Gateways - Python
Platforms: All
Version: 2022.1.1

This change activates Python SSL support in IRISPython 3.2.

DP-414026: Fix bug that failed SLL connection hangs PythonGateway Server

Category: Gateways - Python
Platforms: UNIX®
Version: 2022.1.1

This change ensures that a failed SSL connection will not hang the PythonGateway Server. This bug was present on Unix systems.

DP-414102: Modify Gateway SSL argument to use ":" as delimiter instead of "?"

Category: Gateways - Python
Platforms: UNIX®,macOS
Version: 2022.1.1

The Gateway SSL argument format is ssl:/<xml-filename>?<password>, with the question mark as the delimiter. However, the question mark causes problems because it is treated as a wildcard on Mac and some Unix shells.

This change causes the delimiter to be ":" instead.

DP-414166: Correct handling of SSL cryptographic settings in Python

Category: Gateways - Python
Platforms: All
Version: 2022.1.1

This change corrects the handling of SSL cryptographic settings. Here is the new logic:

• In the current version of Python's SSL implementation, TLSv1.3 ciphers are not changeable.
• For TLSv1.3, only Ciphersuites is used, its value must be exactly this list: TLS_AES_128_GCM_SHA256:TLS_AES_256_GCM_SHA384:TLS_CHACHA20_POLY1305_SHA256 (order may vary)
• For versions lower than TLSv1.3, only CipherList is used. Its value is used to call set_ciphers().

DP-414221: Add "Verify SSL Host Name" to Python Gateway settings

Category: Gateways - Python
Platforms: All
Version: 2022.1.1

This change adds "Verify SSL Host Name" to the Python Gateway settings.

DP-416351: Give a default resource for Gateway if not specified in Create()

Category: Gateways - Python
Platforms: All
Version: 2022.1.1

This change ensures that however you create a gateway, the default for Resource Required is %Gateway_Object. Before this change, when you created a gateway in the Terminal, Resource Required was an empty string (which was not consistent with what happened when you created a gateway in the Management Portal).

DP-418573: Fix memory leak when using streams in %XML.XSLT.Transformer

Category: Gateways - XSLT
Platforms: All
Version: 2022.1.2

This change fixes a memory leak that occurred when using streams in the callback handler in ##class(%XML.XSLT.Transformer).TransformStream.

DP-416244: Exclude async members from shard broker host configuration

Category: ICM
Platforms: All
Version: 2022.1.2

With this change, ICM does not set shard brokered hosts on async mirror members.

DP-413625: Corrects an access problem for server-side editing from VSCode

Category: IDEs
Platforms: All
Version: 2022.1.1

Before this change, when a user wanted to enable server-side editing from VSCode, the user had to run this command for each namespace:

GRANT EXECUTE ON %Library.RoutineMgr_StudioOpenDialog TO %Developer

DP-416045: Correct Studio bug with View Web Page for a class that had a fully qualified LOCATION parameter

Category: IDEs
Platforms: All
Version: 2022.1.2

This change fixes a bug in which the View Web Page option did not work for a class whose LOCATION parameter is a full path with the scheme prepended (http:// or https://).

DP-416194: Show calculated properties as "Calculated" instead of nonprintable characters

Category: IDEs
Platforms: All
Version: 2022.1.2

With this change, IDEs show calculated properties as "Calculated" instead of as nonprintable characters.

DP-417920: Correct access to the Atelier debug agent

Category: IDEs
Platforms: All
Version: 2022.1.2

This change fixes an earlier change that ensures that the Atelier debug agent is dispatched to from a REST context. Before this fix, it was possible to receive the error ERROR #5916: Illegal Web Request [zOnPreServer+7^%Atelier.v5.XDebugAgent.1:%SYS]

DP-410240: Add log parsing tool to Web Gateway installers

Category: Installation
Platforms: All
Version: 2022.1.1

This change adds a log parsing tool to all Web Gateway installers.

DP-410894: Handle bad mappings in CPF file during conversion

Category: Installation
Platforms: All
Version: 2022.1.1

While converting the CPF file during a Caché to InterSystems IRIS conversion, the code now updates the [Map.*] sections and replaces any references to the CACHE* system databases to the corresponding InterSystems IRIS* system databases.

In one scenario, there was a line that was not converted correctly, causing the conversion to fail.

DP-412431: Require 2MB free space in the manager database before continuing installation

Category: Installation
Platforms: All
Version: 2022.1.1

It is now necessary to have at least 2 MB of freespace in the manager database before the installer can run. With this change, the installer checks the manager database and does not allow the installer to proceed unless there is enough space.

DP-413191: Distinguish Linux platforms for unsupported InterSystems IRIS platforms

Category: Installation
Platforms: UNIX®
Version: 2022.1.1

This change improves the installer prompts shown when one tries to install InterSystems IRIS on an unsupported platform. Previously, the prompts did not provide enough information to distinguish some of the Linux platforms.

DP-413447: Do not install intersystems-integratedml-*.jar on Windows unless IntegratedML is installed

Category: Installation
Platforms: Windows
Version: 2022.1.1

Wit this change, the installer will not install dev\java\lib\1.8\intersystems-integratedml-*.jar on Windows unless the IntegratedML feature is selected for install.

DP-413651: Remove .../dev/java/lib/datarobot/*.jar files from kits

Category: Installation
Platforms: All
Version: 2022.1.1

This change removes .../dev/java/lib/datarobot/*.jar files from kits.

DP-414541: Remove .NET 2 files from Windows kits

Category: Installation
Platforms: Windows
Version: 2022.1.1

This change removes references to .NET 2 from Windows install.

DP-414705: remove old files in upgrade on macOS before copying new version

Category: Installation
Platforms: macOS
Version: 2022.1.1

macOS does not always refresh executable signature cache when files are overwritten by "cp" command. As a workaround, the installer will remove old version before copying a new one on this platform.

DP-414750: Update Xerces to 3.2.3

Category: Installation
Platforms: All
Version: 2022.1.1

xerces_c version used by InterSystems IRIS build is upgraded from 3.2.2 to 3.2.3.

DP-415894: Always overwrite httpd modules upon upgrade

Category: Installation
Platforms: Windows
Version: 2022.1.2

With this change, the installer will always overwrite Apache httpd *.so modules on upgrade because normal versioning rules to not apply to .so files. This change fixes an error in which the Management Portal would not work after upgrade.

DP-416718: Fix conversion of remote gateway address of 127.0.0.1

Category: Installation
Platforms: All
Version: 2022.1.1

This change corrects a bug in which performing an upgrade would lose the Remote Server Address for a remote gateway.

DP-418665: Allow InterSystems IRIS upgrade after an OS upgrade on Unix

Category: Installation
Platforms: UNIX®
Version: 2022.1.2

With this change, the Unix install will allow InterSystems IRIS upgrade to proceed when irisdb cannot start due to missing OS libraries caused by OS upgrade.

DP-416027: AutoML fix for SUSE 'sys' module bug

Category: IntegratedML
Platforms: Linux
Version: 2022.1.2

This change works around a Python bug (resolved in Python 3.8) that affects %ML.AutoML.Provider. The bug had resulted in the error AttributeError: module 'sys' has no attribute 'argv'

DP-416137: Correct incompatibilities raised by TensorFlow and tensorboard

Category: IntegratedML
Platforms: All
Version: 2022.1.2

This change fixes incompatibilities raised by TensorFlow and tensorboard.

DP-418508: Shared/Utility code(CacheList) should not assume casting an unsigned char to (char) or (int) will make it signed

Category: IntegratedML
Platforms: All
Version: 2022.1.2

This change corrects an issue that occurred when casting (unsigned char) to (char) or (int) on ARM. Before this change, the unsigned char was not sign extended.

DP-410236: PATCH verb supported by EnsLib.HTTP.OutboundAdapter

Category: Interoperability
Platforms: All
Version: 2022.1.1

The EnsLib.HTTP.OutboundAdapter now supports the PATCH verb and passes it to %Net.HttpRequest.

The new adapter methods are Patch(), PatchFormDataArray(), and PatchURL().

DP-410391: Modify setting 'raw' XML to a property path to aid determination of order

Category: Interoperability
Platforms: All
Version: 2022.1.1

There was a previous correction that corrected the output order for a single property path in a sequence where a prior array sibling had more than one element. This correction lead to a possible change in output order when 'raw' XML (for example from a source XML VDoc complex property) was set using a Property path syntax. The latter change is now corrected.

A new transient property of EnsLib.EDI.XML.Document is introduced to allow the prior behavior. The property is ByPassPropCacheForMixed.

When setting 'raw' XML to a Property path (as opposed to a DOM path), this flag allows setting the data directly to the internal DOM storage. While this might improve performance, the output may have nodes in a different order than desired when combining with single property path sets.

This setting is provided for backwards compatibility. The default is to set to the internal intermediary Property storage.

DP-412203: XML Virtual Document schema correction when collapsing only one inner ComplexType Sequence Element

Category: Interoperability
Platforms: All
Version: 2022.1.1

When generating the schema for an XML Virtual document using an XSD, the code collapses redundant inner elements - see documentation

Certain XSD with complex types for the inner elements were collapsed so that even the last single child was collapsed, resulting in having no virtual properties being available. This is now corrected.

DP-412700: Enterprise Monitor QueueCount sorting correction

Category: Interoperability
Platforms: All
Version: 2022.1.2

Sorting by QueueCount on the Enterprise Monitor Status management portal page has been corrected. The page has also been improved in various ways, including wording changes, tooltips, and a change to how the page is refreshed.

DP-414905: XML VDoc SetSubDocumentAt did not copy attributes for top node

Category: Interoperability
Platforms: All
Version: 2022.1.1

An error had been introduced into the SetSubDocumentAt API used by the DTL SubTransform for XML Virtual Documents whereby the attributes of the top node of the sub document being used as the source were not being being populated. This is now corrected.

DP-415234: Improvements to the Message Purge API

Category: Interoperability
Platforms: All
Version: 2022.1.2

This change improves the performance of the Message Purge API and makes it possible to have different retention periods for different production configuration items.

It is now also possible to specify which config items to limit a particular purge request to.

The user running the updated Purge API requires SQL SELECT privilege on the Ens.MessageHeader table. This is a change from the existing API in Ens.MessageHeader::Purge.

For details on the Purge() method, see Ens.Message Header in the class reference.

The Purge Task has been updated to allow specifying the optional Work Queue Category, the WQBatchSize.

The new settings (properties) exposed for Ens.Util.Tasks.Purge are optionalMessageLimitToConfigItems, optionalMessageWorkQueueBatchSize, and optionalMessageWorkQueueCategory. There are no default values.

To configure a task to use the multi-threaded purge, set the value of optionalMessageWorkQueueCategory to Default or to a custom category.

See Configuration > Work Queue Manager Categories in the Management Portal and documentation.

If optionalMessageWorkQueueCategory is set, then optionalMessageWorkQueueBatchSize can also be set.

optionalMessageLimitToConfigItems is independent of whether you use multi-threaded message purge.

DP-415411: Project FullSize property to SQL for all EDI document types

Category: Interoperability
Platforms: All
Version: 2022.1.2

This change projects the FullSize property to SQL for X12, EDIFACT, and ASTM.  The property had already existed for all three (plus HL7), and the projection was already included for HL7.

DP-416059: Update to interoperability Java and DotNet Gateway services

Category: Interoperability
Platforms: All
Version: 2022.1.1

With this change, the EnsLib Gateway services use a dynamic object instead of the now-deprecated %Net.Remote.ObjectGateway class.

DP-416310: Use correct API to stop External Language Server

Category: Interoperability
Platforms: All
Version: 2022.1.1

This change corrects the Interoperability Gateway service so that it uses the correct API to stop the External Language Server.

DP-416568: Modifications to how productions start/stop/update as _Ensemble

Category: Interoperability
Platforms: All
Version: 2022.1.2

This change modifies how the implementation of the internal wrapper methods that allow Interoperability Production Host Items to run as InterSystems IRIS user _Ensemble.

DP-416858: Add optional use of Access Token for SASL XOAUTH support in EnsLib email adapters

Category: Interoperability
Platforms: All
Version: 2022.1.2

The email adapters now provide a new setting for a configured OAuth2 Application to use for SASL XOAUTH2. The adapters will use the associated Access Token if the application is authorized.

The new settings include OAuth2ApplicationName, which is an optional OAuth2 Client Configuration Application name to use. If specified, this indicates that OAuth 2 is to be used and the name is used in the Authorization and Access Token retrieval process.

DP-417266: Disable EXTERNAL INTERRUPT in production when invoking via %SOAP.WebService

Category: Interoperability
Platforms: All
Version: 2022.1.2

This change disables external interrupts when calling into Interoperability productions (CreateBusinessService) via core %SOAP.WebService.

DP-417996: SOAP adapter/service syncrequest to support response timeout recovery

Category: Interoperability
Platforms: All
Version: 2022.1.2

With this change, the SOAP adapter/service will support optional Response Timeout Recovery for requests that depend on possibly long running synchronous sends within the production.

When a client system retries, it is up to the receiving code to handle whether to fully reprocess the request or look for a response that has been created already. The Interoperability framework by default will attempt to fully reprocess each request. The framework provides for asynchronous request coupled with secondary attempts to obtain the response using the Deferred Sending mechanism which uses deferred response tokens.

A new feature has been added to aid existing code that uses a synchronous request to process a client message within the SOAP protocol and the client times out waiting for the initial response and retries. The new feature is designed to prevent multiple processing of the same retried request. The support relies on the SOAP service processing to continue even when the original client request and that the original response is returned to the client on a retry attempt.

Both the SOAP client and SOAP service need to be configured to support Synchronous Delayed Response Support for SOAP client requests. Only one SendRequestSync in the particular SOAP Service web method call is supported.

The EnsLib.SOAP.OutboundAdapter can be configured to include the request key in the HTTP headers to identify uniquely its request and whether the request is a retry. The Adapters response timeout setting is also included in a new header. The new HTTP headers are VND.InterSystems.IRIS.RequestKey, VND.InterSystems.IRIS.RetryRequestKey and VND.InterSystems.IRIS.ResponseTimeout.

The value for VND.InterSystems.IRIS.RequestKey and associated VND.InterSystems.IRIS.RetryRequestKey are to be the same.

The setting that controls the inclusion is IncludeRequestKeyInHTTPHeader. The default is OFF. The new setting is displayed under the category of DelayedResponseSupport

A new setting SupportDelayedSyncRequest (under the category of DelayedResponseSupport) is provided for SOAP Business Services that extend EnsLib.SOAP.Service or business services that are invoked via CreateBusinessService from a %SOAP.WebService subclass and extend a new class Ens.Helper.Service.SyncResponseHandler.HTTP. The default is OFF.

Two other settings are provided: OverrideClientResponseWaitTimeout and GatewayTimeout.

Support for Delayed Sync Request is implemented when the service is enabled for SupportDelayedSyncRequest and the client sends includes VND.InterSystems.IRIS.RequestKey on first request and VND.InterSystems.IRIS.RetryRequestKey on subsequent retries:

SendRequestSync call will record the client request key and the request header for the SendRequestSync in a temporary object Ens.Temp.XREF.DelayedClientRequest. The storage global is ^IRIS.Temp.EnsRuntimeAppData($NAMESPACE,"_syncdelayed","D") When a client times out and retries before the original request is completed, the SendRequestSync call will examine the Ens.Temp.XREF.DelayedClientRequest table for an outstanding response handling. If it is determined that processing is still taking place the SendRequestSync call will wait until either the original response is returned or the client times out. (The intention of waiting until the client times out is because there is no control over the custom code flow in the service after the SendRequestSync call.) When a delayed response is returned for the original request, the entry is in Ens.Temp.XREF.DelayedClientRequest. When a delayed response is returned on a retry, the entry in Ens.Temp.XREF.DelayedClientRequest is left in case the client was disconnecting at the point of response being returned. After the second retry with response returned, the entry in Ens.Temp.XREF.DelayedClientRequest is removed. It is, therefore, possible that entries in Ens.Temp.XREF.DelayedClientRequest can remain but these are not expected to be common. That is, this feature is intended to help for what is regarded as edge cases.

DP-419175: Correct xDBC static cursor execution with runtime plan choice

Category: JDBC
Platforms: All
Version: 2022.1.2

This change corrects an issue in JDBC Static Cursor query execution where an <UNDEFINED> error occurred during Close of the cached query. The error reported by the server was as follows:

java.sql.SQLException: [SQLCODE: <-400>:<Fatal error occurred>]
[Error: <<UNDEFINED>%OnClose+3^%sqlcq.SAMPLES.HIQN7Dljzf5.cls1.1>]
[Location: <ServerLoop>]
    at com.intersystems.jdbc.IRISConnection.getServerError(IRISConnection.java:976)
    at com.intersystems.jdbc.IRISConnection.processError(IRISConnection.java:1121)
    at com.intersystems.jdbc.InStream.readMessageInternal(InStream.java:314)
    at com.intersystems.jdbc.InStream.readMessage(InStream.java:201)
    at com.intersystems.jdbc.InStream.readMessage(InStream.java:183)
    at com.intersystems.jdbc.IRISPreparedStatement.Query(IRISPreparedStatement.java:95)
    at com.intersystems.jdbc.IRISPreparedStatement.executeQuery(IRISPreparedStatement.java:47)
    at com.intersystems.jdbc.test.legacy.test18.fastSelect.SimpleTest.runTest(SimpleTest.java:178)
 

DP-410180: Do not change journal directory when unrelated journal property changes

Category: Journaling
Platforms: All
Version: 2022.1.2

This change corrects an issue that caused journaling to change back to the primary directory when a journal property change unrelated to journal directories is activated.

DP-414668: Properly create 2GB or larger journal files on Unix platforms

Category: Journaling
Platforms: UNIX®
Version: 2022.1.1

Addressed an issue that could cause journal decompression to fail or hang on Unix platforms when the original (uncompressed) file size is 2GB or greater.

DP-415782: Fix a problem that caused JRNDUMP not to display specific journal files

Category: Journaling
Platforms: All
Version: 2022.1.2

Before this fix, if you deactivated an encryption key after turning off journal file encryption, that caused JRNDUMP not to display any journal files created before journal file encryption was disabled.

DP-417229: Ensure that ^STU has access to system data

Category: Journaling
Platforms: All
Version: 2022.1.2

This change ensures that ^STU has access to system data. Before this change, it was possible for %ZSTART code (which calls ^STU) to fail occasionally because the _Ensemble user and the Security.System 'SYSTEM' object could not be found.

DP-412948: Correct display for the GBLOCKCOPY monitor

Category: Kernel
Platforms: All
Version: 2022.1.2

This change corrects the output display of the GBLOCKCOPY monitor.

DP-413143: Upgrade zlib to 1.2.12

Category: Kernel
Platforms: All
Version: 2022.1.1

This change upgrades zlib to version 1.2.12.

DP-413859: Corrected a CPP dispatcher issue

Category: Kernel
Platforms: All
Version: 2022.1.1

This change fixes a rare problem with class methods implemented in Python or C++. If the method implementation calls back into InterSystems IRIS and invalidates context, after invalidation, the class/context may cause an unpredictable result. In this case python.Import() tries to new an object of the same type but the class object is freed/reused for something else.

DP-414175: Fix mirroring failure when mirror set name starts with numeric character

Category: Kernel
Platforms: All
Version: 2022.1.1

This change fixes a mirroring failure when a mirror set name starts with a number.

DP-414224: Handle error() call in Windows mailbox thread

Category: Kernel
Platforms: Windows
Version: 2022.1.1

Under very unusual conditions, a $VIEW(-1,pid) of another process could cause that process to terminate with an exception.

DP-414650: Fix error that could cause ECP daemon not finding lock entry for delock.

Category: Kernel
Platforms: All
Version: 2022.1.1

This change fixes an error in ECP that would sometimes result in a message like the following: Could not find lock entry for delock request, tid=70000, token=6f3261, sfn=3, lock=^ER1DCS(921208056)

DP-414757: Prevent dead lock on MISC resource during pidtab expansion

Category: Kernel
Platforms: All
Version: 2022.1.2

This change prevents a dead lock on MISC resource during pidtab expansion.

DP-414973: Avoid missing journal entry in primary when mirrored is re-mounted.

Category: Kernel
Platforms: All
Version: 2022.1.1

Avoid missing journal entry in primary when mirrored is re-mounted.

DP-415307: JRNZIP now finds first uncompressed mirror journal file at startup

Category: Kernel
Platforms: All
Version: 2022.1.2

A problem has been resolved where the last journal file an async member was receiving when it was shut down remained uncompressed after the instance is started.

DP-415602: Improve %ToJSON() performance when writing to streams or files

Category: Kernel
Platforms: All
Version: 2022.1.2

The performance of the %DynamicAbstractObject method %ToJSON() has been improved when the JSON representation of a complex JSON object is being sent to a stream or file.   (The performance when writing to a string had already been improved.)

DP-415977: Support /ENV argument for CPIPE open

Category: Kernel
Platforms: All
Version: 2022.1.1

This change adds a /ENV argument to the CPIPE Open command. It specifies environment variables to be set in the new process. There are two ways to specify the values - explicitly or in an array. The examples show two names but there can be any number. The explicit list must be enclosed in parentheses.

Explicitly:

  /ENV=(name1:value1,name2:value2)

  Set arr(name1)=value1
  Set arr(name2)=value2
  /ENV=arr...

DP-416121: Fixed an issue in ECP that resulted in <WIDE CHAR> error when using $ORDER in reverse

Category: Kernel
Platforms: All
Version: 2022.1.2

This change corrects an issue in ECP that sometimes resulted in a <WIDE CHAR> error when using $ORDER in reverse.

DP-416181: kill fix

Category: Kernel
Platforms: All
Version: 2022.1.1

The new KILL code introduced an extremely rare possibility that a KILL (most likely a large kill) could result in a hang of the system (the write daemon freezes and processes eventually stop running).   No database degradation occurs.  It is recommended that anyone who installed a version with the new KILL code eventually update to a maintenance release with this fix at a convenient time.

DP-416283: Support /ENV on $ZF(-100)

Category: Kernel
Platforms: All
Version: 2022.1.1

This change adds /ENV to the $ZF(-100) flags argument. It specifies environment variables to be set in the new process. There are two ways to specify the values - explicitly or in an array. The explicit list must be enclosed in parentheses.

This is similar to /ENV for CPIPE (DP-415977) but subtly different for explicit values. With CPIPE the name and value are expressions - they can be string literals (quoted strings) or variable names or any expression. With $ZF(-100), because the entire flags argument is a string, the name and value are always treated as strings, not variable names. If they contain characters that would interfere with parsing the rest of the string, such as colon or comma, they must be enclosed in quotes, which must be doubled because they are within the flags string.

The format is /ENV=(name:value) There can be multiple name:value pairs separated by a comma.

This example will run the command with variable MYNAME equal to "Tom" and MYARG equal to "comma,".

do $ZF(-100,"/ENV=(MYNAME:Tom,MYARG:""comma,"")",command)

This example produces the same result as the previous one.

set arr("MYNAME")="Tom"
set arr("MYARG")="comma,"
do $ZF(-100,"/ENV=arr...",command)

DP-416662: Fix check for $C(num)=0 when num#256=48

Category: Kernel
Platforms: All
Version: 2022.1.2

This change corrects an issue on x64 platforms. Before this change, set var=$C(num),result=var=0 would set result=1 for all num values where num#256=48.

DP-416949: Corrected an error in which a multidimensional property was incorrectly treated as a Python method

Category: Kernel
Platforms: All
Version: 2022.1.2

This change corrects an error in which a multidimensional property was incorrectly treated as a Python method, raising a wide chararacter error.

DP-416971: Corrected handling of new format routines

Category: Kernel
Platforms: All
Version: 2022.1.2

This change corrects handling of obj code for routines with no source. Before this change, it was possible to have <SYSTEM> errors after restart.

DP-417018: Corrected routine invalidation order across ECP

Category: Kernel
Platforms: All
Version: 2022.1.2

This change corrects an issue in which routine recompilation didn't invalidate rOBJ blocks consistently relative to routine invalidation on application servers. The application servers would continue to run the old version.

DP-417668: Corrected embedded Python IO redirection

Category: Kernel
Platforms: All
Version: 2022.1.2

This change corrects embedded Python IO redirection.

DP-418023: Correct variable states in %ETN or %STACK

Category: Kernel
Platforms: All
Version: 2022.1.2

This change corrects an error that cause the error trap %ETN, or the %STACK utility, to omit the data value for a variable, given a particular order of NEW commands in the execution stack.

Before this change, doing a $$LOG^%ETN() stack dump could sometimes die, resulting in an incomplete dump in the ^ERRORS global.

DP-418343: Fix %SYS.Trace change trace directory

Category: Kernel
Platforms: All
Version: 2022.1.2

This change corrects an issue that was seen when using ^TRACE UI or %SYS.Trace API to change the directory for trace files to a path with a shorter length. Before this correction, an incorrect directory was used until the time the system is restarted.

DP-419462: Global iterator: Correct compact unicode/vector big string value handling and don't cache big strings by default

Category: Kernel
Platforms: All
Version: 2022.1.2

This change correct compact unicode/vector big string value handling and also no longer caches big strings by default.

DP-419666: Correct method dispatch cache invalidation

Category: Kernel
Platforms: All
Version: 2022.1.2

This change corrects a very rare error that could result in segfault errors.

DP-419771: Include Red Hat version in $zv on lnxrh9x64, lnxrharm64 and lnxrh9arm64 platforms

Category: Kernel
Platforms: All
Version: 2022.1.2

$zv will include Red Hat version on Red Hat 8 arm64 and both Red Hat 9 platforms

DP-413589: Support paging for results tables produced by %CSP.UI.Component.SQLTables

Category: Management Portal
Platforms: All
Version: 2022.1.1

This adds the ability for the SQLTables component to produce paged results, which reduces the rendering burden of huge HTML tables and improves user experience.

DP-417081: Update Database page to sort correctly

Category: Management Portal
Platforms: All
Version: 2022.1.2

This change corrects the Database page to display data correctly when you sort by available space.

DP-412174: Changing async member type between DR and Reporting now restarts dejournaling

Category: Mirroring
Platforms: All
Version: 2022.1.2

This correction ensures that when you change the async member type between DR and Reporting, that change also restarts dejournaling.

Before this correction, in such a scenario, dejournaling was not restarted and consequently, multiple updater jobs were left running.

DP-412459: Allow users to correct the "ERR" failure in ProcessValidationFailure^MIRROR.

Category: Mirroring
Platforms: All
Version: 2022.1.2

This change allows users to correct the "ERR" failure in ProcessValidationFailure^MIRROR.

DP-415939: Allow users to delete all mirror journal files when deleting a mirror set configuration.

Category: Mirroring
Platforms: All
Version: 2022.1.2

This change allows users to delete all mirror journal files when deleting a mirror set configuration.

DP-418792: Fix 30 seconds delay on primary sending journal data to async members

Category: Mirroring
Platforms: All
Version: 2022.1.2

This change removes an unnecessary 30 second delay on the primary member sending journal data to async members.

DP-415166: Fix <PROTECT> error in %Monitor.Process

Category: Monitoring
Platforms: All
Version: 2022.1.2

This change allows ##class(%Monitor.Process).Metrics() to be called from a non-privileged account in any namespace.

DP-416533: /csp/sys/oauth2/ web application should not require %All

Category: OAuth
Platforms: All
Version: 2022.1.2

This change modifies the /csp/sys/oauth2/ web application so that it does not run with the %All role. The %All role will no longer be added to the application roles. If the web application already exists this role, the application is updated to no longer use this role.

The CSPURL parameter has also been added to the following pages, so that they cannot be executed from other /csp/sys/ applications:

DP-416247: Allow IRISDate and IRISTime to be created from string values from server

Category: Object - .NET Binding
Platforms: All
Version: 2022.1.2

In the .NET Bindings, when a value returned from the server is expected to be a date or time, we need to convert it to type IRISDate or IRISTime. Before this change, the conversion occurred only if the type returned from the server was IRISDate/IRISTime or Long/Int.

With this change, a string from the server containing an ODBC date/time value or similarly formatted date/time (such as 01-01-2021) can also be turned into the corresponding IRISDate/IRISTime object.

DP-408900: Correct how .NET XEP detects the number of defined indexes

Category: Object - .NET XEP
Platforms: All
Version: 2022.1.1

This change corrects how .NET XEP detects the number of defined indices from the storage schema. Previously, a error would be possible for some queries.

DP-408901: Fix bug in subscript mapping caused by null/empty string problem

Category: Object - .NET XEP
Platforms: All
Version: 2022.1.2

By default, the subscript for the base data node used by a persistent class is not specified. This is specified in the Unified schema as either null or "", depending on how the subscript is specified in the storage definition. .NET constructs a subscript map using the subscript from the unified storage schema. This change normalizes both null and empty string ("") to null when constructing that map.

DP-408902: .NET XEP - update handling of reference and embedded types

Category: Object - .NET XEP
Platforms: All
Version: 2022.1.2

XEP supports embedded objects (%SerialObject) and references to persistent objects.

This change allows .NET XEP to process new schema definitions for embedded and reference types.

DP-410585: Add check for serializable attribute in arrays of objects for .NET XEP

Category: Object - .NET XEP
Platforms: All
Version: 2022.1.1

In XEP when determining the type of a field, if the field is an array, XEP determines the type based on the elements of the array. However, there was a bug in the .NET version where no further checks would be made to determine if the array field was annotated as serializable or not, which caused errors down the line.

This change makes the behavior consistent with Java XEP, and will set the type of an array field to be serializable if it is annotated as such.

In addition, there was a bug when reading serialized arrays in which no actual data was read, and the resulting array was always empty. This change fixes that issue as well.

DP-411312: Correctly deserialize serializable XEP object arrays in .NET 5

Category: Object - .NET XEP
Platforms: All
Version: 2022.1.1

This change uses a new implementation to deserialize serializable XEP object arrays.

DP-412574: Remove console write from .NET XEP

Category: Object - .NET XEP
Platforms: All
Version: 2022.1.1

Before this fix, when storing data, an unnecessary line was printed to the console, giving information about the elapsed server write time.

DP-416571: SQL: Correct Iregression with class query (SQL) that includes $$$OK macro reference

Category: Object Compiler
Platforms: All
Version: 2022.1.2

This change corrects an issue in which a class query of type %SQLQuery might fail to compile if the SQL query references an InterSystems IRIS system macro, such as $$$OK, in the query text.

DP-416677: Correct error when opening a %Dictionary class

Category: Object Compiler
Platforms: All
Version: 2022.1.2

This change corrects an error in which the system did not release a lock on a %Dictionary package class. The error occurred when the class dictionary version for the class was out of date and the attempt to automatically upgrade the version failed.

DP-407820: Add qualifier to verify class storage is not changed during class compile

Category: Object Library
Platforms: All
Version: 2022.1.2

This change adds a qualifier to enable you to verify class storage that not changed during class compile. If this qualifier is enabled, if class storage is changed, the compiler now reports an error as this can lead to problems using this storage against existing data. The qualifer is called /checkstoragedefined. Pass in /checkstoragedefined=1 turn this checking on.

DP-409668: Don't display verbose OAuth errors after redirect failures

Category: Object Library
Platforms: All
Version: 2022.1.2

This change fixes a issue in which the OAuth2.Response and OAuth2.PostLogoutRedirect classes would display a custom error page with verbose errors under certain redirect failure conditions. Now, those pages display the web application's default error page and log the verbose errors.

DP-414164: Suppress generation of idkey index with no properties

Category: Object Library
Platforms: All
Version: 2022.1.1

When a unified schema contains an index defined as the idkey but does not define any fields on which the index key is based, then the assumption is that the index key is generated by the system. There is no way to define that index in InterSystems IRIS because the system assigned keyword is a CompiledIndex property only and not an IndexDefinition property. This change fixes the problem by suppressing the definition of an index that is flagged as the IDKEY but does not define any fields.

DP-414418: Reject unrecognized client assertion types in OAuth2 server

Category: Object Library
Platforms: All
Version: 2022.1.1

This change updates the OAuth server code to reject token requests whose client_assertion_type value is not "urn:ietf:params:oauth:client-assertion-type:jwt-bearer" with a 400 status code.

DP-414475: Return 400 error when no client authentication sent to OAuth token endpoint

Category: Object Library
Platforms: All
Version: 2022.1.1

When no basic auth, client_assertion, or client_id is sent to the OAuth Token endpoint to authenticate a client, the server now returns a 400 error with "invalid_client". Previously it had returned a 500 server error.

DP-414511: Reinstate accidentally removed return value to OAuth2.Server.Token:Authorize()

Category: Object Library
Platforms: All
Version: 2022.1.1

This change reinstates the successful return value from OAuth2.Server.Token:Authorize(),

DP-414548: Avoid duplicate rebuild of routine/class index

Category: Object Library
Platforms: All
Version: 2022.1.1

This change removes redundant steps in the logic that builds the routine/class indexes.

The change also increases the timeout for the routine/class index when doing a rebuild from 5s to 120s, as an index build can take a short while and other processes need to wait for the first process to complete.

DP-414767: Fix host key crash in FIPS mode

Category: Object Library
Platforms: All
Version: 2022.1.1

When running in FIPS mode, making an SSH connection could crash because FIPS specifically disallows the traditional MD5 hashes and the libssh2 function returns a NULL pointer that the code was not checking for.

DP-415659: Drop histogram info when exporting with /exportversion <2021.2 for Caché

Category: Object Library
Platforms: All
Version: 2022.1.2

This change modifies the class export code (such as $system.OBJ.ExportPackage()) so that it omits histogram information if /exportversion is 2021.2 or earlier.

DP-415703: Allow %OAuth2.JWT:GetJWK() to find keys by algorithm without a kid

Category: Object Library
Platforms: All
Version: 2022.1.2

This change modifies the GetJWK() method in %OAuth.JWT to return a key even if no JWK is found with the matching kid.

If no key is found with a matching kid and alg, then we will return the most recently added key with a matching alg, regardless of the kid in the the JWKS.

This corrects a bug in the case where the JWKS is generated from an x509 configuration on both the server and client. In this case, the kid values will not match.

DP-415716: Remove illegal syntax from code generated by %JSON.Adaptor

Category: Object Library
Platforms: All
Version: 2022.1.2

Before this fix, if a class extended %JSON.Adaptor and included a property defined as a list of streams, that class could not be compiled.

DP-416517: Drop the 'histogram' info while exporting with /exportversion <2021.2 for InterSystems IRIS

Category: Object Library
Platforms: All
Version: 2022.1.2

This change corrects code export with /exportversion <2021.2. Now the export will not include the 'histogram' information, which is not accepted in earlier releases.

DP-416632+DP-416639: Fix variable leaking in %DocDB.Database

Category: Object Library
Platforms: All
Version: 2022.1.2

This change ensures that no internal variables are left after you call %CreateDatabase() of the class %DocDB.Database.

DP-416725: Prevent <UNDEFINED> error for %Studio.Project::InstallFromGbl()

Category: Object Library
Platforms: All
Version: 2022.1.2

This change prevents an <UNDEFINED> error that was possible when using %Studio.Project::InstallFromGbl().

The error message included the text

<UNDEFINED>SaveLocalSettings+78^%occStorage

DP-416814: Fix direct reference to %RuntimeMode in %ScrollableResultSet

Category: Object Library
Platforms: All
Version: 2022.1.2

This change corrects a refactoring that changed ..RuntimeMode to (incorrect) i%RuntimeMode.

DP-417775: Allow globals to be killed in HALT cleanup even if GlobalKillEnabled=0

Category: Object Library
Platforms: All
Version: 2022.1.2

This change ensures that the system cleans up globals correctly (without <PROTECT> errors) during the global cleanup logic in HALT handling, even if the CPF file has GlobalKillEnabled=0.

DP-418357: Enable embedding token recognition for JavaScript template literals

Category: Object Parser
Platforms: All
Version: 2022.1.2

This change corrects an error that caused compilation errors for a class that contained JavaScript template literals.

DP-416355: Avoid UNDEFINED error in %RemoveFromSaveSet() for item not in save set

Category: Object Storage
Platforms: All
Version: 2022.1.2

Before this change, when calling %RemoveFromSaveSet for a class that is not in the save set (for example, a transient property), the result could be an <UNDEFINED> error. Now %RemoveFromSaveSet() detects such cases and skips removing items that are not in the set of objects to save.

DP-412709: Prevent access violation with long strings in background job

Category: ObjectScript
Platforms: Windows
Version: 2022.1.2

This change corrects an issue in which a running routine that contains $listfromstring with very long string input in a background job could cause an access violation on Windows.

DP-415573: Corrects ODBC connections that use passwords

Category: ODBC
Platforms: All
Version: 2022.1.1

This change fixes a problem with ODBC connections that use passwords. The problem was that when you attempt to open a table linked to an InterSystems IRIS table would hang for long time, show errors, and display cells incorrectly. After this change, however, a call to SQLDriverConnect() will return the full connection string, including password.

DP-417170: Correct fastSelect with UNION query and literals in select list

Category: ODBC
Platforms: All
Version: 2022.1.2

This change corrects an issue where a SELECT query over xDBC that is a UNION query and the first leg of the UNION query has literal values in the SELECT list might return incorrect results.

DP-418276: Correct ODBC parser handling of ORDER BY within GROUP BY

Category: ODBC
Platforms: All
Version: 2022.1.2

This change corrects an issue using the ODBC driver to run queries that include an ORDER BY clause within a GROUP BY clause.

PLATFORMS-RH9: Add RH9 support

Category: Platforms
Platforms: UNIX®
Version: 2022.1.2

This release adds support for Red Hat 9.x for x86-64 or ARM64.

PLATFORMS-UBUNTU-2204: Add Ubuntu 22.04 support

Category: Platforms
Platforms: UNIX®
Version: 2022.1.1

This release adds support for Ubuntu 22.04.

DP-415663: Updates ^STU to no longer include code for System Alerting and Monitoring

Category: SAM - System Alerting and Monitoring
Platforms: All
Version: 2022.1.1

Updates ^STU to no longer include code for System Alerting and Monitoring, which is now built as an independent module.

DP-410314: Only create refresh tokens after scopes have been customized and accepted

Category: Security
Platforms: All
Version: 2022.1.2

This change fixes a bug where OAuth servers would issue refresh tokens to clients even when users explicitly denied the clients' request for a refresh token.

DP-411420: Remove pre-Apache 2.4 support

Category: Security
Platforms: All
Version: 2022.1.1

This change removes unsupported code, primarily pre-Apache v 2.4 support.

DP-412784: Return HTTP 400 when OAuth Token endpoint doesn't find client

Category: Security
Platforms: All
Version: 2022.1.2

With this change, the OAuth server code now properly checks that a client has been opened before trying to operate on said client. Before this change, in some cases, there were internal server errors instead of invalid client errors.

DP-412786: Set default value for subject_types_supported for InterSystems IRIS OAuth/OIDC servers

Category: Security
Platforms: All
Version: 2022.1.2

The OAuth server metadata property subject_types_supported, which is required for OAuth servers, was previously never set to a value. It is now set to "public".

DP-415141: Return status correctly in %SYS.Audit:Import()

Category: Security
Platforms: All
Version: 2022.1.1

This change fixes a bug in the Import() method of %SYS.Audit, where an error status code was not being returned for an error condition.

DP-416839: Reset SSL cache on failed connection to LDAP

Category: Security
Platforms: All
Version: 2022.1.2

This change fixes a bug in which it was possible to get an "UNKNOWN CA" error when logging in, when using LDAP to authenticate.

This change provides a new option the method %SYS.LDAP:SetOption. The option is described in the class reference.

For the example of "LDAP host names" parameter, to specify multiple host names, separate the names by spaces. If the LDAP server is configured to use a particular port, you can specify it by appending ":portname" to the host name; typical usage is not to specify a port and to let the LDAP functions use the default port, such as:

ldapserver.example.com
ldapserver.example.com ldapbackup.example.com

If you have multiple replicated domain servers on your network like

ldapserver.example.com
ldapserver1.example.com
ldapserver2.example.com
ldapserver3.example.com

You can specify the domain "example.com" as your host name. LDAP will perform a DNS query asking for the addresses of all the matching ldap servers, and then automatically select one to connect to.

DP-417677: Allow InterSystems IRIS to start when FIPSMode=1 in CPF file for RedHat 9

Category: Security
Platforms: RedHat 9
Version: 2022.1.2

This change allows InterSystems IRIS to start on RedHat 9 when FIPSMode=1 in the CPF file.

DP-418534: Set Content-Type header correctly in OAuth2.JWTServer

Category: Security
Platforms: All
Version: 2022.1.2

This change modifies OAuth2.JWTServer to set the Content-Type header in the OnPreHTTP() Method instead of in the OnPage() method. 

This change prevents a <PROTECT> error.

DP-415310: Pass %NOINDEX query hint to shards

Category: Sharding
Platforms: All
Version: 2022.1.2

This change fixes a problem in which the %NOINDEX query hint was not passed to shard-local queries, causing it to be ignored when executing sharded queries.

DP-416531: Don't set properties fields to "" for defaults when mapping globals

Category: Sharding
Platforms: All
Version: 2022.1.1

This change causes sharding logic, when setting up a properties array for a call to ##class(Config.MapGlobals), to not set any properties for which the default is intended, rather than setting such properties to "".

DP-416775: Fix shared lock leak in $system.Sharding.VerifyShards()

Category: Sharding
Platforms: All
Version: 2022.1.2

This change fixes a problem in which VerifyShards() could sporadically fail to release a shared lock on a shard's entry in the sharding metadata global.

DP-417495: VerifyShards: don't set master backup address when called recursively

Category: Sharding
Platforms: All
Version: 2022.1.2

This change fixes a problem in which VerifyShards failed with a <SUBSCRIPT> error, if called in a mirrored sharded cluster, in which the master node has no backup failover member.

DP-417989: Sharding only activate namespace once after series of mapping operations

Category: Sharding
Platforms: All
Version: 2022.1.2

This change fixes a problem in which, when a master namespace contains many user-defined mappings, it could take an unacceptably long time for sharding to propagate them to shards.

DP-418033: Disable sharding debug tracing in Backup.ShardedCluster methods

Category: Sharding
Platforms: All
Version: 2022.1.2

This change fixes a problem in which a sharded cluster could become hung in a quiesced state if the Quiesce, JournalCheckpoint, or ExternalFreeze methods of Backup.ShardedCluster were called while sharding debug tracing was enabled.

DP-408485+PLUS: Corrects bugs in the SQL 'EXPLAIN' feature

Category: SQL
Platforms: All
Version: 2022.1.2

This change refactors the SQL EXPLAIN feature in order to fix multiple bugs. The SQL EXPLAIN statement is now fully supported via the following interfaces:

• Embedded SQL [Both <select stmt: single row> and <select stmt: multi row> (e.g. DECLARE)]
• Dynamic SQL [e.g. %SQL.Statement class]
• SQL Shell [do $SYSTEM.SQL.Shell()]
• Management Portal [System Explorer -> SQL -> Query]
• JDBC

Our SQL *EXPLAIN* statement is best described via the following BNF:

<explain> ::= EXPLAIN [ <explain option list> ] [ INTO <host ref> ] <selct>
   -- <selct> denotes the SELECT Statement, which is the only valid query currently supported with <explain> 
<explain option list> ::= [ <alt option ] [ <stat option> ]
<alt option>  ::= ALT | ALL
<stat option> ::= STAT | STATS
                  -- The <stat option> and <alt option> can be specified in any order


<decl> ::= DECLARE <ident> CURSOR FOR <selct> [ FOR <updtcls> ]
         | DECLARE <ident> CURSOR FOR <explain> [ FOR <updtcls> ] 

// --- Returns the query plan as an XML string ---
EXPLAIN SELECT Name,DOB FROM Sample.Person where Name [ 'Q'
// --- Returns the query plan and performance stats (by module) as an XML string ---
EXPLAIN STAT SELECT Name,DOB FROM Sample.Person where Name [ 'Q'
// --- Returns the alternate query plans as an XML string ---
EXPLAIN ALT SELECT Name,DOB FROM Sample.Person where Name [ 'Q'
// --- Returns the alternate query plans and performance stats as an XML string ---
EXPLAIN ALT STAT SELECT Name,DOB FROM Sample.Person where Name [ 'Q'

• GetSQLPlan(sqlStr,showStats,planType,sqlPlan)
• RefactorSQLPlan(planRef) (Previously named:�CollectPlans(planRef) )
• Explain(sql,qualifiers,dynargs,plan)

DP-408910: Fix <NOLINE> in EXPLAIN in ShowPlan() and ShowPlanAlt()

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects a bug that could cause a _<NOLINE>_error when processing the EXPLAIN statement (with the STAT qualifier) during query compilation, when either of the following methods are invoked:

• do $SYSTEM.SQL.ShowPlan(...)
• do $SYSTEM.SQL.ShowPlanAlt(...)

DP-409827: Close loophole where SQL privileges could be dropped

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects an issue where a user at the terminal prompt could make a call to an API in %SYS.SQLSEC and if the correct arguments were passed in, could delete a user's SQL privileges.

DP-412636: Add MAP_SELECTABLITY column to Index information

Category: SQL
Platforms: All
Version: 2022.1.2

A map's usability by the SQL Query optimizer can be turned off using the $SYSTEM.SQL.Util.SetMapSelectability() API.  If a map's selectability is OFF, it is now easier to see that in the following locations:

• In the SQL section of the Management Portal, for a table's Maps/Indices, we now display Yes/No if the map is selectable by the SQL query optimizer. 
• In the INFORMATION_SCHEMA.INDEXES catalog table, there is a new column MAP_SELECTABILITY which will display where an index map is selectable by the SQL Query optimizer. 

DP-412869: Fix tune table to correctly mark outliers when outlier selectivity and sample size are both small

Category: SQL
Platforms: All
Version: 2022.1.2

With this change, tune table now correctly marks outliers when outlier selectivity and sample size are both small.

DP-412965: Support %SQL.Statement Prepare/ExecDirect without privilege checking

Category: SQL
Platforms: All
Version: 2022.1.1

When preparing dynamic SQL statements via %SQL.Statement, there is now an option to not perform privilege checking.

The %Prepare() method for %SQL.Statement now takes an optional second argument called checkPriv.  If checkPriv=0, SQL privileges are not checked on the statement.  The default value for checkPriv is 1.

For example:

USER>set stmt=##class(%SQL.Statement).%New()
USER>set sc=stmt.%Prepare("DELETE FROM T",0) // No privileges checked
USER>set stmt2=##class(%SQL.Statement).%New()
USER>set sc=stmt2.%Prepare("DELETE FROM T") // Privilege is checked

Note, the %ExecDirectNoPriv() method may not be called directly in application mode. If it is called directly in application mode, it will immediately return "" and the statement will not be executed.  An example of attempting to call this directly in application mode would be something like:

iris terminal MyInstance "##class(%SQL.Statement).%ExecDirectNoPriv(,\"truncate table T\")"

DP-413117: Disable block sampling for sparse disk data master map

Category: SQL
Platforms: All
Version: 2022.1.2

This change disables block sampling for tables with a sparse disk data master map, such as the tables using %Storage.SQL.

DP-413121: Tune table now correctly samples compound ID

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects an error in which uncached queries timed out in the management portal when they are first run but ran quickly after that initial failure. The extent size of the table was also calculated incorrectly. The error occurred in tables that had default storage and a compound IDKey.

DP-413511: Correct string concatenation in subqueries

Category: SQL
Platforms: All
Version: 2022.1.1

This change corrects an issue where string concatenation in a subquery was not working.

DP-413782: Return results in the correct selectmode for UNION %PARALLEL queries

Category: SQL
Platforms: All
Version: 2022.1.1

This change fixes a problem in which UNION %PARALLEL queries would only return results in logical mode.

DP-413800: Correct code generation for FIRST_VALUE(col)

Category: SQL
Platforms: All
Version: 2022.1.1

Before this change, the system generated incorrect code for the FIRST_VALUE function. Specifically, the code was inappropriate for string values.

DP-413802: Update SQL window function SUM to throw -37 error when used over a stream field

Category: SQL
Platforms: All
Version: 2022.1.1

This fix updates the SQL window function SUM to behave consistently with ordinary aggregates in the way that it handles streams.

DP-413867: Kill %ROWLIMIT's rowcount variable in close

Category: SQL
Platforms: All
Version: 2022.1.1

This change corrects a problem where a query that specified %ROWLIMIT was executed over xDBC and then executed a second time.  The first execution returns the correctly limited number of rows.  The second execution returned no rows.

DP-413934: Fixed a recursion problem that caused compilation errors for queries with FULL JOIN

Category: SQL
Platforms: All
Version: 2022.1.1

This change fixes a compliation error for specific queries. To get the error, the query must be a FULL JOIN, st have more than one condition in the ON, and must have an OR in the WHERE clause.

DP-413975: Throw -37 error for SQL window function that uses an unsupported aggregation over a stream field

Category: SQL
Platforms: All
Version: 2022.1.1

This change ensures that InterSystems IRIS throws an error when a query attempts to use an SQL window function with an unsupported aggregation over a stream field.

DP-414119: Do not hide Multivalue MVASSOCIATION properties

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects an issue in which collection fields with an MVASSOCIATION were erroneously marked as hidden and never output during a SELECT *. With this change, fields that have an MVASSOCIATION will not be marked as hidden and will still be output.

DP-414230: Fix class compile error related to RTPC

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects an error in runtime plan choice that could result in an error like the following when compiling a class that contains SQL:

ERROR #5475: Error compiling routine: ... 
#1020: Expected period : 'SQLrtpcv45=$g(18),SQLrtpcv46=$g(1)' : Offset:21 [%OnNew+8^%sqlcq.USER.cls1.1]

DP-414559: Correct parsing of USING clause's JSON when not specified in a literal constant

Category: SQL
Platforms: All
Version: 2022.1.1

This change fixes an issue in parsing the LOAD DATA statement that included a USING clause. The USING clause allows for a JSON object expression either as a JSON object \{...} or a string literal '\{...}'. Before this fix, an error occurred if you used a JSON object. With this fix, both forms are handled correctly.

DP-415465: Correct datatype mismatch error when using COALESCE

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects an error in which a query that used COALESCE could result in the following error message:

Datatype mismatch in arguments to 'COALESCE' function.  

DP-415661: Handle TO_NUMBER() correctly

Category: SQL
Platforms: All
Version: 2022.1.2

This query corrects an issue affecting queries that use TO_NUMBER(). Before this correction, such queries returned incorrect results, unless the query also included the %NOINDEX option.

DP-415788: Fix <SUBSCRIPT> error in sortedSample when building histogram

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects a <SUBSCRIPT> error in sortedSample when building histogram.

DP-416320: Fix query error 'MAXLEN parameter value must be a positive integer'

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects an error in which some queries would fail to compile. The error message was

ERROR #5554: MAXLEN parameter value must be a positive integer: ...

DP-416453: DDL: Correction for creating external language functions

Category: SQL
Platforms: All
Version: 2022.1.2

This change fixes an error that occurred when parsing CREATE FUNCTION with an EXTERNAL LANGUAGE of Python.

DP-416476: Correct query compilation error "too many arguments/subscripts"

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects an issue in which a query against a very large table might fail to compile with an error #1031: Too many arguments/subscripts.  This issue can happen if more than 1024 $list slots are specified for a single storage node, and the query selects fields that are 1024 or more storage slots apart.

DP-416479: Add XMLELEMENT, XMLATTRIBUTES and XMLFOREST support to the query regeneration logic

Category: SQL
Platforms: All
Version: 2022.1.2

This change adds support for XMLELEMENT, XMLATTRIBUTES, and XMLFOREST functions to the query reconstruction logic used by regular %PARALLEL processing (not Adaptive Parallel Processing).

DP-416552: Avoid <DIVIDE> error in queries that use RTPC

Category: SQL
Platforms: All
Version: 2022.1.2

This change avoids a <DIVIDE> error in queries that contain a NOT condition that referred to a property with selectivity equal to 1. It was possible to execute such queries only by using the %NORUNTIME hint. With this change, it is not necessary to use the %NORUNTIME hint to avoid the error.

DP-416681: Add privilege checking to %SYSTEM.java.SQL and %SYSTEM.python.SQL class methods

Category: SQL
Platforms: All
Version: 2022.1.2

With this change, the following class methods require the %Admin_ExternalLanguageServerEdit resource in order to execute:

• %SYSTEM.java.SQL.addPath()
• %SYSTEM.java.SQL.closeGateway()
• %SYSTEM.python.SQL.addPath()
• %SYSTEM.python.SQL.closeGateway()

This means %Admin_ExternalLanguageServerEdit is also required to call the following stored procedures:

• %SYSTEM_java.add_Path(...)
• %SYSTEM_java.close_Gateway()
• %SYSTEM_python.add_Path(...)
• %SYSTEM_python.close_Gateway()

DP-416691: Change HOUR function back to taking first piece of $zt output

Category: SQL
Platforms: All
Version: 2022.1.2

The HOUR function takes some time value and outputs only the hour portion of that time value. For logical %Date/$HOROLOG time values, we convert the time portion of the logical value to HH:MM:SS format with $ZTIME. A previous update that added proper validation of the time input (to allow error throwing in the case of invalid input) accidentally changed the output from %Date/$HOROLOG input values to take the second piece of the $ZTIME output, when the first piece should be taken.

DP-416723: Correct Tune Table behavior when extent size = 0

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects an error in which when you ran tune table on a table that had no records (such as a table on a development system), that affected the storage definition. Now auto-tune should never update storage if the table is empty.

DP-416803: Store RTPC information in opaque structure to prevent query compilation error

Category: SQL
Platforms: All
Version: 2022.1.2

This change codifies how InterSystems IRIS stores RTPC information (such as outliers, truth values, range conditions, and list length conditions). Before this change, depending on the stored data, it was possible to have errors like the following when compiling queries.

ERROR #5475: Error compiling routine: ...
#1019: Expected colon : 'SQLrtpcrtexpr1=$S(OTHERSTUFF"="' : Offset:35 [%OnNew+6^%sqlcq.USER.cls1.1]

DP-416924: Correct query with HAVING or ORDER BY with implicit join

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects an error in which a query could return duplicate records if the query included a HAVING clause or included an ORDER BY clause that contained an implicit join.

DP-416962: %PARALLEL: Move RTPC detection to later phase in processing

Category: SQL
Platforms: All
Version: 2022.1.2

With this change, we detect RTPC conditions at a later phase in processing when all required information is available. Before this change, with queries that use %PARALLEL, it was possible to receive errors like the following:

[SQLCODE: <-400>:<Fatal error occurred>]
[%msg: <Cannot apply partition range compiling embedded cached query ...

DP-417080: Correct type returned for TO_NUMBER() scalar function

Category: SQL
Platforms: All
Version: 2022.1.2

A problem has been corrected where the type reported by a TO_NUMBER(...) function was not a numeric type.

TO_NUMBER(_val_) will now return the following type:

 
VARCHAR, VARBINARY, TIME --> NUMERIC
BIT -> TINYINT
DATE ->INTEGER
TIMESTAMP, POSIXTIME -> BIGINT
all others -> type of val

DP-417267: RTPC: Add normalization on literal and host variable input values

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects an issue in which SQL comparison of numeric strings with a leading zero had unexpected results.

DP-417280: Correct %ValidateIndices utility for tables with row-level security

Category: SQL
Platforms: All
Version: 2022.1.2

This correction fixes the %ValidateIndices utility method for classes that use row-level security.  The general flaw in the utility is that an index was traversed and when an index value was found that belonged to a row the user did not have privileges to read, the utility thought the row did not exist.  If the utility was called with pFix=1, the utility would then delete the row.

%ValidateIndices has been updated to allow the utility to validate all rows in the table regardless if the caller has the privilege to read all rows from the table or not.  If the class/table uses row-level security, the display of any issues found will obscure the error messages so that no data in the table is displayed to the caller of %ValidateIndices.

DP-417432: Correct <SUBSCRIPT> error for parallel query on table with %SPACE collation

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects a <SUBSCRIPT> error that occurred when running a parallel query on a table with %SPACE collation.

DP-417498: Fix collation of scalar subqueries

Category: SQL
Platforms: All
Version: 2022.1.2

This change fixes the collation of scalar subqueries during view recursion.

Before this change, it was possible to have different query plans for equivalent queries that differ only in trivial ways.

DP-417933: Fix max length, precision, and scale metadata for window functions

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects the metadata that is generated for queries using window functions.

DP-418002: Correct issue with NOT IN

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects a regression in query performance related to queries using the NOT IN clause. In some cases, a <DIVIDE> error was also possible.

DP-418072: Fix block sampling when DataLocation global includes one or more leading subscripts

Category: SQL
Platforms: All
Version: 2022.1.2

For block sampling for tune table, before this fix, it was possible to get a <DIVIDE> error if the DataLocation global includes one or more leading subscripts. This error has been corrected.

DP-418154: SQL DDL: Correct missing variable NEW in CreateMethod^%apiDDL

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects an error that caused an <UNDEFINED> error when exporting a class created via DDL.

DP-418158: Disable auto-parallel if query contains constant and mode is %Runtime/%FDBMS

Category: SQL
Platforms: All
Version: 2022.1.2

This change disables the auto-parallel mode for a query that contains a constant and that is run in either the %Runtime or %FDBMS mode. Such queries, when run in parallel, did not return expected results.

DP-418248: Improve performance of queries with outer-join conditions involving multiple view tables

Category: SQL
Platforms: All
Version: 2022.1.2

This change improves the performance of queries with outer-join conditions involving multiple view tables.

DP-418360: Make log file writeable in WriteToLogFile()

Category: SQL
Platforms: All
Version: 2022.1.2

This change ensures that if you run tune table with a log file specified, the log file is writeable and is generated correctly.

DP-418404: Improve error handling in TT

Category: SQL
Platforms: All
Version: 2022.1.2

This change improve error handling in tune table and prevents a <DIVIDE> error.

DP-418419: Correct <SUBSCRIPT> error when creating view definition using arrow syntax

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects an issue seen when creating a view definition where the query uses -> syntax.  The symptom was a <SUBSCRIPT> error when parsing the query.

DP-418470: RTPC/xDBC Cached query lock leak correction

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects an error in CreateNewRunTimeQuery^%SYS.SQLRTUMAKER in which the code acquired an exclusive lock and returned without unlocking.

DP-418476: DDL: Create temporary tables in process-private globals

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects an issue in which queries like

CREATE GLOBAL TEMPORARY TABLE table ... AS SELECT ..

DP-418751: Handle system with 'GlobalKillEnabled=0' in resource cleanup

Category: SQL
Platforms: All
Version: 2022.1.2

Before this change, the resource cleanup logic that we run periodically to remove globals/semaphores/events could get a <PROTECT> error if the system has 'GlobalKillEnabled=0' in the configuration. Now, the resource cleanup logic is able to successfully work in all cases.

DP-418975: Fix errors running tune table while purging cached queries in the background

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects an issue that occurred when running tune table while purging cached queries in the background. The issue caused errors like the following:

ERROR #5521: SQLError: SQLCODE=-400 %msg=Fatal error occurred::
There are 1 errors in routine %sqlcq.USER.1
...
ERROR #5521: SQLError: SQLCODE=-400 %msg=Fatal error occurred::
Error executing code for 
Getting sample of rows from data blocks ...

DP-418978: Add lock to prevent RTPC xDBC runtime cached queries from getting purged

Category: SQL
Platforms: All
Version: 2022.1.2

This change corrects an issue that occurred when running some RTPC queries via ODBC while purging cached queries in the background. The issue resulted in errors like the following:

LogMessage: SQLState: (HY000) NativeError: [478] Message: [Iris ODBC][State : HY000][Native Code 478] 
[d:\iris223\bin\IRISDB.EXE] 
Query recompiled: Result Set mismatch 

ERROR #6022: Gateway failed: Execute.  SQLState: (HY000) NativeError: [400] Message: [Iris ODBC][State : HY000][Native Code 400]
[SQLCODE: <-400>:<Fatal error occurred>]
[Error: <<LIST>decomposeStatus+23^%occSystem>]
[Location: <ServerLoop>]

ERROR #6022: Gateway failed: Execute.  SQLState: (HY000) NativeError: [400] Message: [Iris ODBC][State : HY000][Native Code 400]
[SQLCODE: <-400>:<Fatal error occurred>]
[Location: <ServerLoop>]
[%msg: <Process 19388 failed to compile Cached Query Class %sqlcq.USER.HUZh7INt1mZ.cls3 with these errors: 
 

DP-419115: Correct error in NULLIF

Category: SQL
Platforms: All
Version: 2022.1.2

After this change, NULLIF will always explicitly compare the first argument with the second argument.

DP-418450: Correct <UNDEFINED> on xDBC query prepare for table with functional index

Category: SQL Search
Platforms: All
Version: 2022.1.2

This change corrects an issue that caused an <UNDEFINED> error during the Prepare step for a SELECT statement of the form:

select * from khoj.Relationship where %ID %FIND search_index("relationiFind", 'SUC') 

DP-414251: Fix Integrity Check selected global list when number of jobs is 1

Category: System
Platforms: All
Version: 2022.1.1

This change corrects a problem introduced in 2022.1.0 with integrity check when performed using $$CheckList^Integrity, the management portal, or the integrity check task.  If the check was specified to use a list of selected globals AND to be performed in just a single job, it would incorrectly include many other globals from the same database. This is corrected.

DP-414797: Allow [Gateways] section to be removed from CPF file

Category: System
Platforms: All
Version: 2022.1.1

This change makes [Gateways] an optional section of the CPF file, simplifying the upgrade code.

DP-416744: Fix incorrect resource name in irisstat, SYS.Stats.Resource, etc.

Category: System
Platforms: All
Version: 2022.1.1

Starting in 2021.2, irisstat, the SYS.Stat.Resource class, and similar functionality that display the system resource statistics by name had a missing entry in the table of names that caused the resource names to be shifted by one.   The numbers are correct and the names are correct through "ECP_S_TRANS", which includes all of the singular/static resources, like the "Globals" resource.   The name of the "OCSP" resource mistakenly had the next name concatenated to it, after which all of the following names were shifted, with resource number n mistakenly associated with the name of resource number n+1.

DP-416836: Fix quoting of Windows commands issued via $ZF in ^SystemCheck

Category: System
Platforms: All
Version: 2022.1.1

An issue has been resolved in which all \^SystemCheck reports produced on Windows systems would not contain any of the following data:

• Operating System Version
• Extended System Information
• Key File
• First and second runs of TASKLIST -V
• First and second irisstat snapshots
• ipconfig /all
• netstat -ano
• netstat -s
• Bin Directory
• Dump files in Manager's Directory

This issue was present in InterSystems IRIS 2021.1.1.

DP-418519: Correct CPF [Gateway] .NET line when no resource specified

Category: System
Platforms: All
Version: 2022.1.2

This change corrects how the CPF file is updated when you create a .NET external language server with an empty resource.

DP-418812: Mount databases for directio on Unix when wdwrite_asyncio_max is non-zero

Category: System
Platforms: UNIX®
Version: 2022.1.2

This change fixes a bug where a database which had been dismounted and remounted would not have direct I/O enabled on a system where the write daemon is using async I/O (the default configuration).

DP-417474: Allow task to be scheduled by user without permissions on the task namespace

Category: Task Manager
Platforms: All
Version: 2022.1.2

This change corrects a regression within the permission checks for scheduling tasks. With this change, in order to create a task, the user needs READ access on the task class, as well as access to the namespace where the task will run, and the permissions required by any other operations performed by the class. Note that a user needs %Admin_Secure to configure a task to run as a user other than themself.

DP-417244: Add check for EndDate="" to ImportTasks method.

Category: Tasks
Platforms: All
Version: 2022.1.2

This change modifies ImportTasks() to prevent importing a Task that has EndDate="" (i.e., no EndDate).

DP-414563: Correct IIS-only regression processing chunked requests

Category: Web Gateway
Platforms: All
Version: 2022.1.2

This dechange fixes an IIS-specific regression for chunked POST requests. The regression caused the Web Gateway to report Request Entity Too Large and refuse to pass the request through. Now, it processes the request and sends it to the InterSystems IRIS server, as it did before.

DP-409294: Do not add messages.log entry for expected external interrupt error

Category: Work Queue Manager
Platforms: All
Version: 2022.1.2

With this change, the Work Queue Manager no longer adds entries to messages.log for expected interrupt messages.

DP-414171: Avoid <MAXSTRING> when truncating output

Category: Work Queue Manager
Platforms: All
Version: 2022.1.2

Before this change, if a Work Queue Manager task produced very long output of around 3.5Mb and also returned a long %Status code return value, it was possible to get a <MAXSTRING> error when serializing this data.

With this change, we explicitly take into account the length of the %Status code and leave sufficient space for this to avoid getting <MAXSTRING> errors.

DP-414360: Removes duplicate "1" value in Work Queue Manager Category dropdowns

Category: Work Queue Manager
Platforms: All
Version: 2022.1.1

Before this change, the Work Queue Manager Category could include duplicate "1" values.

DP-414996: Truncate output if there are 16-bit wide chars

Category: Work Queue Manager
Platforms: All
Version: 2022.1.2

This change truncate Work Queue Manager output if there are 16-bit wide chars. This change avoids <MAXSTRING> error on big output.

DP-415039: Do not report DISCONNECT errors in WQM as alerts

Category: Work Queue Manager
Platforms: All
Version: 2022.1.2

Before this fix, if the work queue manager got an async DISCONNECT error during some parts of processing, it would log these as errors to messages.log file when they are to be ignored. Now we detect and ignore these errors.

DP-415819: Fix <UNDEFINED> error in Work Queue Manager code

Category: Work Queue Manager
Platforms: All
Version: 2022.1.2

This change fixes an undefined error in WaitForComplete^%SYS.WorkQueueMgr. Before this fix, if a work queue was deleted, checking ##class(%SYSTEM.Event).Count() threw an <UNDEFINED> error.

DP-418608: Correct hang when running RTPC xDBC Cached Queries

Category: xDBC
Platforms: All
Version: 2022.1.2

This change corrects an issue has been corrected where a SELECT query executed over xDBC that uses RTPC might hang the client/server connection if one or more of the tables/views used by the query is from an ECP client and the class was recompiled on the remote server.

DP-409007: Add Feature Tracker information to xDBC clients

Category: xDBC Server
Platforms: All
Version: 2022.1.1

This change expands the information provided by xDBC clients to the Feature Tracker.

DP-413884: Correct NullPointerException in Zen Report RenderServer

Category: Zen Reports
Platforms: All
Version: 2022.1.1

The Zen Report RenderServer code failed to initialize a field in a class, which resulted in a NullPointerException when the render server attempted to read the request from the server. Then, because the communication with the render server would fail, the server rendered the report directly, which was very slow.

This change removes the NullPointerException bug.