January Update

January Update Release Notes

Bug Fixes and Security Updates.

v1.0.9

GA (1.0.9) Release Notes

Azure IoT Operations and Azure Device Registry: Now Generally Available

Azure IoT Operations enables customers to collect edge data, process it, and transfer it to the cloud. Following the adaptive cloud approach, all controls for data collection, processing, and transfer are managed through configuration interfaces located alongside the customer's cloud service interfaces. Once configured, Azure IoT Operations sends processed data to cloud data services like Microsoft Fabric, making it accessible in the common data lake that supports the company's data estate. Learn more

To support Azure IoT Operations, Azure Device Registry is an integral product offering that enables asset management.

v0.8.32

v0.8.32 Release Notes

MQTT Broker

• New Features
  • Added feature to help prevent inadvertent service name conflicts which lets you leave a BrokerListener's serviceName as null, and the service name will automatically be set to match the name of the BrokerListener instead of a static value.
  • Add support for version upgrades.
• Fixes
  • Fixed issue where updating a broker listener doesn't work.
  • Fixed issue where generating resource requests like CPU limit wasn't working properly.
• General
  • Added support for Kubernetes admission webhook to help avoid inadvertent misconfiguration.

Dataflows

• New Features
  • Added support for version upgrades.
• Fixes
  • Fixed issue where you can't use anonymous authentication for MQTT and Kafka endpoints when deploying dataflow endpoints via the portal.
  • Fixed issue where it was possible to set empty values for dataSource and dataDestinations which led to crashes.
  • Fixed issue where client ID prefix wasn't working.
  • Fixed issue where MQTT messages were limited to 10KB in size as opposed to the correct 256MB.
  • Fixed issue where updating a dataflow with new source MQTT topics didn't work properly.
  • Fixed issue where scaling up or down a dataflow profile via instance count resulted in unexpected message loss or duplication.
• General
  • Added support for Kubernetes admission webhook to help avoid inadvertent misconfiguration.

Unified AIO Arc Extension

• Breaking Changes
  • The AIO instance resource has a breaking change in this release from the last release. Specifically, the schema registry parameter has changed in the AIO RP version 2024-09-15-preview from schemaRegistryNamespace to schemaRegistryRef { resourceID: <yourSchemaRegistryResourceId>}.
• New Features
  • Upgrade: AIO can be upgraded in place from the previous version (0.7.x) to this version (0.8.x) using the AIO CLI.
• Fixes/General
  • Implemented various bug fixes to enhance stability and performance.

Akri

• Fixes
  • Metrics TLS and fixes
  • Security fixes and updated dependencies
• General
  • Automatic asset discovery is NOT being deprecated - it will return with a new and improved version in the next refresh.
  • Note: You will still see Akri deployed on your cluster as a part of Azure IoT Operations.

Azure Portal

• New Features
  • Upgrade AIO: Upgrade to the latest version without the need for redeployment.
  • Dataflow list: Read-only views.
  • Instance Overview: Display metrics of instance resources for better monitoring.
  • Cluster type selection: Choose between single node and multi-node configurations with recommended settings.
• Fixes/General
  • Implemented various bug fixes to enhance stability, performance, and user experience.

Azure IoT Operations Experience

• New Features
  • Instance overview: View details of an IoT Operations instance.
  • New data transform operations: Rename datapoints in and/or add new properties to a dataflow.
  • New storage-based dataflow endpoints: Connect dataflows to storage-based endpoints, including Azure Data Explorer, Azure Data Lake Storage (2nd generation) and local storage.
• Fixes/General
  • Various bug fixes and performance improvements

ADR and Schema Registry

• New Features
  • Outbound proxy support
    • Improved reliability and resiliency
    • Security improvements
    • Arc Gateway support

Azure IoT Operations CLI

• New Features
  • Support a new command upgrade to perform in-place upgrade from M2 builds
  • Ability to inject certificate when creating Asset endpoint profile with OPC UA
• General
  • Schema registry parameter changes from the last release. (Schema registry ID param --sr-resource-id now part of create)

v0.7.31

v0.7.31 Release Notes

OPC UA Connector

• New Features
  • Schema registry
  • Support for Cloud Events

MQTT Broker

• Breaking Changes
  • BrokerAuthentication configuration syntax updated.
  • Added "settings" suffix to each method configuration object name.
  • x509Credentials renamed to x509Settings.
• New Features
  • Support for configuration via Azure portal.
• Fixes
  • Fixed issue preventing BrokerAuthentication deployment via ARM.
  • Fixed bugs in BrokerListener configuration preventing certain advanced cert-manager properties.
• General
  • New default service name: aio-broker.
  • New pod names: aio-broker-frontend-0 and aio-broker-backend-0.
  • New default broker listener port: 18883 for AIO internal communication to vacate common user ports 1883 and 8883, avoiding conflicts or misconfiguration.
  • New Kubernetes service account audience: aio-internal for default broker authentication, used by other AIO components.
  • Performance improvements.

Dataflows

• Breaking Changes
  • CRD and ARM API; fields renamed
• Integration
  • Schema registry for reserialization and transformation.
• New Features
  • Configuration via IoT Operations Experience portal.
  • Sending data to Fabric OneLake, ADLSv2, and Azure Data Explorer.
  • Use MQTT message properties in map transformations.
  • Get last-known-value in transformations.
  • Compatibility with Cloud Events attributes.
  • Auto-determine system-assigned managed identity audience.
  • Use user-assigned managed identity with dataflow endpoints via workload identity federation.
• Default Settings
  • Auto-generated DataflowEndpoint (named default) with each AIO deployment.
  • Default DataflowProfile renamed to default.
• Fixes
  • Deploying dataflows via ARM.
  • Clarified supported authentication methods for each endpoint type.
  • Authentication configuration moved inside endpoint-type-specific settings (e.g. mqttSettings).
  • Scaling up instance count beyond 1.
  • Default values for MQTT endpoint types to built-in MQTT broker.
• General
  • Performance improvements.

Akri

• Breaking Changes
  • Removed Akri agent and UDF discovery support where Akri instance akrii CRs are created for discovered OPC UA assets.
  • Discovered Asset and Discovered Asset Endpoint Profile using mPRC (the end-to-end flow is not yet supported).
• General
  • Automatic asset discovery is NOT being deprecated - it will return with a new and improved version in the next refresh.
  • Note: You will still see Akri deployed on your cluster as a part of Azure IoT Operations.

Unified AIO Arc Extension

• New Feature
  • Ability to upgrade has been implemented in this release - Customers will be able to upgrade to the next version of the AIO arc extension without needing to redeploy everything.
  • Integration of Cert manager and Trust Manager for setting up secure communications internally among pods and between pods and external endpoints.

Azure Portal

• New Features
  • AIO Install/Deployment based on customer need.
    • "Test Setting": Simpler deployment for testing purposes.
    • "Secure Setting": Deployment for production use cases, includes support for User Assigned Managed Identity and Secret management.
  • Ability to select an existing schema registry or create a new one from the AIO Install wizard.
  • Optional dependencies deployment
    • MQTT: listeners, authentication and authorization
• Breaking Changes
  • CLI command changes in portal automation screen for Edge Storage Accelerator (ESA), Schema registry, Workload identity federation, and az iot ops init vs create.

Azure IoT Operations Experience

• New Features
  • Dataflows - A dataflow can subscribe to an MQTT topic and forward the messages to an event hub in your Azure Event Hubs namespace.
  • Integrate with Schema Registry RP and use Schema Registry ARG.
  • Dataflow Endpoints - A dataflow endpoint is the connection point for the dataflow.
  • Dataflow Endpoints – access token AKV and Azure Secret Store integration.
• Breaking Changes
  • Asset endpoint profile – username/password AKV and Azure Secret Store integration.

ADR and Schema Registry

• New Features
  • Schema Registry
    • Synchronization of message schemas between cloud and edge.
    • Ability for OPC UA Connector to store message schemas in Schema Registry.
    • Ability for Dataflows to consume message schemas in dataflows.
    • Ability for upload user-generated message schemas in Operations Experience.
    • Ability to author Dataflows with schemas in Operations experience.
  • Asset and Asset Endpoint Profile
    • Added reference to message schemas.
    • Ability to define dataset.
    • Add ability to set MQTT topic and retain flag on a per asset, and per dataset basis.
• Breaking changes
  • Changes to Asset + Asset Endpoint Profile ARM & CR field names and structure.

Azure IoT Operations CLI

• New Features
  • Deployment of Azure IoT Operations are now broken into two phases:
    • Deploy AIO dependencies via init
    • Creation of AIO instance via create
  • Updated delete to delete AIO instances by default created by create, append --include-deps flag to undo init.
  • Added identity command group for general management of workload identity.
  • Added secretsync command group for secret sync configurations of Azure IoT Operations instance.
  • Added data flow to check command.

Identity

• New Features
  • Support of User Assigned Managed Identity for northbound connections.

Secret Management

• New Features
  • Ability to automatically sync secrets from Azure Key Vault down to edge using Operations Studio.
  • Ability to use secrets for southbound and northbound connections.
  • Ability to delete synced secrets from edge.
  • Ability to add new synced secrets to edge.

Validated Environments

• This release has been validated on the latest September update of AKS Edge Essentials (version 1.8.202.0).

v0.6.0-preview

Release Notes

OPC UA Broker

• Bug fixes and security improvements
• Reduced memory load by optimizing logging by OPC UA Stack
• Reduced memory consumption during DTDL generation

MQ

Broker CR Updates

• Removed Diagnostic service CR, and consolidated all Diagnostic settings in the Diagnostic section.
• Created a new "advanced" settings section with new settings for MQTT subscriptions, internal traffic encryption, and node tolerations.
• Removed temporary resource limits section, and moved some of those settings to the "advanced" settings section.
• Container image fields are no longer mandatory.

BrokerListener CR Redesign

• Now supports multiple ports per listener, functioning similarly to a Kubernetes service.

Authentication Changes

• BrokerAuthentication CR now allows direct inline specification of X.509 attributes, eliminating the need for a TOML file.
• Discontinued username/password authentication.
• Immediately disconnect clients with expired credentials.

Authorization Updates

• Revised BrokerAuthorization CR syntax for State store authorization configuration.
• Removed support for AKV CSI driver extension.

Dataflows

• New component that replaces the previous cloud connector with additional data processing features.
• Transformations can be applied within dataflow to process the message payload, with capabilities including compute new properties, rename properties, remove properties, convert units, standardize values, and contextualize data.
• Configurable via custom resource YAML files.
• Endpoints supported: MQ (MQTT broker), Azure Events Grid, Azure Events Hub, Fabric Real-time. Note: support for sending data to ADX, ADLSv2, and Fabric OneLake are not available in this release. Support for these endpoints will be added back in an upcoming preview release.

Unified AIO Arc Extension

• Introduced a new Azure resource type called "instance" that represents the bundle of Azure IoT Operations services that are installed in the cluster.
• Introduced a single AIO arc extension in lieu of separate service arc extensions for each AIO component. This arc extension installs a unified controller that is responsible for monitoring and acting on the Azure IoT Operations instance custom resource.

Azure IoT Operations Experience

• Activity Logs are available to view at the instance level or for a specific asset, asset endpoint, or data pipeline.

Azure IoT Operations CLI

• Detailed release notes, describing features, fixes, and improvements are available in the Azure IoT Operations CLI Extension Releases.

Validated Environments

• This release has been validated on the latest AKS-EE release version 1.7.639.0 and K3s 1.28.3. View AKS-Edge releases here: AKS-Edge Releases.

Known Issues

Detailed list of known issues are available in the Azure IoT Operations public documentation

v0.5.1-preview

This release makes Data Processor an optional component. By default, the az iot ops init command doesn't deploy the Data Processor component. To deploy Data Processor, add the --include-dp argument.

v0.5.0-preview

Release notes

MQ:

• Added support for MQTT over Websockets
• Bug fixes and stability improvements

Cloud connector:

• Added support for sending to Azure Data Explorer

OPC-UA Broker, Data Processor and AKRI:

• Bug fixes and stability improvements

Azure IoT Operations Portal:

• Streamlined navigation experience to specific sites and across multiple sites

• Improvements to maintain context through long running operations

Azure IoT Operations CLI:

• Detailed release notes, describing features, fixes and improvements are available in the CLI github repo.

v0.4.0-preview

Release notes

This update implements logging and transmission functionalities for non-personal logs, facilitating proactive health investigations.

Data Processor:

• Dependency on NFS has been removed, users no longer need to install NFS on their host machines before deployment.
• Support for Managed Identity based authentication has been added to MySQL source and Fabric Lakehouse, Azure data explorer destination.
• Ability to read from Influx DB.
• Ability to write to an HTTP endpoint as a destination.
• Ability to write to Azure Blob Storage.
• Ability to configure retries within pipeline.

OPC UA Broker:

• The intermittent token expiration issue has been fixed.
• ARC extension has been added.
• Support for enterprise grade certificate management.
• Topic structure for telemetry has changed. Telemetry of an Asset is now published in topic "azure-iot-operations/data/<Asset name>

Digital Operations Experience:

• Support for Asset Metadata/custom properties.
• The intermittent token expiration issue has been fixed.
• Internationalization support: Users can customize UI with their language preference

Validated Environments

• This release has been validated on latest AKS-EE release version AksEdge-K3s-1.26.10-1.6.384.0

v0.3.0-preview

Release Notes

AIO Arc Extension:

• Support for outbound proxy has been added to Azure IoT Operations arc extension.

Data Processor:

• Support for outbound proxy has been added to Data processor arc extension.

Azure CLI:

• Added deployment pre-checks to reduce deployment failures.

Digital Operations Experience:

• UX improvements
• Logs and metrics improvements
• Support of different AIO Extension versions

v0.2.0-preview

Release Notes

Data Processor:

• Service account token expiration causing data communication loss between MQ and data processor has been fixed.

MQ

• The issue of service account token expiration, which caused a loss of connection between IoT MQ and other pods, has been resolved.
• These observability metrics are now available:
  • aio_mq_backend_replicas
  • aio_mq_backend_replicas_current
  • aio_mq_frontend_replicas
  • aio_mq_frontend_replicas_current

OPC-UA Broker

• Akri OPC UA asset discovery now works on the first run after AIO deployment.
• Deletion and modification of assets in the Digital Operations Experience portal works as expected.
• Telemetry encoding does not switch to gzip occasionally.