OneCompute Platform - User Guide

# OneCompute Release Notes

# Known issues

# Release history

# Version 9.3 - April 18, 2024

Version 9.3 release of OneCompute focused on improving portal performance, KubeIT backend improvements, and minor bug fixes.

# Enhancements

  • Don't include "Content-Security-Policy" response header for our CSS file, for performance reasons
  • Push DNVGL.One.Compute.SignalR package to NuGet.org
  • Monthly NuGet updates April 2024
  • Handle "Low" sev. SAST flaw (in portal): CWE-209: Generation of Error Message Containing Sensitive Information

# Bug fixes

  • Google translation has console error and failed, due to CSP (content security policy) restrictions
  • WorkItems with the same ID cannot be run on the KubeIT backend
  • Work items cannot run on KubeIT if the ID is too long or contains invalid characters
  • Test environment's "Job" endpoint throws exception for all users
  • Portal's "Jobs" doesn't properly enumerate data, with bad performance as a result

# NuGet/Python package release?

  • Yes

# Version 9.2(.1) - March 21, 2024

Version 9.2 release of OneCompute focused on improving portal performance, as well as minor Python usability improvements, and minor bug fixes.

# Enhancements

  • In the portal's "Accounting" view, reduce the default date range from one year to one month, to increase performance
  • Improve performance for portal's job deletion, as it currently is prone to timeouts when deleting many jobs at a time
  • Separate portal's "Accounting" view in two, to enable not requiring MFA for external users
  • [Python] Enhance File Service with Progress Reporting, Concurrent File Transfer, and MD5 Check
  • [Python] Enable concurrent service runs with enhanced logging
  • Update Python dependency packages versions, incl. to handle some reported security vulnerabilities
  • Resuscitate the "UserAuthViaIntermediateAPI" example projects, by running on recent .NET and use latest authentication endpoint
  • Monthly NuGet updates March 2024
  • Handle "High" sev. SCA vuln. in "System.Private.Uri" (transitive) NuGet dep. (4.3.0) - take 2
  • Add "Microsoft.Identity.Client" Nuget pck ref to "Platform.Client" as well, to offer more consistent OC NuGet pcks

# Bug fixes

  • Job scheduling doesn't dispose of the "BatchClient" instance - possibly causing resource locking?
  • The end user documentation page is not found after migrating to KubeIT
  • The developer documentation page is not found after migrating to KubeIT - Part 1 (make it work short term by adjusting the URL)
  • "My Jobs" can not render data (gives timeout) when the user has many jobs
  • Runtime error from Web Application Firewall when trying to submit too large jobs?
  • [Python] Enhance delete_dir method to handle deletion of more than 256 blobs
  • Local client GetWorkItemProperties return wrong data

# NuGet/Python package release?

  • Yes

# Version 9.1(.1) - February 22, 2024

Version 9.1 release of OneCompute focused on removing support for creating old pool types in the portal, as well as minor Python and portal usability improvements, and minor bug fixes.

# Enhancements

  • In the portal's pool details view, change the applications grid display size from 5 to 7 rows, for readability
  • Improve portal's audit log user experience by sorting descendingly rather than ascendingly on the timestamp, as well as allowing search in the "Information" column
  • [Python SDK] Refactor temp directory creation for enhanced flexibility and isolation
  • [Python SDK] Introduce exception handling for starting already running processes
  • Python: Upgrade OneCompute Python to ensure compatibility with Python version 3.12
  • Support in-place local execution
  • Remove the ability to create Windows Cloud Service pools after February 2024
  • Monthly NuGet updates February 2024
  • Quarterly JavaScript/CSS updates Q1 2024
  • Handle "High" sev. SCA vuln. in "System.Data.Common" NuGet dep. (4.3.0)
  • Separate Plant and ROS pools, applications and users in different environments

# Bug fixes

  • Kubernetes jobs don't run when submitted by North Europe users
  • Downgrade .NET Standard 2.1 to 2.0 in Core in order not to break .NET Framework support in clients
  • Job progress in the portal shouldn't be rounded up to 100% when the job is not completed yet
  • Azure Batch pool environment variable naming issue on Linux with BatchApplicationEnvironment class
  • Python: ERROR: Authentication failed
  • IApplicationEnvironment is not found when using UniversalWorkerHost with Azure Batch

# NuGet/Python package release?

  • Yes

# Version 9.0.2 - February 19, 2024

Version 9.0.2 hotfix release of OneCompute focused on stability improvements to the job scheduling.

# Enhancements

  • Jobs are occasionally not completed by the job scheduler

# NuGet/Python package release?

  • No

# Version 9.0.1 - February 12, 2024

Version 9.0.1 hotfix release of OneCompute focused on logging improvements to the job scheduling.

# Enhancements

  • Extend job scheduling task monitoring logging with job ID for failed task listing

# NuGet/Python package release?

  • No

# Version 9.0.1 (NuGet only) - January 22, 2024

Version 9.0.1 (NuGet only) hotfix release of OneCompute focused on fixing security vulnerabilities in third-party libraries.

# Enhancements

  • Affects "DNVGL.One.Compute.StorageLibrary.SQLite" (typically local worker host execution):
    • Handle "High" sev. SCA vuln. in "System.Data.SqlClient" NuGet dep. (4.8.5)
  • Affects "DNVGL.One.Compute.Platform.Client.Extensions" (typically Platform client in auto-refresh access token mode):
    • Handle "Medium" sev. SCA vuln. in "Microsoft.IdentityModel.Protocols.OpenIdConnect" NuGet dep. (7.0.3) and "System.IdentityModel.Tokens.Jwt" (transitive) NuGet dep. (7.0.3)

# NuGet/Python package release?

  • Yes

# Version 9.0 - January 18, 2024

Version 9.0 release of OneCompute focused on upgrading worker hosts to support .NET 8 (instead of 7), and minor bug fixes.

# Enhancements

  • Deprecate .NET Framework 4.6.2 support for the worker hosts
  • Replace .NET 7.0 support with .NET 8.0 for the worker hosts
  • Update Platform to .NET 8
  • Monthly NuGet updates January 2024

# Bug fixes

  • FileLogger is not thread safe
  • Fix invalid bookmark links in doc

# NuGet/Python package release?

  • Yes

# Version 8.5(.2) - December 21, 2023

Version 8.5 release of OneCompute focused on removing the East US-based environments (to cut cost, as they are no longer being used by any active users), continued KubeIT migration, and minor bug fixes.

# Enhancements

  • Remove EastUS and EastUS2 environments
  • Python: Securely cache login tokens in the Python client
  • Python: Preserve temporary directories for further analysis or insights
  • Migrate Develop environment to KubeIT
  • Migrate Test environment to KubeIT
  • Monthly NuGet updates December 2023
  • Quarterly JavaScript/CSS updates Q4 2023

# Bug fixes

  • Python: Set stdout and stderr to None when 'redirect_console_logs_to_terminal' is disabled
  • Jobs don't run on KubeIT green cluster
  • Handle "Medium" sev. SAST flaw (in "AzureStorageConnectionStringResolver"): CWE-316: Cleartext Storage of Sensitive Information in Memory
  • Handle "Low" sev. SAST flaw (in portal): CWE-1174: ASP.NET Misconfiguration: Improper Model Validation - Part 1

# NuGet/Python package release?

  • Yes

# Version 8.4 - November 16, 2023

Version 8.4 release of OneCompute focused on stability improvements to the BLOB file transfer service, and minor bug fixes.

# Enhancements

  • Remove the access condition when uploading files to Azure BLOB storage
  • Monthly NuGet updates November 2023

# Bug fixes

  • (Azure) worker host fails to process job prep. path when running under Kubernetes
  • Developer documentation page can not be reached (used old "dnvgl.com" domain)
  • Job progress is wrong in JobStatus table, if client appl. sends invalid progress

# NuGet/Python package release?

  • Yes

# Version 8.3.2 - November 7, 2023

Version 8.3.2 hotfix release of OneCompute focused on bugfixes.

# Bug fixes

  • The workitems table is overwritten during job scheduler service restarts, causing jobs to fail, due to having "BatchNumber" set to 0

# NuGet/Python package release?

  • No

# Version 8.3.1 (NuGet only) - November 2, 2023

Version 8.3.1 (NuGet only) hotfix release of OneCompute focused on stability improvements to the BLOB file transfer service.

# Enhancements

  • Consider removing the access condition when uploading files to Azure storage

# NuGet/Python package release?

  • Yes

# Version 8.3 - October 19, 2023

Version 8.3 release of OneCompute focused on various improvements to the Python packages (mainly for use in OneWorkflow), improved worker host logging when running locally (typically through OneWorkflow), and security updates.

# Enhancements

  • Let timestamps in the worker host use local timezone instead of UTC
  • When running locally, the ConsoleLogger should log timestamps in local time, not UTC time
  • Save console logs from local jobs to stdout.txt and stderr.txt
  • Improve error messages for failed file transfers
  • Python: Improve temporary folder cleanup and shutdown process
  • Python: Handle TimeoutExpired gracefully
  • Python: Introduce a new attribute for controlling the console visibility of the LocalWorkflowRuntime service.
  • Update NuGet pck "Joonasw.AspNetCore.SecurityHeaders" from 4.0.1 to 5.0.0 (mostly to help remediate SCA vuln.)
  • Upgrade NuGet pck "System.IdentityModel.Tokens.Jwt" from 6.x to 7.x, without getting catastrophic runtime problems in web APIs
  • Handle "High" sev. SCA vuln. in "Microsoft.AspNetCore.WebSockets" (transitive) NuGet dep. (2.1.7)
  • Handle "High" sev. SCA vuln. in "Microsoft.AspNetCore.Http.Features" (transitive) NuGet dep. (2.1.1/2.2.0)
  • Handle "Medium" sev. SCA vuln. in "System.Data.SqlClient" (transitive) NuGet dep. (4.4.2)
  • Handle "Medium" sev. SCA vuln. in "System.Private.Uri" (transitive) NuGet dep. (4.3.0)
  • Handle JavaScript injected by WAF, that gets blocked by our CSP
  • Handle "Informational" sev. SAST flaw (in filelogger): CWE-404: Improper Resource Shutdown or Release
  • Monthly NuGet updates October 2023

# Bug fixes

  • Python: Job's properties is replaced when setting a new property
  • Python: Fix ReductionTask scheduling

# NuGet/Python package release?

  • Yes

# Version 8.2 - September 21, 2023

Version 8.2 release of OneCompute focused on various improvements to the Python packages (mainly for use in OneWorkflow), as well as improved worker host logging when running locally (typically through OneWorkflow).

# Enhancements

  • Python: Refactor Workflow service for enhanced readability and maintainability
  • Python: Improve process readiness wait mechanism
  • Python: Enhance FileOptions class to support human-readable file sizes
  • When running locally, the ConsoleLogger should log timestamps in local time, not UTC time
  • Onboard to Veracode SAST scanning - Part 4 (Python)
  • Onboard to Veracode SAST scanning - Part 5 (KubernetesJobOrchestrator)
  • Handle "Medium" sev. SAST flaw (in Python): CWE-331: Insufficient Entropy
  • Upgrade "Bootstrap" JS library from 4.5.0 to 4.5.3 by using new CDN URL, to work around network issues in China
  • Monthly NuGet updates September 2023

# Bug fixes

  • None

# NuGet/Python package release?

  • Yes

# Version 8.1 - August 17, 2023

Version 8.1 release of OneCompute focused on performance improvements and bug fixes in the portal, as well as being the first official release with full Python support (mainly for use in OneWorkflow).

# Enhancements

  • Support throttling when running locally
  • Extend pool grid/details with OS family, "containerized" and VM type
  • Update support link in portal footer, as the DNV customer portal has been moved
  • Investigate whether a Universal Worker Package model is feasible
  • Handle "High" sev. SCA vuln. in "System.Security.Cryptography.Pkcs" NuGet dep. (7.0.0)
  • Handle "High" sev. SCA vuln. in "DNVGL.One.Compute.StorageLibrary.SQLite" project, detected through a client project (OneWorkflow)
  • Quarterly JavaScript/CSS updates Q3 2023
  • Monthly NuGet updates August 2023
  • Onboard to Veracode SAST scanning - Part 3 (worker hosts)

# Bug fixes

  • Home page very slow to load
  • Accounting view is extremely slow
  • Updating pool start task fails

# NuGet/Python package release?

  • Yes

# Version 8.0 - June 15, 2023

Version 8.0 release of OneCompute focused on changes to Azure Batch pool creation, due to the old pool type being deprecated end of February 2024.

# Enhancements

  • Monthly NuGet updates June 2023
  • Create Windows Marketplace Batch Pool
  • In the native auto-refresh access token implementation, explicitly opt out of embedded web view, due to new MSAL default from their 4.52.0 version onward
  • Possible hugely improved performance of job status retrieval
  • Enable application deployment on demand from the ConsoleWorkItemScheduler

# Bug fixes

  • My storage environment dropdown not resizing properly on small screens, causing automated UI test to fail

# NuGet package release?

  • Yes

# Version 7.4 - May 19, 2023

Version 7.4 release of OneCompute focused on minor bug fixes.

# Enhancements

  • Monthly NuGet updates May 2023
  • File-based workers need to be able to know the working directory
  • Implement IOneComputeClient for the Console WorkerHost + SqlLite storage
  • Before upgrading to OneDesign 3.2.x, rename some custom styles to avoid confusion
  • Quarterly JavaScript/CSS updates May 2023
  • Handle detected SAST "Medium" flaw (in portal): CWE-915: Improperly Controlled Modification of Dynamically-Determined Object Attributes - Part 2 (application package upload)

# Bug fixes

  • None

# NuGet package release?

  • No

# Version 7.3 - April 20, 2023

Version 7.3 release of OneCompute focused on minor bug fixes.

# Enhancements

  • Allow Google Translate URLs in content security policy, to avoid effectively being denied access to external CSP violation reporting service due to "spamming" during automated UI testing
  • Make the platform client's access token auto-refresh for native flow expose the "ConstructLocalTokenCacheAppPath" method as public, to allow clients to handle multi-user scenarios together with disk-based token cache
  • Monthly NuGet updates April 2023
  • Turn off CSP reporting for the API's "plain text" endpoints
  • Onboard to Veracode SAST scanning - Part 2

# Bug fixes

  • Fix failure in MultiAccountWorkScheduler to assign to K8s scheduler
  • Handle detected SAST "Medium" flaw (in portal): CWE-915: Improperly Controlled Modification of Dynamically-Determined Object Attributes - Part 1
  • Web API returns incorrect results when querying for work item properties for a specific work item
  • Handle detected SAST "Medium" flaw (in portal): CWE-601: URL Redirection to Untrusted Site ('Open Redirect')
  • Handle detected SAST "Medium" flaw (in portal's job details): CWE-80: Improper Neutralization of Script-Related HTML Tags in a Web Page (Basic XSS) (known false positive)
  • Improve platform client's response handling for scenario with mismatching authentication configuration

# NuGet package release?

  • No

# Version 7.2 - March 16, 2023

Version 7.2 release of OneCompute focused on improving job scheduling for dynamic workflow and local execution, as well as fixing a few portal bugs.

# Enhancements

  • Monthly NuGet updates March 2023
  • Verify that API token validation handles non-existing signature algorithm
  • The in-process work scheduler should assign different working directories for different work units
  • Unfortunate conflicting use of WorkUnit.Command
  • Migrate DevCore & TestCore environments from ArgoCD to Flux2
  • The platform job scheduler should create any message queues for the job

# Bug fixes

  • Unable to navigate to the results folder in My Storage from the Jobs page for a non-Result Lake job when the work item's job specification uses backslashes in file transfer specification
  • Alert shown when pressing "Load Tasks" button in job details page (with many tasks)
  • In local workflow execution, a job continues to execute even if JobPreparation is faulted
  • Jobs with a single work unit (at the root) fail

# NuGet package release?

  • Yes

# Version 7.1.2 - February 21, 2023

Version 7.1.2 hotfix release of OneCompute focused on bugfixes.

# Bug fixes

  • Job preparation work is broken for Pipeline product centre (SPH outage analysis application)

# NuGet package release?

  • No

# Version 7.1.1 - February 20, 2023

Version 7.1.1 hotfix release of OneCompute focused on bugfixes.

# Bug fixes

  • Adding new application package fails on Linux pool
  • Change default for platform client native authentication to NOT use embedded web view

# NuGet package release?

  • Yes

# Version 7.1 - February 16, 2023

Version 7.1 release of OneCompute focused on extending the Platform client with a new auto-refresh access token mode and further improvements to the dynamic workflow, as well as improvements to the local execution mode needed in OneWorkflow.

# Enhancements

  • Standardize the file download path for the various file transfer services
  • Create an Agent Kernel
  • Tidy up dynamic workflow code and add to OneCompute once Phast code is working
  • Monthly NuGet updates February 2023
  • Temporarily downgrade the MSAL library to 4.47.2 to avoid runtime error due to .NET 7 incompatibility
  • Extend Platform client with auto-refresh of access tokens for interactive login flow
  • Onboard to Veracode SAST scanning - Part 1
  • Quarterly JavaScript/CSS updates February 2023
  • Update OneDesign from 3.0.0 to 3.1.2, incl. updated default fonts
  • Make job preparation and release work work across backend types

# Bug fixes

  • None

# NuGet package release?

  • Yes

# Version 7.0 - January 19, 2023

Version 7.0 release of OneCompute focused on updating the platform to .NET 7 and incremental reductions in dynamic workflows

# Enhancements

  • Dynamic workflows: Incremental reduction
  • Add .NET 7.0 to targets for the worker hosts and remove support for .NET Core 3.1 and .NET 5
  • Make a tool to delete data for retired customers
  • Specify resource requests and node pool for the Kubernetes backend
  • Monthly NuGet updates January 2023
  • Update Platform to .NET 7
  • Upgrade from .NET Framework 4.6.1 to 4.6.2, as <=4.6.1 will reach end of support in April 2022

# Bug fixes

  • Can not access storage , only Azure.storage works

# NuGet package release?

  • Yes

# Version 6.4 - December 15, 2022

Version 6.4 release of OneCompute focused on collecting storage consumption per application and adherence to security policies

# Enhancements

  • Replace "Microsoft.Azure.Management.Fluent" with "Azure.ResourceManager" in Platform - Part 1 & 2
  • Fix build error in "PreparationAndReleaseTaskSample" example after upgrading to OC 6.3.0 NuGet packages
  • Monthly NuGet updates December 2022
  • Register dynamic work unit so that it appears in portal
  • Remove the limitation that the cost factor cannot be less than 1
  • Security Center recommendation; Enable auditing and logging - Diagnostic logs in [...] should be enabled - Part 2
  • Start collecting storage consumption per application
  • Provide an example of 'In-process worker host and work item scheduler'
  • Adhere to upcoming GSS IT Azure policy: "FTPS should be required in web apps"
  • Adhere to upcoming GSS IT Azure policy: "Key Vault secrets should have an expiration date"
  • Adhere to upcoming GSS IT Azure policy: "Storage account public access should be disallowed" - Part 2
  • Adhere to upcoming GSS IT Azure policy: "Web Application should only be accessible over HTTPS"
  • Extend LocalFileTransferService to transfer/copy files between the local directories
  • Remove deprecated "Expect-CT" response header

# Bug fixes

  • Infinite loop of redirects after logging in with 2FA
  • Unable to edit application in KubeIT environment
  • Unable to obtain a token in the Kubernetes env

# NuGet package release?

  • No

# Version 6.3 - November 17, 2022

Version 6.3 release of OneCompute focused on improvements to the dynamic workflow and security fixes.

# Enhancements

  • Set WorkItemProperties for workItems added by dynamic workflow
  • It should be possible to deserialize a content object wrapped in a WorkUnit or Result as object, without knowing the type
  • Adhere to upcoming GSS IT Azure policy: "Key vaults should have soft delete enabled and Key vaults should have purge protection enabled"
  • Adhere to upcoming GSS IT Azure policy: "Storage account public access should be disallowed" - Part 1
  • Adhere to upcoming GSS IT Azure policy: "TLS should be updated to the latest version for web apps"
  • Handle detected "Medium" security vulnerability in "System.Drawing.Common" NuGet dependency (4.7.0)
  • Monthly NuGet updates October 2022
  • Quarterly JavaScript/CSS updates November 2022
  • Monthly NuGet updates November 2022

# Bug fixes

  • Job Scheduler emits incorrect command when scheduling on a Batch pool with custom VM image
  • Infinite loop of redirects after logging in with 2FA

# NuGet package release?

  • Yes

# Version 6.2.1 - October 14, 2022

Version 6.2.1 hotfix release of OneCompute focused on bugfixes.

# Bug fixes

  • Administration - 400 error and [Change Credit Limit] is not clickable

# NuGet package release?

  • No

# Version 6.2 - October 05, 2022

Version 6.2 release of OneCompute focused Linux pools creation without Docker and phasing out OneAuthorization NuGet package.

# Enhancements

  • Re-enable creation of Linux pools without Docker
  • Phase out the "OneAuthorization" NuGet package
  • Fail Azure Batch job if the pool does not exist

# Bug fixes

  • Cannot access output files from OC portal not working
  • File download fails for a .NET 6 Windows client
  • Non-portal web services get loads of exceptions logged for MFA
  • Production - Can not add Storage Tester in pool
  • SignalR web API gets a "B" in the internal security scan due to returning "ASP.NET" in the "X-Powered-By" response header
  • Unstable portal and client production westeurope

# NuGet package release?

  • No

# Version 6.1 - September 15, 2022

Version 6.1 release of OneCompute focused on multi-factor authentication on the admin pages.

# Enhancements

  • Multifactor authentication on admin interfaces - part 2
  • Worker host referencing DNVGL.One.Telemetry.Core.ApplicationInsights should issue a warning and carry on rather than failing
  • Monthly NuGet updates September 2022

# Bug fixes

  • Dynamic Workflow creating child tasks with duplicate BatchNumber
  • StorageTester dynamic workflow failing tasks
  • Workerhost not running with ISendMessage

# NuGet package release?

  • No

# Version 6.0 - August 18, 2022

Version 6.0 release of OneCompute focused on adding dynamic workflows functionality.

# Enhancements

  • Dynamic workflows: Enable workers to schedule additional work
  • Improve ScheduleWorkService behaviour to set required params of Child Tasks
  • Roles tab - need to pass MFA to access roles tab
  • Monthly NuGet updates July 2022
  • Monthly NuGet updates August 2022

# Bug fixes

  • Insufficient error handling in job scheduler host related to ResultLake caching
  • Fix minor styling issues after upgrading to OneDesign 3.0
  • Key vault update script fails to retrieve logged in user info and log short secrets

# NuGet package release?

  • Yes

# Version 5.5.2 - August 3, 2022

Version 5.5.2 hotfix release of OneCompute focused on security updates.

# Enhancements

  • Handle detected "High" vulnerability in "moment" JS dependency (2.29.3)
  • Handle detected "Medium" vulnerability in "jquery/validate"/"jquery-validation" JS dependency (1.19.4)
  • Handle detected "Medium" vulnerability in "jquery-ui" JS dependency (1.13.1)

# NuGet package release?

  • No

# Version 5.5 - June 16, 2022

Version 5.5(.1) release of OneCompute focused on security and OneDesign updates.

# Enhancements

  • ASSA: Remove deprecated X-XSS-Protection HTTP response header
  • Handle findings from SAST (static code analysis) tool(s)
  • Monitor "@microsoft/signalr" JS dependency for updates to its vulnerable "eventsource" transient dependency
  • Upgrade ASSA form to latest 6.0 and assess the brand new security controls
  • Improve stability on portal production westeurope
  • Monthly NuGet updates June 2022
  • Review ASSA form to have only supported statuses
  • Update OneDesign to 3.0.0

# Bug fixes

  • MD5 checksum in BLOB may be blank -> filetransfer validation fails
  • Windows Server 2019-based pools don't work (reliably) with Cloud Services config
  • Application package upload browse button does not work in OneDesign 3.0.0

# NuGet package release?

  • No

# Version 5.4.2 - May 31, 2022

Version 5.4.2 hotfix release of OneCompute focused on security updates.

# Enhancements

  • Handle detected security vulnerability in "jquery/validate"/"jquery-validation" JS dependency (1.19.3)
  • Handle detected security vulnerability in "eventsource" JS dependency (transient dependency)

# Bug fixes

  • Improved portal front page yields CSP violation for some script

# NuGet package release?

  • No

# Version 5.4 - May 19, 2022

The 5.4 release of OneCompute focused on bugfixes, tech debt and performance improvements.

# Enhancements

  • Reintroduce logging of the ContainerUrl in a redacted form in the file transfer service
  • Improve loading performance of Portal Home page - Part 2
  • Upgrade platform services to .NET 6 - Part 3
  • In Azure Batch WorkerHost, refactor Result Lake client factory handling to cater for SWiM needs
  • Have multiple SRI hashes for JS/CSS dependencies, for improved browser support
  • Quarterly JavaScript/CSS updates May 2022
  • Monthly NuGet updates May 2022
  • Consider using a "JsonSerializer.SerializationBinder" when deserializing, to satisfy SAST tool

# Bug fixes

  • Application package upload based on Azure DevOps build artifact fails
  • Filetransfer fails if subfolder is more than 200 characters on Linux
  • Fix missing trace messages in Application Insights for JobScheduler and BackgroundWoker
  • Azure Batch worker host unable to handle telemetry client configuration if instrumentation key is missing

# NuGet package release?

  • Yes

# Version 5.3 - April 21, 2022

The 5.3 release of OneCompute focused on bugfixes, security enhancements and upgrades to .NET 6 runtime.

# Enhancements

  • Update «moment» JavaScript library from 2.29.1 to 2.29.2 to fix security vulnerability reported by Snyk
  • Improve loading performance of Portal Home page - Part 1
  • Upgrade platform services to .NET 6 - Part 2 (the web API)
  • Investigate whether we need to safe-guard against the "node-ipc" npm package situation ("peacenotwar")

# Bug fixes

  • User jobs are not listed in My Jobs
  • Remove logging of long-lived SAS token in BLOB container URLs in file transfer service

# NuGet package release?

  • Yes

# Version 5.2 - March 17, 2022

The 5.2 release of OneCompute focused on bugfixes and security enhancements.

# Enhancements

  • Should update client-side libraries to latest version
  • Upgrade "bootstrap" library used in portal to improve Snyk web test score from "D"
  • Update to latest OneDesign 2.8.1

# Bug fixes

  • Credits for a Job not counted after 7 days

# NuGet package release?

  • No

# Version 5.1 - February 17, 2022

The 5.1 release of OneCompute focused on minor bugfixes.

# Enhancements

  • Various HTML issues are reported by Edge browser - Part 1

# Bug fixes

  • Work items with more than 24 hours' duration only displays the time info for the last day

# NuGet package release?

  • No

# Version 5.0 - January 20, 2022

The 5.0 release of OneCompute focused on code cleanup and getting the platform ready for the migration to OneGateway, which will be done as soon as the infrastructure is ready.

The old, regional API endpoints (used prior to the 4.0 release) are now officially deprecated.

# NuGet package release?

  • Yes

# Version 4.6 - December 16, 2021

The 4.6 release of OneCompute focused on security updates and code refactoring.

# NuGet package release?

  • No

# Version 4.5 - November 18, 2021

The 4.5 release of OneCompute focused on minor bugfixes.

# Enhancements

  • Setup East US 2 deployment

# Bug fixes

  • Report generation fails when user has only User role and with account which has no tag
  • Connection string caching fails to provide fallbacks for non-set environment ID
  • Create Linux Pool does not create pool supporting containers
  • Getting job properties through platform client yields only minimum date for "CreationTimestamp" property
  • Add Tag failed in My Jobs page

# NuGet package release?

  • Yes

# Version 4.4 - October 25, 2021

The 4.4 release of OneCompute focused on Kubernetes backend, improvements to the portal and minor bugfixes.

# Enhancements

  • Add default version of an application to a pool
  • Backend services running on Kubernetes
  • Filter jobs by environment or application on Jobs page
  • Improve deletion experience
  • Show tags in the "Compute: Credits per job" report

# Bug fixes

  • Job deletion SignalR is sometimes unstable
  • Application list is not correct for User role
  • File upload from cloud nodes sometimes fails length part of validation

# NuGet package release?

  • No

# Version 4.3.1 - September 29, 2021

The 4.3(.1) release of OneCompute focused on improvements to the portal and minor bugfixes.

# Enhancements

  • None

# Bug fixes

  • JobScheduler does not remove the job orchestrator when the job terminates
  • Correct title not shown when browsing to subfolder
  • Accounting reports for all accounts time out
  • Application - Delete: Error Message is not correct when user has no access to delete
  • My Storage page shows incorrect Summary Size information
  • Other internal bugfixes

# NuGet package release?

  • Yes

# Version 4.2.1 - August 18, 2021

The 4.2(.1) release of OneCompute focused on:

  • Improvements to the portal and minor bugfixes
  • Re-branding from "DNV GL" to "DNV"

As part of the re-branding, all portal endpoints have changed:

The new global API endpoints are:

The old, regional API endpoints (used prior to the 4.0 release) are kept for compatibility reasons for some time still. The old "@dnvgl.com" endpoints are kept for compatibility reasons for some time still.

# Enhancements

  • Job and workspace tags
  • Provide API to access usage data
  • Improve accounting report with field filtering
  • Refactoring of multiple batch account handling
  • Updating applicable Azure related NuGet packages from SDK v11 "Microsoft.Azure." to SDK v12 "Azure."

# Bug fixes

  • Newlines in 'notify users' text field are not taken into account in actual email
  • No Batch account info in NodeCount, Scale, Restart, Reimage page in Operations
  • Missing Batch account name in pool views
  • Application access selection shows only 5 rows by default, even though it claims to show 10
  • GetJobProperties times out occasionally
  • Mixed content error - scripts are requested over HTTP rather than HTTPS
  • JS errors on Users' Edit page when run on Linux image in Kubernetes
  • Job Details page violates the Content Security Policy
  • Missing UI feedback for a Delete Job operation
  • Batch account selector doesn't reflect active environment

# NuGet package release?

  • Yes

# Version 4.1 - April 28, 2021

The 4.1 release of OneCompute was a minor servicing release of the OneCompute platform with no package updates. Its main purpose was to add support for the new authentication scheme introduced by Veracity in April 2021 to the OneCompute platform API and portal before the old authentication scheme is deprecated on July 1, 2021.

# NuGet package release?

  • No

# Version 4.0 - February 20, 2021

The 4.0 release of OneCompute focused on:

  • Supporting multiple Batch accounts
  • Globalization: Integrating the regional deployments into a single, global OneCompute
  • Security enhancements
  • Audit logging
  • Worker communication and control
  • Support for .NET 5.0-based workers

OneCompute 4.0 introduces a new concept, the environment. An environment contains the resources needed to execute jobs. Users are assigned a home environment, which corresponds to the region in which they run their jobs and store their files. The home environment of a user can be set through the OneCompute portal by a User Manager. Currently, the develop, test and prod deployments of OneCompute are set up with three environments:

  • West Europe
  • North Europe
  • East US

What previously were three separate deployments of OneCompute have in version 4.0 been converted to environments.

The regional deployments of OneCompute are kept, but they are pooled behind common endpoints:

The new global API endpoints are:

The old, regional API endpoints are kept for compatibility reasons.

# Enhancements

  • Support multiple Batch accounts (ADO#69264,171934,171933,172912,172914,177692,187727)
  • Add .NET 5.0 to the target platforms of WorkerHost.AzureBatch (ADO#242624,242625)
  • The Users views must list applications in all Batch accounts (ADO#187727)
  • Show the user's home environment on the Home page (ADO#240898)
  • Add an environment column to the jobs lists (ADO#240900)
  • User Managers should be able to set home environment of users (ADO#186853)
  • Assign home environment of a user (ADO#174096)
  • Logging of user changes to the audit log (ADO#214645)
  • OC does not block job input file upload while user has no storage/credits/access (ADO#151269)
  • Add method to retrieve properties for all jobs of the user (ADO#249563)
  • Misc. security enhancements (ADO#138334,140294,214081,246940,248611,251690,251691,251898,252639,252698,255442,255443,216243,216521,220325,221154,223140,223156,223157,223163,223182,223407,249677,249819,253128,257421)
  • Misc. portal UI enhancements (ADO#171934,245229,258615,260492,215239)
  • Add Service Manager to the CPU consumption report (ADO#171526)
  • [Result Lake] Reduce number of requests to get access token needed by the worker host (ADO#183924)
  • Delete Azure Batch job (ADO#209894)
  • Logging of user changes to the audit log (ADO#214645)
  • Worker communication and control (ADO#216508,170141,176929,176930)
  • Improved background worker logging (ADO#221546)
  • Delete pools with the same name from multi-batch-accounts (ADO#242617)
  • Should block Result Lake download when user's account storage has expired (ADO#255688)
  • The Create Application page should allow creating an application with the same in a different environment (ADO#244356)

# Bug fixes

  • AccountAdministrationTab: Can not change credit limit (ADO#249783)
  • Failure to delete big jobs (ADO#251924)
  • When selecting more than 10 jobs for deletion it only deletes 10 (ADO#170630)
  • Monitor service event reports wrong workitemId (ADO#185284)
  • Unable to remove application from a pool (ADO#212443)
  • Selecting jobs is only kept in the active page (ADO#212477)
  • Selecting folders or files is only kept in the active page (ADO#212478)
  • Portal: Accounting; Inconsistent number formatting across credit and storage reports (ADO#215275)
  • "New user" e-mail does not link directly to accept the user (ADO#221270)
  • [Background worker] Lacks error handling for sequential work executor execution (ADO#252682)
  • UploadFileAsync fails to upload files in sub folders on Windows when targeting .NET Core 3.1 and .NET 5.0 (ADO#252855)
  • Email notification issues (ADO#254241)
  • Transaction Details fails for users with duplicate membership (UserId) entries (ADO#258105)
  • Error in accounting reports after migration of accounting data (ADO#261676)

# NuGet package release?

  • Yes

# Version 3.1 - September 25, 2020

The 3.1 release of OneCompute focused on OneCompute portal enhancements.

# Enhancements

  • Miscellaneous security-related enhancements to tighten security of the portal and the API (ADO#140290,146348,159347,159349,214097,214107)
  • Restrict the number of tasks loaded in the Job Details view
  • Storage size calculation enhancements
  • Added web API method to delete a specified job (ADO#182140)
  • Extend the API with a method to get container URIs for all work items in a given job (ADO#182311)
  • Improved UI in MyStorage and MyJobs views (ADO#173036)
  • OneDesign alignments
  • UI improvements to account management
  • Misc. portal UI enhancements (ADO#82427,88166,91954,94991,94995,94997,95957,153322,158304,165453,165879,185424,189601)
  • Administration page for Account Administrators (ADO#176223)
  • Manually assign account admins to the proper account (ADO#79272)
  • Improve the home page load performance (ADO#144310)
  • Bulk delete of jobs from OCP portal (ADO#157078)
  • Field for Account Administrators to change the credit limit (ADO#160553)
  • Allow AccountAdministrators to see the account jobs (ADO#165711)
  • Show size of jobs in the My jobs tab (ADO#183649)
  • Show size of tasks in the My jobs tab (ADO#187202)

# Bug fixes

  • Not able to send email notification to users without disabling Javascript
  • Not able to delete files or Jobs from Result Lake
  • Failure to upload files to Result Lake for long-running work
  • AzureBatchWorkScheduler consistently times out for certain big jobs and fails to complete the job (ADO#177808)

# NuGet package release?

  • Yes

# Version 3.0 - April 1, 2020

The 3.0 release of OneCompute focused on enhancements to OneCompute Platform:

  • Accounts and consumption control
  • Improved consumption reports.
  • Result Lake: providing scalable storage of result files
  • Miscellaneous usability enhancements to the OneCompute Portal

# Changes

All NuGet package references have been upgraded to their latest versions in this release. "Microsoft.WindowsAzure.Storage" has changed to "Microsoft.Azure.Storage.DataMovement" & "Microsoft.Azure.Storage.Blob." As of "Microsoft.Azure.Storage" v9.4 Table API support has been dropped. Table API support is now provided by the "Microsoft.Azure.Cosmos.Table" library. Applications using Azure storage may need to upgrade to these libraries.

There are a few breaking changes to the OneComputePlatformClient. See list of Enhancements below.

# Enhancements

  • New home page with usage data.
  • Provide link from job directly to corresponding storage folder
  • Scalable results storage, see Result Lake
  • General Portal Improvements
  • Implementation of Accounts
  • Limit Credit consumption
  • Limit Storage access
  • Changes to the OC platforms
  • Storage usage visible for users
  • Extend portal reports and UI to account for consumption limits
  • Add transactions into One Compute
  • Access to Results Lake output files, see Using the OneCompute Result Lake
  • The WorkUnit.Data property was removed. Its usage was to provide access to application input, which now can retrieved by using the WorkUnit.GetInput method.
  • The asynchronous methods of OneComputePlatformClient was renamed with the Async postfix to give room for corresponding synchronous methods, in preparation for clients that require synchronous methods.

# Bug fixes

  • Usage report error when user has no usage
  • Portal: "Jobs" table does not show properly
  • Unhandled authentication exception for external user
  • Portal: Security; Penetration testing vulnerability 2.4.1.1 - W - A2-Broken Authentication and Session Management - Incorrect session management
  • Portal: Size sorting is not working properly
  • Portal: After "Log out" the user is not logged out nor redirected to home page
  • OneCompute portal- Operation: Wrong VM sizes displayed
  • Batch: File transfer to node fails occasionally
  • Access denied to job details through developer portal
  • Portal: Run time is not updated in Jobs view while job is running
  • Portal: Applications; Upload fails when package version contains a space
  • Exception for a non-VerIT user when accepting terms and conditions in the OCP portal
  • Uploading big application package fails with HTTP error code 500
  • Exception in JobScheduler when updating work item properties
  • Credits are not properly accounted for in a faulted job
  • West Europe production portal fails
  • Errors experienced by a user that has no jobs or container content.
  • Cloud storage navigation fails for users with high storage
  • The home page is crashing in the production North-Europe environment.
  • Dev+Test Prevent web jobs running on Structure compute portal resources
  • Jobs getting stuck in states instead of moving to completed
  • CSV report has column header Cost instead of Credits
  • The Add-Application page fails to validate form inputs
  • Pools listed in Application Default Pool drop down wrong

# NuGet package release?

  • Yes

# Version 2.2.2 - November 24, 2019

This is a patch release of version 2.2.

# Changes

  • None

# Bug fixes

# NuGet package release?

  • No

# Version 2.2.1 - October 14, 2019

This is a patch release of version 2.2.

# Changes

  • None

# Bug fixes

# NuGet package release?

  • No

# Version 2.2 - July 12, 2019

The 2.2 release of OneCompute focused on

  • Portal accessibility
  • Following up on findings from penetration tests
  • Following up on findings from security review

# Changes

  • None

# Enhancements

# Bug fixes

# NuGet package release?

  • Yes

# Version 2.1 - April 30, 2019

The 2.1 release of OneCompute focused on:

  • Consumption reporting in the OneCompute Portal
  • Ability to specify default pools for Batch applications
  • Enhanced pool management from the OneCompute portal
  • Application properties on jobs and work items

# Changes

  • None

# Enhancements

# Bug fixes

# NuGet package release?

  • Yes

# Version 2.0 - February 13, 2019

The 2.0 release of OneCompute focused on:

  • Establishing OneCompute Platform, a shared, scalable compute service running in Azure.
  • Increasing scalability and robustness of OneCompute components.

# Features of OneCompute Platform

  • OneCompute API with secure access through Veracity
    • Schedule jobs for execution
    • Monitor job execution
    • Get job status and progress
    • Provide secure access to a private blob container for every user
  • OneCompute Portal with secure login through Veracity and role based security
    • Every user can browse their own blob container and download files through the OneCompute Portal
    • Every user can list their jobs
    • Every user can get a consumption report
    • Accountants can get consumption reports for companies and users
    • Operators can manage compute pools
    • Application Owners can manage applications
    • User Managers can manage user access to applications

# Changes

  • None

# Enhancements

# Bug fixes

# NuGet package release?

  • Yes

# Version 1.2.2 - June 30, 2018

This is a patch release of version 1.2.

# Changes

  • None

# Bug fixes

# NuGet package release?

  • No

# Version 1.2.1 - April 5, 2018

This is a patch release of version 1.2.

# Changes

  • None

# Enhancements

# NuGet package release?

  • Yes

# Version 1.2 - March 30, 2018

The 1.2 release focused on:

  • Fixing defects
  • Minor enhancements
  • Enhancing the production environment of OneCompute
    • Adding automatic regression testing of the supported back-ends
    • Automatic build of examples and VSIX projects
    • Standardizing on .NET Standard 2.0
    • Standardizing on the new C# project format that simplifies NuGet packaging and avoids package dependency inconsistencies

# Changes

  • None

# Enhancements

# Bug fixes

# NuGet package release?

  • Yes

# Version 1.1.1 - February 5, 2018

This is a patch (bug fix release of version 1.1).

# Changes

# NuGet package release?

  • Yes

# Version 1.1 - November 22, 2017

This was the initial release of OneCompute.

# NuGet package release?

  • Yes

←