OneCompute Release Notes
Known issues
Release history
- Version 10.3 - September 19, 2024
- Version 10.2.3 - August 20, 2024
- Version 10.2(.2) - August 15, 2024
- Version 10.1.1 (NuGet only) - August 5, 2024
- Version 10.1 - June 20, 2024
- Version 10.0 - May 16, 2024
- Version 9.3 - April 18, 2024
- Version 9.2(.1) - March 21, 2024
- Version 9.1(.1) - February 22, 2024
- Version 9.0.2 - February 19, 2024
- Version 9.0.1 - February 12, 2024
- Version 9.0.1 (NuGet only) - January 22, 2024
- Version 9.0 - January 18, 2024
- Version 8.5(.2) - December 21, 2023
- Version 8.4 - November 16, 2023
- Version 8.3.2 - November 7, 2023
- Version 8.3.1 (NuGet only) - November 2, 2023
- Version 8.3 - October 19, 2023
- Version 8.2 - September 21, 2023
- Version 8.1 - August 17, 2023
- Version 8.0 - June 15, 2023
- Version 7.4 - May 19, 2023
- Version 7.3 - April 20, 2023
- Version 7.2 - March 16, 2023
- Version 7.1.2 - February 21, 2023
- Version 7.1.1 - February 20, 2023
- Version 7.1 - February 16, 2023
- Version 7.0 - January 19, 2023
- Version 6.4 - December 15, 2022
- Version 6.3 - November 17, 2022
- Version 6.2.1 - October 14, 2022
- Version 6.2 - October 05, 2022
- Version 6.1 - September 15, 2022
- Version 6.0 - August 18, 2022
- Version 5.5.2 - August 3, 2022
- Version 5.5 - June 16, 2022
- Version 5.4.2 - May 31, 2022
- Version 5.4 - May 19, 2022
- Version 5.3 - April 21, 2022
- Version 5.2 - March 17, 2022
- Version 5.1 - February 17, 2022
- Version 5.0 - January 20, 2022
- Version 4.6 - December 16, 2021
- Version 4.5 - November 18, 2021
- Version 4.4 - October 25, 2021
- Version 4.3 - September 29, 2021
- Version 4.2 - August 18, 2021
- Version 4.1 - April 28, 2021
- Version 4.0 - February 20, 2021
- Version 3.1 - September 25, 2020
- Version 3.0 - April 1, 2020
- Version 2.2.2 - November 24, 2019
- Version 2.2.1 - October 14, 2019
- Version 2.2 - July 12, 2019
- Version 2.1 - April 30, 2019
- Version 2.0 - February 13, 2019
- Version 1.2.2 - June 30, 2018
- Version 1.2.1 - April 5, 2018
- Version 1.2 - March 30, 2018
- Version 1.1.1 - February 5, 2018
- Version 1.1 - November 22, 2017
Version 10.3 - September 19, 2024
Version 10.3 release of OneCompute focused on a major bugfix in the Azure Batch log file upload handling, as well as minor security improvements.
Enhancements
- Handle "High" and "Medium" sev. SCA vuln. in several Python (transitive) dep.
- Handle "Medium" sev. SAST flaw (in web svcs): CWE-117: Improper Output Neutralization for Logs
- Handle "Medium" sev. SAST flaw (in "EmailServiceInfo" and others): CWE-316: Cleartext Storage of Sensitive Information in Memory
- Handle "Low" sev. SAST flaw (in "EmailManager"): CWE-201: Insertion of Sensitive Information Into Sent Data
- Monthly NuGet updates September 2024
Bug fixes
- Log files not always uploaded by Azure Batch
NuGet/Python package release?
- Yes
Version 10.2.3 - August 20, 2024
Version 10.2.3 hotfix release of OneCompute focused on stability improvements to the storage cache host (daily storage consumption calculation).
Enhancements
- None
Bug fixes
- StorageCacheHost crashes when performing "DeleteExpiredUserTables", in environments other than DevCore
NuGet/Python package release?
- No
Version 10.2(.2) - August 15, 2024
Version 10.2 release of OneCompute focused on MFA simplifications for the "Jobs" page, as well as minor security improvements.
Enhancements
- Split "JobsController" in two to avoid MFA confusion with "My Jobs"
- Debit account when debit account interval has elapsed (internally send a "DebitAccountMessage")
- Expose debit account interval in the portal (for an application)
- Configure storage accounts to accept connections using minimum TLS 1.2
- Monthly NuGet updates August 2024
- Quarterly JavaScript/CSS updates Q3 2024
- Handle "High" sev. SCA vuln. in "ws" JS (transitive) dependency (7.5.7)
- Migrate KubeIT services to "blue" cluster (KubeIT 2.1) before 5th Aug '24
Bug fixes
- In the portal, the "Jobs" view shows jobs that are not connected to any account when logged in as an "AccountAdministrator"
NuGet/Python package release?
- Yes
Version 10.1.1 (NuGet only) - August 5, 2024
Version 10.1.1 (NuGet only) hotfix release of OneCompute focused on fixing security vulnerabilities in third-party libraries.
Enhancements
- Affects "DNVGL.One.Compute.StorageLibrary.Azure":
- Handle "High" sev. SCA vuln. in "System.Text.Json" NuGet dep. (8.0.3)
- Handle "Medium" sev. SCA vuln. in "Azure.Identity" NuGet dep. (1.11.2)
- Affects "DNVGL.One.Compute.Platform.Client.Extensions":
- Handle "High" sev. SCA vuln. in "System.Formats.Asn1" NuGet (transitive) dep. (8.0.0)
- Handle "Medium" sev. SCA vuln. in "Microsoft.Identity.Client" NuGet dep. (4.61.2)
NuGet/Python package release?
- Yes
Version 10.1 - June 20, 2024
Version 10.1 release of OneCompute focused on minor local workflow improvements, as well as minor security improvements.
Enhancements
- Reorganize the Application Management Service to reduce project dependencies
- Publish SAST flaw mitigation advice for NuGet pcks
- Handle "Low" sev. SAST flaw (in portal): CWE-1174: ASP.NET Misconfiguration: Improper Model Validation - Part 2 (models)
- Handle "Low" sev. SAST flaw (in web API): CWE-1174: ASP.NET Misconfiguration: Improper Model Validation
- In "Defender for Cloud", try to reclaim 21 secure score points in dev. sub. by converting to chiseled base images and afterwards removing older images - Part 1
- Monthly NuGet updates June 2024
Bug fixes
- None
NuGet/Python package release?
- Yes
Version 10.0 - May 16, 2024
Version 10.0 release of OneCompute focused on renaming "DNVGL" to "DNV" (for the NuGet packages), as well as improving portal performance and minor bug fixes.
Note: In order to upgrade to the latest NuGet packages, the existing ones will have to be uninstalled first, and then the corresponding new ones installed.
Enhancements
- Change DNVGL prefix to DNV
- Use "chiseled" base Docker images for Azure Batch worker host, to reduce the potential security attack surface
- Use proper build version on Azure Batch worker host Docker image build
- Handle "Medium" sev. SCA vuln. in "Azure.Identity" NuGet dep. (1.10.4)
- Handle "Low" sev. SCA vuln. in "Microsoft.Identity.Client" NuGet dep. (4.60.1)
- Python: Add documentation for various modules
- Monthly NuGet updates May 2024
- Quarterly JavaScript/CSS updates Q2 2024
Bug fixes
- Timeout when generating report in accounting page when specifying a "too wide" date range (for "Compute: Usage per Job" report)
NuGet/Python package release?
- Yes
Version 9.3 - April 18, 2024
Version 9.3 release of OneCompute focused on improving portal performance, KubeIT backend improvements, and minor bug fixes.
Enhancements
- Don't include "Content-Security-Policy" response header for our CSS file, for performance reasons
- Push DNVGL.One.Compute.SignalR package to NuGet.org
- Monthly NuGet updates April 2024
- Handle "Low" sev. SAST flaw (in portal): CWE-209: Generation of Error Message Containing Sensitive Information
Bug fixes
- Google translation has console error and failed, due to CSP (content security policy) restrictions
- WorkItems with the same ID cannot be run on the KubeIT backend
- Work items cannot run on KubeIT if the ID is too long or contains invalid characters
- Test environment's "Job" endpoint throws exception for all users
- Portal's "Jobs" doesn't properly enumerate data, with bad performance as a result
NuGet/Python package release?
- Yes
Version 9.2(.1) - March 21, 2024
Version 9.2 release of OneCompute focused on improving portal performance, as well as minor Python usability improvements, and minor bug fixes.
Enhancements
- In the portal's "Accounting" view, reduce the default date range from one year to one month, to increase performance
- Improve performance for portal's job deletion, as it currently is prone to timeouts when deleting many jobs at a time
- Separate portal's "Accounting" view in two, to enable not requiring MFA for external users
- [Python] Enhance File Service with Progress Reporting, Concurrent File Transfer, and MD5 Check
- [Python] Enable concurrent service runs with enhanced logging
- Update Python dependency packages versions, incl. to handle some reported security vulnerabilities
- Resuscitate the "UserAuthViaIntermediateAPI" example projects, by running on recent .NET and use latest authentication endpoint
- Monthly NuGet updates March 2024
- Handle "High" sev. SCA vuln. in "System.Private.Uri" (transitive) NuGet dep. (4.3.0) - take 2
- Add "Microsoft.Identity.Client" Nuget pck ref to "Platform.Client" as well, to offer more consistent OC NuGet pcks
Bug fixes
- Job scheduling doesn't dispose of the "BatchClient" instance - possibly causing resource locking?
- The end user documentation page is not found after migrating to KubeIT
- The developer documentation page is not found after migrating to KubeIT - Part 1 (make it work short term by adjusting the URL)
- "My Jobs" can not render data (gives timeout) when the user has many jobs
- Runtime error from Web Application Firewall when trying to submit too large jobs?
- [Python] Enhance delete_dir method to handle deletion of more than 256 blobs
- Local client GetWorkItemProperties return wrong data
NuGet/Python package release?
- Yes
Version 9.1(.1) - February 22, 2024
Version 9.1 release of OneCompute focused on removing support for creating old pool types in the portal, as well as minor Python and portal usability improvements, and minor bug fixes.
Enhancements
- In the portal's pool details view, change the applications grid display size from 5 to 7 rows, for readability
- Improve portal's audit log user experience by sorting descendingly rather than ascendingly on the timestamp, as well as allowing search in the "Information" column
- [Python SDK] Refactor temp directory creation for enhanced flexibility and isolation
- [Python SDK] Introduce exception handling for starting already running processes
- Python: Upgrade OneCompute Python to ensure compatibility with Python version 3.12
- Support in-place local execution
- Remove the ability to create Windows Cloud Service pools after February 2024
- Monthly NuGet updates February 2024
- Quarterly JavaScript/CSS updates Q1 2024
- Handle "High" sev. SCA vuln. in "System.Data.Common" NuGet dep. (4.3.0)
- Separate Plant and ROS pools, applications and users in different environments
Bug fixes
- Kubernetes jobs don't run when submitted by North Europe users
- Downgrade .NET Standard 2.1 to 2.0 in Core in order not to break .NET Framework support in clients
- Job progress in the portal shouldn't be rounded up to 100% when the job is not completed yet
- Azure Batch pool environment variable naming issue on Linux with BatchApplicationEnvironment class
- Python: ERROR: Authentication failed
- IApplicationEnvironment is not found when using UniversalWorkerHost with Azure Batch
NuGet/Python package release?
- Yes
Version 9.0.2 - February 19, 2024
Version 9.0.2 hotfix release of OneCompute focused on stability improvements to the job scheduling.
Enhancements
- Jobs are occasionally not completed by the job scheduler
NuGet/Python package release?
- No
Version 9.0.1 - February 12, 2024
Version 9.0.1 hotfix release of OneCompute focused on logging improvements to the job scheduling.
Enhancements
- Extend job scheduling task monitoring logging with job ID for failed task listing
NuGet/Python package release?
- No
Version 9.0.1 (NuGet only) - January 22, 2024
Version 9.0.1 (NuGet only) hotfix release of OneCompute focused on fixing security vulnerabilities in third-party libraries.
Enhancements
- Affects "DNVGL.One.Compute.StorageLibrary.SQLite" (typically local worker host execution):
- Handle "High" sev. SCA vuln. in "System.Data.SqlClient" NuGet dep. (4.8.5)
- Affects "DNVGL.One.Compute.Platform.Client.Extensions" (typically Platform client in auto-refresh access token mode):
- Handle "Medium" sev. SCA vuln. in "Microsoft.IdentityModel.Protocols.OpenIdConnect" NuGet dep. (7.0.3) and "System.IdentityModel.Tokens.Jwt" (transitive) NuGet dep. (7.0.3)
NuGet/Python package release?
- Yes
Version 9.0 - January 18, 2024
Version 9.0 release of OneCompute focused on upgrading worker hosts to support .NET 8 (instead of 7), and minor bug fixes.
Enhancements
- Deprecate .NET Framework 4.6.2 support for the worker hosts
- Replace .NET 7.0 support with .NET 8.0 for the worker hosts
- Update Platform to .NET 8
- Monthly NuGet updates January 2024
Bug fixes
- FileLogger is not thread safe
- Fix invalid bookmark links in doc
NuGet/Python package release?
- Yes
Version 8.5(.2) - December 21, 2023
Version 8.5 release of OneCompute focused on removing the East US-based environments (to cut cost, as they are no longer being used by any active users), continued KubeIT migration, and minor bug fixes.
Enhancements
- Remove EastUS and EastUS2 environments
- Python: Securely cache login tokens in the Python client
- Python: Preserve temporary directories for further analysis or insights
- Migrate Develop environment to KubeIT
- Migrate Test environment to KubeIT
- Monthly NuGet updates December 2023
- Quarterly JavaScript/CSS updates Q4 2023
Bug fixes
- Python: Set stdout and stderr to None when 'redirect_console_logs_to_terminal' is disabled
- Jobs don't run on KubeIT green cluster
- Handle "Medium" sev. SAST flaw (in "AzureStorageConnectionStringResolver"): CWE-316: Cleartext Storage of Sensitive Information in Memory
- Handle "Low" sev. SAST flaw (in portal): CWE-1174: ASP.NET Misconfiguration: Improper Model Validation - Part 1
NuGet/Python package release?
- Yes
Version 8.4 - November 16, 2023
Version 8.4 release of OneCompute focused on stability improvements to the BLOB file transfer service, and minor bug fixes.
Enhancements
- Remove the access condition when uploading files to Azure BLOB storage
- Monthly NuGet updates November 2023
Bug fixes
- (Azure) worker host fails to process job prep. path when running under Kubernetes
- Developer documentation page can not be reached (used old "dnvgl.com" domain)
- Job progress is wrong in JobStatus table, if client appl. sends invalid progress
NuGet/Python package release?
- Yes
Version 8.3.2 - November 7, 2023
Version 8.3.2 hotfix release of OneCompute focused on bugfixes.
Bug fixes
- The workitems table is overwritten during job scheduler service restarts, causing jobs to fail, due to having "BatchNumber" set to 0
NuGet/Python package release?
- No
Version 8.3.1 (NuGet only) - November 2, 2023
Version 8.3.1 (NuGet only) hotfix release of OneCompute focused on stability improvements to the BLOB file transfer service.
Enhancements
- Consider removing the access condition when uploading files to Azure storage
NuGet/Python package release?
- Yes
Version 8.3 - October 19, 2023
Version 8.3 release of OneCompute focused on various improvements to the Python packages (mainly for use in OneWorkflow), improved worker host logging when running locally (typically through OneWorkflow), and security updates.
Enhancements
- Let timestamps in the worker host use local timezone instead of UTC
- When running locally, the ConsoleLogger should log timestamps in local time, not UTC time
- Save console logs from local jobs to stdout.txt and stderr.txt
- Improve error messages for failed file transfers
- Python: Improve temporary folder cleanup and shutdown process
- Python: Handle TimeoutExpired gracefully
- Python: Introduce a new attribute for controlling the console visibility of the LocalWorkflowRuntime service.
- Update NuGet pck "Joonasw.AspNetCore.SecurityHeaders" from 4.0.1 to 5.0.0 (mostly to help remediate SCA vuln.)
- Upgrade NuGet pck "System.IdentityModel.Tokens.Jwt" from 6.x to 7.x, without getting catastrophic runtime problems in web APIs
- Handle "High" sev. SCA vuln. in "Microsoft.AspNetCore.WebSockets" (transitive) NuGet dep. (2.1.7)
- Handle "High" sev. SCA vuln. in "Microsoft.AspNetCore.Http.Features" (transitive) NuGet dep. (2.1.1/2.2.0)
- Handle "Medium" sev. SCA vuln. in "System.Data.SqlClient" (transitive) NuGet dep. (4.4.2)
- Handle "Medium" sev. SCA vuln. in "System.Private.Uri" (transitive) NuGet dep. (4.3.0)
- Handle JavaScript injected by WAF, that gets blocked by our CSP
- Handle "Informational" sev. SAST flaw (in filelogger): CWE-404: Improper Resource Shutdown or Release
- Monthly NuGet updates October 2023
Bug fixes
- Python: Job's properties is replaced when setting a new property
- Python: Fix ReductionTask scheduling
NuGet/Python package release?
- Yes
Version 8.2 - September 21, 2023
Version 8.2 release of OneCompute focused on various improvements to the Python packages (mainly for use in OneWorkflow), as well as improved worker host logging when running locally (typically through OneWorkflow).
Enhancements
- Python: Refactor Workflow service for enhanced readability and maintainability
- Python: Improve process readiness wait mechanism
- Python: Enhance FileOptions class to support human-readable file sizes
- When running locally, the ConsoleLogger should log timestamps in local time, not UTC time
- Onboard to Veracode SAST scanning - Part 4 (Python)
- Onboard to Veracode SAST scanning - Part 5 (KubernetesJobOrchestrator)
- Handle "Medium" sev. SAST flaw (in Python): CWE-331: Insufficient Entropy
- Upgrade "Bootstrap" JS library from 4.5.0 to 4.5.3 by using new CDN URL, to work around network issues in China
- Monthly NuGet updates September 2023
Bug fixes
- None
NuGet/Python package release?
- Yes
Version 8.1 - August 17, 2023
Version 8.1 release of OneCompute focused on performance improvements and bug fixes in the portal, as well as being the first official release with full Python support (mainly for use in OneWorkflow).
Enhancements
- Support throttling when running locally
- Extend pool grid/details with OS family, "containerized" and VM type
- Update support link in portal footer, as the DNV customer portal has been moved
- Investigate whether a Universal Worker Package model is feasible
- Handle "High" sev. SCA vuln. in "System.Security.Cryptography.Pkcs" NuGet dep. (7.0.0)
- Handle "High" sev. SCA vuln. in "DNVGL.One.Compute.StorageLibrary.SQLite" project, detected through a client project (OneWorkflow)
- Quarterly JavaScript/CSS updates Q3 2023
- Monthly NuGet updates August 2023
- Onboard to Veracode SAST scanning - Part 3 (worker hosts)
Bug fixes
- Home page very slow to load
- Accounting view is extremely slow
- Updating pool start task fails
NuGet/Python package release?
- Yes
Version 8.0 - June 15, 2023
Version 8.0 release of OneCompute focused on changes to Azure Batch pool creation, due to the old pool type being deprecated end of February 2024.
Enhancements
- Monthly NuGet updates June 2023
- Create Windows Marketplace Batch Pool
- In the native auto-refresh access token implementation, explicitly opt out of embedded web view, due to new MSAL default from their 4.52.0 version onward
- Possible hugely improved performance of job status retrieval
- Enable application deployment on demand from the ConsoleWorkItemScheduler
Bug fixes
- My storage environment dropdown not resizing properly on small screens, causing automated UI test to fail
NuGet package release?
- Yes
Version 7.4 - May 19, 2023
Version 7.4 release of OneCompute focused on minor bug fixes.
Enhancements
- Monthly NuGet updates May 2023
- File-based workers need to be able to know the working directory
- Implement IOneComputeClient for the Console WorkerHost + SqlLite storage
- Before upgrading to OneDesign 3.2.x, rename some custom styles to avoid confusion
- Quarterly JavaScript/CSS updates May 2023
- Handle detected SAST "Medium" flaw (in portal): CWE-915: Improperly Controlled Modification of Dynamically-Determined Object Attributes - Part 2 (application package upload)
Bug fixes
- None
NuGet package release?
- No
Version 7.3 - April 20, 2023
Version 7.3 release of OneCompute focused on minor bug fixes.
Enhancements
- Allow Google Translate URLs in content security policy, to avoid effectively being denied access to external CSP violation reporting service due to "spamming" during automated UI testing
- Make the platform client's access token auto-refresh for native flow expose the "ConstructLocalTokenCacheAppPath" method as public, to allow clients to handle multi-user scenarios together with disk-based token cache
- Monthly NuGet updates April 2023
- Turn off CSP reporting for the API's "plain text" endpoints
- Onboard to Veracode SAST scanning - Part 2
Bug fixes
- Fix failure in MultiAccountWorkScheduler to assign to K8s scheduler
- Handle detected SAST "Medium" flaw (in portal): CWE-915: Improperly Controlled Modification of Dynamically-Determined Object Attributes - Part 1
- Web API returns incorrect results when querying for work item properties for a specific work item
- Handle detected SAST "Medium" flaw (in portal): CWE-601: URL Redirection to Untrusted Site ('Open Redirect')
- Handle detected SAST "Medium" flaw (in portal's job details): CWE-80: Improper Neutralization of Script-Related HTML Tags in a Web Page (Basic XSS) (known false positive)
- Improve platform client's response handling for scenario with mismatching authentication configuration
NuGet package release?
- No
Version 7.2 - March 16, 2023
Version 7.2 release of OneCompute focused on improving job scheduling for dynamic workflow and local execution, as well as fixing a few portal bugs.
Enhancements
- Monthly NuGet updates March 2023
- Verify that API token validation handles non-existing signature algorithm
- The in-process work scheduler should assign different working directories for different work units
- Unfortunate conflicting use of WorkUnit.Command
- Migrate DevCore & TestCore environments from ArgoCD to Flux2
- The platform job scheduler should create any message queues for the job
Bug fixes
- Unable to navigate to the results folder in My Storage from the Jobs page for a non-Result Lake job when the work item's job specification uses backslashes in file transfer specification
- Alert shown when pressing "Load Tasks" button in job details page (with many tasks)
- In local workflow execution, a job continues to execute even if JobPreparation is faulted
- Jobs with a single work unit (at the root) fail
NuGet package release?
- Yes
Version 7.1.2 - February 21, 2023
Version 7.1.2 hotfix release of OneCompute focused on bugfixes.
Bug fixes
- Job preparation work is broken for Pipeline product centre (SPH outage analysis application)
NuGet package release?
- No
Version 7.1.1 - February 20, 2023
Version 7.1.1 hotfix release of OneCompute focused on bugfixes.
Bug fixes
- Adding new application package fails on Linux pool
- Change default for platform client native authentication to NOT use embedded web view
NuGet package release?
- Yes
Version 7.1 - February 16, 2023
Version 7.1 release of OneCompute focused on extending the Platform client with a new auto-refresh access token mode and further improvements to the dynamic workflow, as well as improvements to the local execution mode needed in OneWorkflow.
Enhancements
- Standardize the file download path for the various file transfer services
- Create an Agent Kernel
- Tidy up dynamic workflow code and add to OneCompute once Phast code is working
- Monthly NuGet updates February 2023
- Temporarily downgrade the MSAL library to 4.47.2 to avoid runtime error due to .NET 7 incompatibility
- Extend Platform client with auto-refresh of access tokens for interactive login flow
- Onboard to Veracode SAST scanning - Part 1
- Quarterly JavaScript/CSS updates February 2023
- Update OneDesign from 3.0.0 to 3.1.2, incl. updated default fonts
- Make job preparation and release work work across backend types
Bug fixes
- None
NuGet package release?
- Yes
Version 7.0 - January 19, 2023
Version 7.0 release of OneCompute focused on updating the platform to .NET 7 and incremental reductions in dynamic workflows
Enhancements
- Dynamic workflows: Incremental reduction
- Add .NET 7.0 to targets for the worker hosts and remove support for .NET Core 3.1 and .NET 5
- Make a tool to delete data for retired customers
- Specify resource requests and node pool for the Kubernetes backend
- Monthly NuGet updates January 2023
- Update Platform to .NET 7
- Upgrade from .NET Framework 4.6.1 to 4.6.2, as <=4.6.1 will reach end of support in April 2022
Bug fixes
- Can not access storage , only Azure.storage works
NuGet package release?
- Yes
Version 6.4 - December 15, 2022
Version 6.4 release of OneCompute focused on collecting storage consumption per application and adherence to security policies
Enhancements
- Replace "Microsoft.Azure.Management.Fluent" with "Azure.ResourceManager" in Platform - Part 1 & 2
- Fix build error in "PreparationAndReleaseTaskSample" example after upgrading to OC 6.3.0 NuGet packages
- Monthly NuGet updates December 2022
- Register dynamic work unit so that it appears in portal
- Remove the limitation that the cost factor cannot be less than 1
- Security Center recommendation; Enable auditing and logging - Diagnostic logs in [...] should be enabled - Part 2
- Start collecting storage consumption per application
- Provide an example of 'In-process worker host and work item scheduler'
- Adhere to upcoming GSS IT Azure policy: "FTPS should be required in web apps"
- Adhere to upcoming GSS IT Azure policy: "Key Vault secrets should have an expiration date"
- Adhere to upcoming GSS IT Azure policy: "Storage account public access should be disallowed" - Part 2
- Adhere to upcoming GSS IT Azure policy: "Web Application should only be accessible over HTTPS"
- Extend LocalFileTransferService to transfer/copy files between the local directories
- Remove deprecated "Expect-CT" response header
Bug fixes
- Infinite loop of redirects after logging in with 2FA
- Unable to edit application in KubeIT environment
- Unable to obtain a token in the Kubernetes env
NuGet package release?
- No
Version 6.3 - November 17, 2022
Version 6.3 release of OneCompute focused on improvements to the dynamic workflow and security fixes.
Enhancements
- Set WorkItemProperties for workItems added by dynamic workflow
- It should be possible to deserialize a content object wrapped in a WorkUnit or Result as object, without knowing the type
- Adhere to upcoming GSS IT Azure policy: "Key vaults should have soft delete enabled and Key vaults should have purge protection enabled"
- Adhere to upcoming GSS IT Azure policy: "Storage account public access should be disallowed" - Part 1
- Adhere to upcoming GSS IT Azure policy: "TLS should be updated to the latest version for web apps"
- Handle detected "Medium" security vulnerability in "System.Drawing.Common" NuGet dependency (4.7.0)
- Monthly NuGet updates October 2022
- Quarterly JavaScript/CSS updates November 2022
- Monthly NuGet updates November 2022
Bug fixes
- Job Scheduler emits incorrect command when scheduling on a Batch pool with custom VM image
- Infinite loop of redirects after logging in with 2FA
NuGet package release?
- Yes
Version 6.2.1 - October 14, 2022
Version 6.2.1 hotfix release of OneCompute focused on bugfixes.
Bug fixes
- Administration - 400 error and [Change Credit Limit] is not clickable
NuGet package release?
- No
Version 6.2 - October 05, 2022
Version 6.2 release of OneCompute focused Linux pools creation without Docker and phasing out OneAuthorization NuGet package.
Enhancements
- Re-enable creation of Linux pools without Docker
- Phase out the "OneAuthorization" NuGet package
- Fail Azure Batch job if the pool does not exist
Bug fixes
- Cannot access output files from OC portal not working
- File download fails for a .NET 6 Windows client
- Non-portal web services get loads of exceptions logged for MFA
- Production - Can not add Storage Tester in pool
- SignalR web API gets a "B" in the internal security scan due to returning "ASP.NET" in the "X-Powered-By" response header
- Unstable portal and client production westeurope
NuGet package release?
- No
Version 6.1 - September 15, 2022
Version 6.1 release of OneCompute focused on multi-factor authentication on the admin pages.
Enhancements
- Multifactor authentication on admin interfaces - part 2
- Worker host referencing DNVGL.One.Telemetry.Core.ApplicationInsights should issue a warning and carry on rather than failing
- Monthly NuGet updates September 2022
Bug fixes
- Dynamic Workflow creating child tasks with duplicate BatchNumber
- StorageTester dynamic workflow failing tasks
- Workerhost not running with ISendMessage
NuGet package release?
- No
Version 6.0 - August 18, 2022
Version 6.0 release of OneCompute focused on adding dynamic workflows functionality.
Enhancements
- Dynamic workflows: Enable workers to schedule additional work
- Improve ScheduleWorkService behaviour to set required params of Child Tasks
- Roles tab - need to pass MFA to access roles tab
- Monthly NuGet updates July 2022
- Monthly NuGet updates August 2022
Bug fixes
- Insufficient error handling in job scheduler host related to ResultLake caching
- Fix minor styling issues after upgrading to OneDesign 3.0
- Key vault update script fails to retrieve logged in user info and log short secrets
NuGet package release?
- Yes
Version 5.5.2 - August 3, 2022
Version 5.5.2 hotfix release of OneCompute focused on security updates.
Enhancements
- Handle detected "High" vulnerability in "moment" JS dependency (2.29.3)
- Handle detected "Medium" vulnerability in "jquery/validate"/"jquery-validation" JS dependency (1.19.4)
- Handle detected "Medium" vulnerability in "jquery-ui" JS dependency (1.13.1)
NuGet package release?
- No
Version 5.5 - June 16, 2022
Version 5.5(.1) release of OneCompute focused on security and OneDesign updates.
Enhancements
- ASSA: Remove deprecated X-XSS-Protection HTTP response header
- Handle findings from SAST (static code analysis) tool(s)
- Monitor "@microsoft/signalr" JS dependency for updates to its vulnerable "eventsource" transient dependency
- Upgrade ASSA form to latest 6.0 and assess the brand new security controls
- Improve stability on portal production westeurope
- Monthly NuGet updates June 2022
- Review ASSA form to have only supported statuses
- Update OneDesign to 3.0.0
Bug fixes
- MD5 checksum in BLOB may be blank -> filetransfer validation fails
- Windows Server 2019-based pools don't work (reliably) with Cloud Services config
- Application package upload browse button does not work in OneDesign 3.0.0
NuGet package release?
- No
Version 5.4.2 - May 31, 2022
Version 5.4.2 hotfix release of OneCompute focused on security updates.
Enhancements
- Handle detected security vulnerability in "jquery/validate"/"jquery-validation" JS dependency (1.19.3)
- Handle detected security vulnerability in "eventsource" JS dependency (transient dependency)
Bug fixes
- Improved portal front page yields CSP violation for some script
NuGet package release?
- No
Version 5.4 - May 19, 2022
The 5.4 release of OneCompute focused on bugfixes, tech debt and performance improvements.
Enhancements
- Reintroduce logging of the ContainerUrl in a redacted form in the file transfer service
- Improve loading performance of Portal Home page - Part 2
- Upgrade platform services to .NET 6 - Part 3
- In Azure Batch WorkerHost, refactor Result Lake client factory handling to cater for SWiM needs
- Have multiple SRI hashes for JS/CSS dependencies, for improved browser support
- Quarterly JavaScript/CSS updates May 2022
- Monthly NuGet updates May 2022
- Consider using a "JsonSerializer.SerializationBinder" when deserializing, to satisfy SAST tool
Bug fixes
- Application package upload based on Azure DevOps build artifact fails
- Filetransfer fails if subfolder is more than 200 characters on Linux
- Fix missing trace messages in Application Insights for JobScheduler and BackgroundWoker
- Azure Batch worker host unable to handle telemetry client configuration if instrumentation key is missing
NuGet package release?
- Yes
Version 5.3 - April 21, 2022
The 5.3 release of OneCompute focused on bugfixes, security enhancements and upgrades to .NET 6 runtime.
Enhancements
- Update «moment» JavaScript library from 2.29.1 to 2.29.2 to fix security vulnerability reported by Snyk
- Improve loading performance of Portal Home page - Part 1
- Upgrade platform services to .NET 6 - Part 2 (the web API)
- Investigate whether we need to safe-guard against the "node-ipc" npm package situation ("peacenotwar")
Bug fixes
- User jobs are not listed in My Jobs
- Remove logging of long-lived SAS token in BLOB container URLs in file transfer service
NuGet package release?
- Yes
Version 5.2 - March 17, 2022
The 5.2 release of OneCompute focused on bugfixes and security enhancements.
Enhancements
- Should update client-side libraries to latest version
- Upgrade "bootstrap" library used in portal to improve Snyk web test score from "D"
- Update to latest OneDesign 2.8.1
Bug fixes
- Credits for a Job not counted after 7 days
NuGet package release?
- No
Version 5.1 - February 17, 2022
The 5.1 release of OneCompute focused on minor bugfixes.
Enhancements
- Various HTML issues are reported by Edge browser - Part 1
Bug fixes
- Work items with more than 24 hours' duration only displays the time info for the last day
NuGet package release?
- No
Version 5.0 - January 20, 2022
The 5.0 release of OneCompute focused on code cleanup and getting the platform ready for the migration to OneGateway, which will be done as soon as the infrastructure is ready.
The old, regional API endpoints (used prior to the 4.0 release) are now officially deprecated.
NuGet package release?
- Yes
Version 4.6 - December 16, 2021
The 4.6 release of OneCompute focused on security updates and code refactoring.
NuGet package release?
- No
Version 4.5 - November 18, 2021
The 4.5 release of OneCompute focused on minor bugfixes.
Enhancements
- Setup East US 2 deployment
Bug fixes
- Report generation fails when user has only User role and with account which has no tag
- Connection string caching fails to provide fallbacks for non-set environment ID
- Create Linux Pool does not create pool supporting containers
- Getting job properties through platform client yields only minimum date for "CreationTimestamp" property
- Add Tag failed in My Jobs page
NuGet package release?
- Yes
Version 4.4 - October 25, 2021
The 4.4 release of OneCompute focused on Kubernetes backend, improvements to the portal and minor bugfixes.
Enhancements
- Add default version of an application to a pool
- Backend services running on Kubernetes
- Filter jobs by environment or application on Jobs page
- Improve deletion experience
- Show tags in the "Compute: Credits per job" report
Bug fixes
- Job deletion SignalR is sometimes unstable
- Application list is not correct for User role
- File upload from cloud nodes sometimes fails length part of validation
NuGet package release?
- No
Version 4.3.1 - September 29, 2021
The 4.3(.1) release of OneCompute focused on improvements to the portal and minor bugfixes.
Enhancements
- None
Bug fixes
- JobScheduler does not remove the job orchestrator when the job terminates
- Correct title not shown when browsing to subfolder
- Accounting reports for all accounts time out
- Application - Delete: Error Message is not correct when user has no access to delete
- My Storage page shows incorrect Summary Size information
- Other internal bugfixes
NuGet package release?
- Yes
Version 4.2.1 - August 18, 2021
The 4.2(.1) release of OneCompute focused on:
- Improvements to the portal and minor bugfixes
- Re-branding from "DNV GL" to "DNV"
As part of the re-branding, all portal endpoints have changed:
- https://onecompute.dnv.com: Global portal endpoint for the production deployment
- https://develop.onecompute.dnv.com: Global portal endpoint for the client application development deployment
- https://test.onecompute.dnv.com: Global portal endpoint for the client application test deployment
The new global API endpoints are:
- https://onecompute.dnv.com/api: Global API endpoint for the production deployment
- https://develop.onecompute.dnv.com/api: Global API endpoint for the client application development deployment
- https://test.onecompute.dnv.com/api: Global API endpoint for the client application test deployment
The old, regional API endpoints (used prior to the 4.0 release) are kept for compatibility reasons for some time still. The old "@dnvgl.com" endpoints are kept for compatibility reasons for some time still.
Enhancements
- Job and workspace tags
- Provide API to access usage data
- Improve accounting report with field filtering
- Refactoring of multiple batch account handling
- Updating applicable Azure related NuGet packages from SDK v11 "Microsoft.Azure." to SDK v12 "Azure."
Bug fixes
- Newlines in 'notify users' text field are not taken into account in actual email
- No Batch account info in NodeCount, Scale, Restart, Reimage page in Operations
- Missing Batch account name in pool views
- Application access selection shows only 5 rows by default, even though it claims to show 10
- GetJobProperties times out occasionally
- Mixed content error - scripts are requested over HTTP rather than HTTPS
- JS errors on Users' Edit page when run on Linux image in Kubernetes
- Job Details page violates the Content Security Policy
- Missing UI feedback for a Delete Job operation
- Batch account selector doesn't reflect active environment
NuGet package release?
- Yes
Version 4.1 - April 28, 2021
The 4.1 release of OneCompute was a minor servicing release of the OneCompute platform with no package updates. Its main purpose was to add support for the new authentication scheme introduced by Veracity in April 2021 to the OneCompute platform API and portal before the old authentication scheme is deprecated on July 1, 2021.
NuGet package release?
- No
Version 4.0 - February 20, 2021
The 4.0 release of OneCompute focused on:
- Supporting multiple Batch accounts
- Globalization: Integrating the regional deployments into a single, global OneCompute
- Security enhancements
- Audit logging
- Worker communication and control
- Support for .NET 5.0-based workers
OneCompute 4.0 introduces a new concept, the environment. An environment contains the resources needed to execute jobs. Users are assigned a home environment, which corresponds to the region in which they run their jobs and store their files. The home environment of a user can be set through the OneCompute portal by a User Manager. Currently, the develop, test and prod deployments of OneCompute are set up with three environments:
- West Europe
- North Europe
- East US
What previously were three separate deployments of OneCompute have in version 4.0 been converted to environments.
The regional deployments of OneCompute are kept, but they are pooled behind common endpoints:
- https://onecompute.dnvgl.com: Global portal endpoint for the production deployment
- https://develop.onecompute.dnvgl.com: Global portal endpoint for the client application development deployment
- https://test.onecompute.dnvgl.com: Global portal endpoint for the client application test deployment
The new global API endpoints are:
- https://onecompute.dnvgl.com/api: Global API endpoint for the production deployment
- https://develop.onecompute.dnvgl.com/api: Global API endpoint for the client application development deployment
- https://test.onecompute.dnvgl.com/api: Global API endpoint for the client application test deployment
The old, regional API endpoints are kept for compatibility reasons.
Enhancements
- Support multiple Batch accounts (ADO#69264,171934,171933,172912,172914,177692,187727)
- Add .NET 5.0 to the target platforms of WorkerHost.AzureBatch (ADO#242624,242625)
- The Users views must list applications in all Batch accounts (ADO#187727)
- Show the user's home environment on the Home page (ADO#240898)
- Add an environment column to the jobs lists (ADO#240900)
- User Managers should be able to set home environment of users (ADO#186853)
- Assign home environment of a user (ADO#174096)
- Logging of user changes to the audit log (ADO#214645)
- OC does not block job input file upload while user has no storage/credits/access (ADO#151269)
- Add method to retrieve properties for all jobs of the user (ADO#249563)
- Misc. security enhancements (ADO#138334,140294,214081,246940,248611,251690,251691,251898,252639,252698,255442,255443,216243,216521,220325,221154,223140,223156,223157,223163,223182,223407,249677,249819,253128,257421)
- Misc. portal UI enhancements (ADO#171934,245229,258615,260492,215239)
- Add Service Manager to the CPU consumption report (ADO#171526)
- [Result Lake] Reduce number of requests to get access token needed by the worker host (ADO#183924)
- Delete Azure Batch job (ADO#209894)
- Logging of user changes to the audit log (ADO#214645)
- Worker communication and control (ADO#216508,170141,176929,176930)
- Improved background worker logging (ADO#221546)
- Delete pools with the same name from multi-batch-accounts (ADO#242617)
- Should block Result Lake download when user's account storage has expired (ADO#255688)
- The Create Application page should allow creating an application with the same in a different environment (ADO#244356)
Bug fixes
- AccountAdministrationTab: Can not change credit limit (ADO#249783)
- Failure to delete big jobs (ADO#251924)
- When selecting more than 10 jobs for deletion it only deletes 10 (ADO#170630)
- Monitor service event reports wrong workitemId (ADO#185284)
- Unable to remove application from a pool (ADO#212443)
- Selecting jobs is only kept in the active page (ADO#212477)
- Selecting folders or files is only kept in the active page (ADO#212478)
- Portal: Accounting; Inconsistent number formatting across credit and storage reports (ADO#215275)
- "New user" e-mail does not link directly to accept the user (ADO#221270)
- [Background worker] Lacks error handling for sequential work executor execution (ADO#252682)
- UploadFileAsync fails to upload files in sub folders on Windows when targeting .NET Core 3.1 and .NET 5.0 (ADO#252855)
- Email notification issues (ADO#254241)
- Transaction Details fails for users with duplicate membership (UserId) entries (ADO#258105)
- Error in accounting reports after migration of accounting data (ADO#261676)
NuGet package release?
- Yes
Version 3.1 - September 25, 2020
The 3.1 release of OneCompute focused on OneCompute portal enhancements.
Enhancements
- Miscellaneous security-related enhancements to tighten security of the portal and the API (ADO#140290,146348,159347,159349,214097,214107)
- Restrict the number of tasks loaded in the Job Details view
- Storage size calculation enhancements
- Added web API method to delete a specified job (ADO#182140)
- Extend the API with a method to get container URIs for all work items in a given job (ADO#182311)
- Improved UI in MyStorage and MyJobs views (ADO#173036)
- OneDesign alignments
- UI improvements to account management
- Misc. portal UI enhancements (ADO#82427,88166,91954,94991,94995,94997,95957,153322,158304,165453,165879,185424,189601)
- Administration page for Account Administrators (ADO#176223)
- Manually assign account admins to the proper account (ADO#79272)
- Improve the home page load performance (ADO#144310)
- Bulk delete of jobs from OCP portal (ADO#157078)
- Field for Account Administrators to change the credit limit (ADO#160553)
- Allow AccountAdministrators to see the account jobs (ADO#165711)
- Show size of jobs in the My jobs tab (ADO#183649)
- Show size of tasks in the My jobs tab (ADO#187202)
Bug fixes
- Not able to send email notification to users without disabling Javascript
- Not able to delete files or Jobs from Result Lake
- Failure to upload files to Result Lake for long-running work
- AzureBatchWorkScheduler consistently times out for certain big jobs and fails to complete the job (ADO#177808)
NuGet package release?
- Yes
Version 3.0 - April 1, 2020
The 3.0 release of OneCompute focused on enhancements to OneCompute Platform:
- Accounts and consumption control
- Improved consumption reports.
- Result Lake: providing scalable storage of result files
- Miscellaneous usability enhancements to the OneCompute Portal
Changes
All NuGet package references have been upgraded to their latest versions in this release. "Microsoft.WindowsAzure.Storage" has changed to "Microsoft.Azure.Storage.DataMovement" & "Microsoft.Azure.Storage.Blob." As of "Microsoft.Azure.Storage" v9.4 Table API support has been dropped. Table API support is now provided by the "Microsoft.Azure.Cosmos.Table" library. Applications using Azure storage may need to upgrade to these libraries.
There are a few breaking changes to the OneComputePlatformClient. See list of Enhancements below.
Enhancements
- New home page with usage data.
- Provide link from job directly to corresponding storage folder
- Scalable results storage, see Result Lake
- General Portal Improvements
- Implementation of Accounts
- Limit Credit consumption
- Limit Storage access
- Changes to the OC platforms
- Storage usage visible for users
- Extend portal reports and UI to account for consumption limits
- Add transactions into One Compute
- Access to Results Lake output files, see Using the OneCompute Result Lake
- The WorkUnit.Data property was removed. Its usage was to provide access to application input, which now can retrieved by using the WorkUnit.GetInput method.
- The asynchronous methods of OneComputePlatformClient was renamed with the Async postfix to give room for corresponding synchronous methods, in preparation for clients that require synchronous methods.
Bug fixes
- Usage report error when user has no usage
- Portal: "Jobs" table does not show properly
- Unhandled authentication exception for external user
- Portal: Security; Penetration testing vulnerability 2.4.1.1 - W - A2-Broken Authentication and Session Management - Incorrect session management
- Portal: Size sorting is not working properly
- Portal: After "Log out" the user is not logged out nor redirected to home page
- OneCompute portal- Operation: Wrong VM sizes displayed
- Batch: File transfer to node fails occasionally
- Access denied to job details through developer portal
- Portal: Run time is not updated in Jobs view while job is running
- Portal: Applications; Upload fails when package version contains a space
- Exception for a non-VerIT user when accepting terms and conditions in the OCP portal
- Uploading big application package fails with HTTP error code 500
- Exception in JobScheduler when updating work item properties
- Credits are not properly accounted for in a faulted job
- West Europe production portal fails
- Errors experienced by a user that has no jobs or container content.
- Cloud storage navigation fails for users with high storage
- The home page is crashing in the production North-Europe environment.
- Dev+Test Prevent web jobs running on Structure compute portal resources
- Jobs getting stuck in states instead of moving to completed
- CSV report has column header Cost instead of Credits
- The Add-Application page fails to validate form inputs
- Pools listed in Application Default Pool drop down wrong
NuGet package release?
- Yes
Version 2.2.2 - November 24, 2019
This is a patch release of version 2.2.
Changes
- None
Bug fixes
NuGet package release?
- No
Version 2.2.1 - October 14, 2019
This is a patch release of version 2.2.
Changes
- None
Bug fixes
NuGet package release?
- No
Version 2.2 - July 12, 2019
The 2.2 release of OneCompute focused on
- Portal accessibility
- Following up on findings from penetration tests
- Following up on findings from security review
Changes
- None
Enhancements
- Azure Batch should wait for start task to finish
- Make job upload more resilient against network errors
- Implement support for Dockerised worker containers
- Add time zone to 'last activation time' when adding / modifying package.
- Security: Fill out DTC's ASSA (Application Security Self-Assessment) form prior to external penetration test
- PoC: Calling OneCompute API from a service
- Penetration testing follow up
- Security review follow up
- Increase ingress and egress limits for storage accounts
- Remove user storage when removing a user
- Improve input files mechanism to match output files
- Job preparation task
- Job release task
Bug fixes
- The WorkerHost project depends on Azure
- AuthRedirectUri app setting not set in deployment scripts
- Question mark link in header is not working
- JobScheduler crashes when the size of the resource files collection is > 32K
- Account admins not assigned to any account can see all data
- User search box is not available anymore
- Should prevent unauthorized access to blob container
- Access to other users' storage through editing user in portal
- Prevent XSS attack in blob names
- Deleting multiple files from the cloud container fails
- OneCompute Platform API URL is wrong
- User registration fails after adding service principal user
- Sesam regression tests fail due to failure to authenticate the test user
- Job serialization problem
- Data transfer Including filters is picking up all files rather than the filtered
- Prevent worker host service reporting missing optional "ITelemetryClient"
- Delete selected blob storage fails
- Changing default version leads to error message
- Error when nothing is typed for the new application id
- Unable to delete selected content when "sibling", unselected content is present
NuGet package release?
- Yes
Version 2.1 - April 30, 2019
The 2.1 release of OneCompute focused on:
- Consumption reporting in the OneCompute Portal
- Ability to specify default pools for Batch applications
- Enhanced pool management from the OneCompute portal
- Application properties on jobs and work items
Changes
- None
Enhancements
- Application properties for jobs and work items
- Report data storage used per company and per user
- It should be possible for the users to see usage for their account (CPU hours and data storage) per month
- Report 'all companies' should show usage per company
- Accounting Report: Display credits value in the Usage table
- Change "created" status to "waiting to start" or similar
- Specify default pool per application
- Allow updating Terms of Use / Click To Accept without deploying portal
- Create "Company accountant" role
- It should be possible for the users to see usage for their account (Credits) per job
- Provide a dashboard for the user showing the company's usage so far this month, as well as their (company's) consumption limits.
- Portal: Jobs: Bring back show run/simulation time for the job
- Report more details for usage per company
- Add more options to the Operation tab
- Show current status of cloud nodes
- Store and retrieve job information
- Store and retrieve Work Item properties
- Portal: Jobs: Show overview of current and recently completed jobs
- Portal: Jobs: Administrator should be able to view jobs across all users
Bug fixes
- OneComputePlatform test portal: "Show user storage per user" gives server error
- The current consumption .CSV file can not be opened in Excel
- The reduction task of a ParallelWork fails to run in Azure Batch
- Authorization not working in swagger
NuGet package release?
- Yes
Version 2.0 - February 13, 2019
The 2.0 release of OneCompute focused on:
- Establishing OneCompute Platform, a shared, scalable compute service running in Azure.
- Increasing scalability and robustness of OneCompute components.
Features of OneCompute Platform
- OneCompute API with secure access through Veracity
- Schedule jobs for execution
- Monitor job execution
- Get job status and progress
- Provide secure access to a private blob container for every user
- OneCompute Portal with secure login through Veracity and role based security
- Every user can browse their own blob container and download files through the OneCompute Portal
- Every user can list their jobs
- Every user can get a consumption report
- Accountants can get consumption reports for companies and users
- Operators can manage compute pools
- Application Owners can manage applications
- User Managers can manage user access to applications
Changes
- None
Enhancements
- Orchestration options on Job for error handling - Implementation Azure batch and console
- Extend WorkItem with description
- Allow jobs to run to completion even if one or more of the work units fail
- Get work items without deserializing json content
- Graceful shutdown and restart of Job Scheduler web job
- Application ownership implementation
- Assign the job to the pool
- Add ability to delete application packages in OneCompute portal
- Only send activation emails to user management role
- Create a user management role
- Also send activation emails to a specified additional non-user email address
- Remove multiple workspace at once
- Add async bulk insert method to AzureStorageTableHelper
- Allow files to be excluded from file upload after the work unit completes
- BlobStorageFileTransferService should invoke events on the original thread
- Accounting reports should report consumption in the form of credits used, not Core-hours
- Show credits for old jobs
- Store CPU consumption for on-going jobs, not just per finished job
- Application Owner can edit credit per consumption unit for an application
- Operator can edit CPU cost factor on a pool
- Aggregation of consumption and credits per job
- List jobs per user
Bug fixes
- Cancelling an Azure Batch job does not work
- Job occasionally fails to complete even if all work units are completed
- Exception while monitoring Batch tasks terminates job
- The OneCompute storage connection string is exposed in the console output from the WorkerHost
- BlobFileTransferService fails to transfer files at high loads
- File transfer occasionally hangs when running at high load
- Unclear error message when trying to run in cloud without account
- Make AzureBatchWorkItemScheduler more resilient when scheduling a large job
- Status updates are lost in the WorkerExecutor
- When Azure Batch fails to run a CloudTask, the error information is not stored in the work item status table
- Fix Azure application package deployment script
- Job scheduling: Input files with space are not copied to compute node
- Task that fails to upload all files to cloud storage should fail
- Count time during copying files to Storage as part of task duration
NuGet package release?
- Yes
Version 1.2.2 - June 30, 2018
This is a patch release of version 1.2.
Changes
- None
Bug fixes
- Aggregate CPU time as long
- WorkUnit is completed before files are uploaded and result stored
- Log the Job.ServiceName to the JobStatus record
- Add a PoolId property on the job to allow the client to choose backend pool to run on
- When a work unit fails, the file transfer is cancelled
- Log which pool is used
NuGet package release?
- No
Version 1.2.1 - April 5, 2018
This is a patch release of version 1.2.
Changes
- None
Enhancements
NuGet package release?
- Yes
Version 1.2 - March 30, 2018
The 1.2 release focused on:
- Fixing defects
- Minor enhancements
- Enhancing the production environment of OneCompute
- Adding automatic regression testing of the supported back-ends
- Automatic build of examples and VSIX projects
- Standardizing on .NET Standard 2.0
- Standardizing on the new C# project format that simplifies NuGet packaging and avoids package dependency inconsistencies
Changes
- None
Enhancements
- Scheduling a job with no user Id specified should throw a descriptive exception
- Reading job status for a non-existing job should return null
- Upgrade solution to .NET Standard
- Update third party NuGet dependencies to latest versions
- Correlate Azure Batch job id with 1C job id
- Support custom Azure Batch Worker Hosts
- Azure Batch Deployment Tools
- Allow user identities which are not email addresses. This enables an application to replace the default user id validator, which requires the user id to be a valid email address, with an alternative id validator. The application may provide a custom validator. OneCompute 1.2 provides a GUID validator, which requires the user id to be a GUID.
Bug fixes
- BlobStorageFileTransferService generates incorrect blob names
- Job with WorkUnit that fails is recorded with status = Completed. Should be Faulted
NuGet package release?
- Yes
Version 1.1.1 - February 5, 2018
This is a patch (bug fix release of version 1.1).
Changes
NuGet package release?
- Yes
Version 1.1 - November 22, 2017
This was the initial release of OneCompute.
NuGet package release?
- Yes