Skip to content

fix!: hardcode machine image to batch-cos instead of batch-debian#10

Closed
SophiaPerzan-DG wants to merge 8 commits intodg-cifrom
tinf-4-revert-batch-debian-hardcode
Closed

fix!: hardcode machine image to batch-cos instead of batch-debian#10
SophiaPerzan-DG wants to merge 8 commits intodg-cifrom
tinf-4-revert-batch-debian-hardcode

Conversation

@SophiaPerzan-DG
Copy link
Copy Markdown
Collaborator

No description provided.

javiergaitan and others added 8 commits June 4, 2025 10:49
…e backend (#1)

* WX-1810 WX-1830 n1/n2/n2d machine types, cpuPlatform on GCPBATCH (broadinstitute#7518)
* feat: [GCP Batch] Support passing standard machine types to the Google backend

---------

Co-authored-by: Miguel Covarrubias <mcovarr@users.noreply.github.com>
@ Conflicts:
@	CHANGELOG.md
@	supportedBackends/google/batch/src/main/scala/cromwell/backend/google/batch/api/GcpBatchRequestFactoryImpl.scala
@	supportedBackends/google/batch/src/main/scala/cromwell/backend/google/batch/models/GcpBatchRuntimeAttributes.scala
@	supportedBackends/google/batch/src/main/scala/cromwell/backend/google/batch/util/GcpBatchMachineConstraints.scala
@	supportedBackends/google/batch/src/test/scala/cromwell/backend/google/batch/models/GcpBatchRuntimeAttributesSpec.scala
@	supportedBackends/google/batch/src/test/scala/cromwell/backend/google/batch/util/GcpBatchMachineConstraintsSpec.scala
must be done ahead of skipping tests
also: make github actions pass

- BROADBOT_GITHUB_TOKEN => GITHUB_TOKEN
- broadbot => dg bot
- remove workflow that updates helm chart we don't use
- update upstream where applicable
- fix formatting with sbt scalafmtAll
- skip unit tests that require azure auth
in order to support using pynvml without blowing up the size
of the monitoring docker image, tasks need to run on the non-default
batch-debian vm image. This makes google batch set up the nvidia
drivers on the vm and mount them to the container instead of
relying on the drivers being installed on the monitor image.

An added benefit is reduced docker image sizes for all tasks
that require a gpu.

also: fix gh actions syntax error
deleted test "return Github import auth provider when Azure auth is enabled"
@SophiaPerzan-DG SophiaPerzan-DG requested a review from ovesh December 2, 2025 22:07
@ovesh
Copy link
Copy Markdown

ovesh commented Dec 3, 2025

Try rebasing on latest upstream to fix the github actions?

} else {
Disk.newBuilder
}
disk.setImage("batch-debian")
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was done to support #8 (see PR description). Need to be careful with unintended side effects of reverting that change.

Looking at the code above, you can get a similar effect by explicitly specifying batch-cos as the boot disk in the task's runtime attributes.

@SophiaPerzan-DG
Copy link
Copy Markdown
Collaborator Author

Superseded by #11

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants