Skip to content

Conversation

@icaoberg
Copy link


name: Brain Image Library analysis ecosystem
about: A new cluster config

Followed the steps to add a new cluster config for the [Brain Image Library Analysis Ecosystem].(https://www.brainimagelibrary.org/)

  • Add your custom config file to the conf/ directory
  • Add your documentation file to the docs/ directory
  • Add your custom profile to the nfcore_custom.config file in the top-level directory
  • Add your custom profile to the README.md file in the top-level directory
  • Add your profile name to the profile: scope in .github/workflows/main.yml
  • OPTIONAL: Add your custom profile path and GitHub user name to .github/CODEOWNERS (**/<custom-profile>** @<github-username>)

@icaoberg icaoberg changed the title [WIP] Brain Image Library cluster profile Brain Image Library cluster profile Apr 15, 2025
@icaoberg icaoberg changed the title Brain Image Library cluster profile Add the Brain Image Library (BIL) cluster profile Apr 15, 2025
@icaoberg icaoberg changed the title Add the Brain Image Library (BIL) cluster profile [WIP] Add the Brain Image Library (BIL) cluster profile Apr 15, 2025
// Profiles
// ─────────────────────────────────────────────────────────────────────────────
profiles {
compute {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I this a reason why this is a separate profile - given you have a single entry?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we have multiple partitions but only adding the public at the moment.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see - however you don't need a specific profile for a specific partition - you can tell Nextflow to dynamically pick the queue based on whatever variables you want to use rather than having to explicitly request it.

So I would move everything in this profile into the base config, and when you need to add additional partitions we can update the profile to be dynamic.

}
}
}

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You may want to consider the cleanup option: https://www.nextflow.io/docs/latest/reference/config.html#unscoped-options to reduce HDD space after successful completion.

icaoberg and others added 5 commits April 18, 2025 14:10
Co-authored-by: James A. Fellows Yates <[email protected]>
Co-authored-by: James A. Fellows Yates <[email protected]>
Fixed typo. Named profile correctly.

Co-authored-by: James A. Fellows Yates <[email protected]>
@icaoberg icaoberg changed the title [WIP] Add the Brain Image Library (BIL) cluster profile Add the Brain Image Library (BIL) cluster profile Apr 29, 2025
@icaoberg icaoberg changed the title Add the Brain Image Library (BIL) cluster profile [WIP] Add the Brain Image Library (BIL) cluster profile Apr 29, 2025
@jfy133
Copy link
Member

jfy133 commented Apr 30, 2025

Feel free to request a re-review when you're ready @icaoberg

@jfy133
Copy link
Member

jfy133 commented Jun 18, 2025

@icaoberg any progress on this?

@icaoberg icaoberg requested a review from jfy133 September 4, 2025 13:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants