Skip to content

Conversation

@olachinkei
Copy link
Collaborator

Summary

  • Add a self-contained tool (scripts/copy_leaderboard/) for copying the Nejumi Leaderboard to a user's own W&B environment
  • Migrate runs with metrics, summaries, and table artifacts as wandb.Table
  • Create leaderboard report in destination
  • Support incremental updates via start_date option
  • YAML-based configuration with example config

Usage

cd scripts/copy_leaderboard
uv sync

# Set API keys
export WANDB_SRC_API_KEY="your-source-api-key"
export WANDB_DST_API_KEY="your-destination-api-key"

# Run full migration
uv run python copy_leaderboard.py -c config.yaml full-migration

Test plan

  • Tested migration of 5 runs with tables to https://fe-crew.wandb.io
  • Verified tables are visible in destination
  • Report creation works

…ironment

Add a self-contained tool for copying the Nejumi Leaderboard (runs, tables, and reports)
to a user's own W&B environment.

Features:
- Migrate runs with metrics, summaries, and table artifacts
- Create leaderboard report in destination
- Support incremental updates via start_date
- YAML-based configuration with example config
@socket-security
Copy link

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff Package Supply Chain
Security
Vulnerability Quality Maintenance License
Addedwandb@​0.24.075100100100100
Addedpolars@​1.37.192100100100100
Addedclick@​8.3.196100100100100
Addedrequests@​2.32.599100100100100
Addedpydantic@​2.12.5100100100100100
Addedpyyaml@​6.0.3100100100100100

View full report

@socket-security
Copy link

Warning

Review the following alerts detected in dependencies.

According to your organization's Security Policy, it is recommended to resolve "Warn" alerts. Learn more about Socket for GitHub.

Action Severity Alert  (click "▶" to expand/collapse)
Warn High
License policy violation: pypi charset-normalizer under CC-BY-SA-3.0

License: CC-BY-SA-3.0 - the applicable license policy does not allow this license (4) (charset_normalizer-3.4.4/data/NOTICE.md)

From: ?pypi/[email protected]pypi/[email protected]pypi/[email protected]

ℹ Read more on: This package | This alert | What is a license policy violation?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at [email protected].

Suggestion: Find a package that does not violate your license policy or adjust your policy to allow this package's license.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore pypi/[email protected]. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn High
License policy violation: pypi wandb

License: FSFAP-no-warranty-disclaimer - the applicable license policy does not allow this license (4) (wandb-0.24.0/core/vendor/github.com/apache/thrift/LICENSE)

License: Apache-2.0 WITH LLVM-exception - the applicable license policy does not allow this license exception (wandb-0.24.0/core/vendor/github.com/apache/arrow-go/v18/LICENSE.txt)

From: scripts/copy_leaderboard/uv.lockpypi/[email protected]

ℹ Read more on: This package | This alert | What is a license policy violation?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at [email protected].

Suggestion: Find a package that does not violate your license policy or adjust your policy to allow this package's license.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore pypi/[email protected]. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn Medium
Native binaries present: pypi polars-runtime-32

Location: Package overview

From: ?pypi/[email protected]pypi/[email protected]

ℹ Read more on: This package | This alert | Why is native code a concern?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at [email protected].

Suggestion: Verify that the inclusion of native code is expected and necessary for this package's functionality. If it is unnecessary or unexpected, consider using alternative packages without native code to mitigate potential risks.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore pypi/[email protected]. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn Medium
Install-time scripts: pypi polars-runtime-32

Install script: Package overview

Source: undefined

From: ?pypi/[email protected]pypi/[email protected]

ℹ Read more on: This package | This alert | What is an install script?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at [email protected].

Suggestion: Packages should not be running non-essential scripts during install and there are often solutions to problems people solve with install scripts that can be run at publish time instead.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore pypi/[email protected]. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn Medium
Native binaries present: pypi tomli

Location: Package overview

From: ?pypi/[email protected]

ℹ Read more on: This package | This alert | Why is native code a concern?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at [email protected].

Suggestion: Verify that the inclusion of native code is expected and necessary for this package's functionality. If it is unnecessary or unexpected, consider using alternative packages without native code to mitigate potential risks.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore pypi/[email protected]. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

View full report

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants