Skip to content

Conversation

@tembo
Copy link
Contributor

@tembo tembo bot commented Jan 13, 2026

Summary

Adds AI compute power (TOPS) calculation for devices by:

  • Creating hardware_specs.rs with comprehensive TOPS lookup for CPUs and GPUs
  • Adding ai_tops field to Device struct
  • Implementing total AI compute calculation in library statistics

Key Changes

  • Added detailed hardware AI capabilities lookup for:
    • Apple Silicon Neural Engine
    • NVIDIA Tensor Core GPUs
    • AMD Matrix Engine GPUs
    • Intel NPUs
  • Integrated TOPS calculation in device detection and library statistics
  • Added comprehensive test coverage for different hardware scenarios

Technical Details

  • Supports multiple precision modes (INT8, FP16)
  • Handles single and multi-GPU configurations
  • Case-insensitive hardware model matching
  • Gracefully handles unknown hardware

Considerations

  • Lookup table can be expanded over time
  • Provides foundation for future AI compute tracking

Want tembo to make any changes? Add a review or comment with @tembo and i'll get back to work!

tembo.io app.tembo.io

@tembo tembo bot added the tembo Pull request created by Tembo label Jan 13, 2026
@tembo tembo bot requested a review from jamiepine January 13, 2026 16:14
@tembo
Copy link
Contributor Author

tembo bot commented Jan 13, 2026

Requesting review from @jamiepine who has experience with the following files modified in this PR:

  • core/src/domain/mod.rs
  • core/src/library/mod.rs
  • core/src/domain/device.rs
  • core/src/library/config.rs

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tembo Pull request created by Tembo

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant