Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create LearnerTorchFTTransformer #338

Open
sebffischer opened this issue Jan 24, 2025 · 0 comments
Open

Create LearnerTorchFTTransformer #338

sebffischer opened this issue Jan 24, 2025 · 0 comments

Comments

@sebffischer
Copy link
Member

sebffischer commented Jan 24, 2025

Before implementing the learner. Just build it as a Graph.
The graph consists of:

  1. Two input nodes (one for tokenization of categoricals, one for numerics). Need to maybe handle what happens when only numerics or only categoricals exist, but ignore for now.
  2. Apply the Categorical encoder to categorical inputs, numeric encoder to numerical inputs.
  3. A Merge PipeOp that combines the categoricals and numerics
  4. A PipeOpTorchBlock that takes in the PipeOpTorch that represents a single transformer block (the PipeOpTorchBlock is responsible for repeating it multiple times
  5. Build the output head using existing PipeOpTorch.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant