Skip to content

rust_arroyo: transform_and_produce example panics #400

@loewenheim

Description

@loewenheim
Contributor

Environment

Current master, i.e. getsentry/snuba@fa3cf88.

Steps to Reproduce

 cargo run --example transform_and_produce

Expected Result

The example would run without panicking.

Actual Result

running processor. transforming from test_in to test_out
thread 'main' panicked at rust_arroyo/examples/transform_and_produce.rs:87:21:
called `Result::unwrap()` on an `Err` value: PollError
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

Activity

untitaker

untitaker commented on Nov 15, 2023

@untitaker
Member

I think this might be because of something basic like either the topic not existing, or the consumer group not having a pre-existing offset.

loewenheim

loewenheim commented on Nov 15, 2023

@loewenheim
ContributorAuthor

The base_processor example also produces errors, although they're not visible unless you add some logging:

2023-11-15T11:48:59.002530Z ERROR rdkafka::client: librdkafka: Global error: UnknownTopicOrPartition (Broker: Unknown topic or partition): Subscribed topic not available: test_static: Broker: Unknown topic or partition    
2023-11-15T11:48:59.002648Z ERROR rust_arroyo::processing: poll error error=Message consumption error: UnknownTopicOrPartition (Broker: Unknown topic or partition)
untitaker

untitaker commented on Nov 15, 2023

@untitaker
Member

i guess we should mostly fix this to not throw away the inner error information: https://github.com/getsentry/snuba/blob/c821f741fdd03d41dcdb725e0c95c7d41deea7aa/rust_snuba/rust_arroyo/src/processing/mod.rs#L185-L188

and have perhaps some docs on how to create topics?

self-assigned this
on Sep 13, 2024
transferred this issue fromgetsentry/snubaon Dec 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

    Development

    No branches or pull requests

      Participants

      @untitaker@mcannizz@loewenheim

      Issue actions

        rust_arroyo: transform_and_produce example panics · Issue #400 · getsentry/arroyo