Skip to content

Data isn't parsed from S3 Source if the file has more than one record #725

@uchennakevinm1

Description

@uchennakevinm1

Data isn't parsed from S3 Source if the file has more than one record
Example data:
an example of the file with which data is transferred
{"id": 44, "name": "Bob"}
an example of the file with which data isn't transferred
{"id": 44, "name": "Bob"}
{"id": 45, "name": "Alex"}

Logs: 2022-05-09T09:28:09+00:00 ERR node stopped error="node 61381064-cf71-47d9-8c93-9a1e0d6c5415-acker stopped with error: error receiving ack: failed to get payload: failed to unmarshal data into structured data: invalid character '{' after top-level value" component=pipeline.Service node_id=61381064-cf71-47d9-8c93-9a1e0d6c5415-acker stack=[{"file":"/Users/serhii/conduit/pkg/pipeline/lifecycle.go","func":"github.com/conduitio/conduit/pkg/pipeline.(*Service.runPipeline.func1","line":387},{"file":"/Users/serhii/conduit/pkg/connector/destination.go","func":"github.com/conduitio/conduit/pkg/connector.(*destination.Ack","line":194},{"file":"/Users/serhii/conduit/pkg/plugin/standalone/v1/destination.go","func":"github.com/conduitio/conduit/pkg/plugin/standalone/v1.(*destinationPluginClient.Ack","line":120}]

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions