Skip to content

BigQuery - Allow jagged rows #358

@moseleyi

Description

@moseleyi

Describe the bug

When loading data from GCS, I would like to use other options like described here: https://cloud.google.com/bigquery/docs/loading-data-cloud-storage-csv
One of them is ``--allow-jagged_rows`

However adding this to yml produces an error:

Encountered an error while running operation: Database Error
  Option allow_jagged_rows value has type INT64 which cannot be coerced to expected type BOOL at 

Steps to reproduce

Add following options to a GCS external table:

options:
  format: csv
  skip_leading_rows: 1
  allow_jagged_rows: true

Expected results

The external table to be created

Actual results

Error

Screenshots and log output

Image

System information

packages:
  - package: dbt-labs/dbt_external_tables
    version: 0.11.1

Which database are you using dbt with?

  • bigquery

The output of dbt --version:

Core:
  - installed: 1.10.1
  - latest:    1.10.1 - Up to date!

Plugins:
  - bigquery:  1.9.2 - Up to date!
  - postgres:  1.9.0 - Up to date!
  - redshift:  1.9.5 - Up to date!
  - snowflake: 1.9.4 - Up to date!

The operating system you're using:
Windows 11 Pro

The output of python --version:
Python 3.12.3

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingtriage

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions