Skip to content

Parquet test isn't properly failing #88

@visch

Description

@visch

This should cause the test to fail when at this commit f651c45

meltano lock --update --all 
meltano install
meltano config tap-universal-file set file_type parquet
meltano config tap-universal-file set parquet_type_coercion_strategy envelope
meltano config tap-universal-file set file_type file_regex "^.*racing\\.parquet$"
meltano invoke tap-unviersal-file

I get the error

tap-universal-file-py3.10visch@DESKTOP-9BDPA9T:~/git/tap-universal-file$ meltano invoke tap-universal-file
2024-07-02T16:33:13.485002Z [info     ] Environment 'test' is active  
Need help fixing this problem? Visit http://melta.no/ for troubleshooting steps, or to
join our friendly Slack community.

Catalog discovery failed: command ['/home/visch/git/tap-universal-file/.meltano/extractors/tap-universal-file/venv/bin/tap-universal-file', '--config', '/home/visch/git/tap-universal-file/.meltano/run/tap-universal-file/tap.8127f8c9-7a4d-45cc-991f-21b171619874.config.json', '--discover'] returned 1 with stderr:
 
A module that was compiled using NumPy 1.x cannot be run in
NumPy 2.0.0 as it may crash. To support both 1.x and 2.x
versions of NumPy, modules must be compiled with NumPy 2.0.
Some module may need to rebuild instead e.g. with 'pybind11>=2.12'.

If you are a user of the module, the easiest solution will be to
downgrade to 'numpy<2' or try to upgrade the affected module.
We expect that some modules will need time to support NumPy 2.

Traceback (most recent call last):  File "/home/visch/git/tap-universal-file/.meltano/extractors/tap-universal-file/venv/bin/tap-universal-file", line 5, in <module>
    from tap_universal_file.tap import TapUniversalFile
  File "/home/visch/git/tap-universal-file/tap_universal_file/tap.py", line 19, in <module>
    from tap_universal_file import streams
  File "/home/visch/git/tap-universal-file/tap_universal_file/streams.py", line 15, in <module>
    import pyarrow as pa
  File "/home/visch/git/tap-universal-file/.meltano/extractors/tap-universal-file/venv/lib/python3.10/site-packages/pyarrow/__init__.py", line 65, in <module>
    import pyarrow.lib as _lib
AttributeError: _ARRAY_API not found
Traceback (most recent call last):
  File "/home/visch/git/tap-universal-file/.meltano/extractors/tap-universal-file/venv/bin/tap-universal-file", line 5, in <module>
    from tap_universal_file.tap import TapUniversalFile
  File "/home/visch/git/tap-universal-file/tap_universal_file/tap.py", line 19, in <module>
    from tap_universal_file import streams
  File "/home/visch/git/tap-universal-file/tap_universal_file/streams.py", line 15, in <module>
    import pyarrow as pa
  File "/home/visch/git/tap-universal-file/.meltano/extractors/tap-universal-file/venv/lib/python3.10/site-packages/pyarrow/__init__.py", line 65, in <module>
    import pyarrow.lib as _lib
  File "pyarrow/lib.pyx", line 36, in init pyarrow.lib
ImportError: numpy.core.multiarray failed to import

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions