Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Embulk freezes when I specify where condition #177

Open
OmkarPathak opened this issue Mar 6, 2020 · 4 comments
Open

Embulk freezes when I specify where condition #177

OmkarPathak opened this issue Mar 6, 2020 · 4 comments

Comments

@OmkarPathak
Copy link

OmkarPathak commented Mar 6, 2020

Hi team,

I am using embulk-input-oracle for fetching data. This works fine when I write query without any WHERE clause. But when I specify a WHERE clause it just freezes.

This is the config we are using:

in:
  type: oracle
  driver_path: ojdbc7-12.1.0.2.jar
  url: jdbc:oracle:thin:@something.com:1526/DB
  user: ABC
  password: "PASSWORD"
  query: "SELECT * FROM SCHEMA.TABLE WHERE ABC_DATE > to_date('01 JAN 2019','DD MON YY')"
  fetch_rows: 20000
  connect_timeout: 100

Is there any flag to be set for this to work?

@hiroyuki-sato
Copy link
Member

Hello, @OmkarPathak

  • How many records do you use?
  • Have you ever tried the same SQL with PL/SQL? (without embulk)

I suspect that SQL doesn't use the index properly.

You can run more verbosely using embulk run -l debug config.yml

@OmkarPathak
Copy link
Author

OmkarPathak commented Mar 6, 2020

@hiroyuki-sato yes the same query works well in oracle sql.
Also tried running verbosely, but it still freezes and no output is generated at sysout (also no error is displayed, and program doesn't exit either)

@hiroyuki-sato
Copy link
Member

Hello, @OmkarPathak

  • How about embulk preview?
  • How about increase memory like embulk -J-Xmx10g run config.yml (-J option must set before run)

@hito4t
Copy link
Contributor

hito4t commented Mar 11, 2020

Hi @OmkarPathak
Would you show the log until embulk freezes?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

3 participants