Deploy->Kubernetes->Yarn is failing #210

monojit18 · 2022-10-04T05:43:07Z

monojit18
Oct 4, 2022

Branch/Tag: release-4.10.1_RC1

Deploy->Kubernetes->Yarn is failing with the following error:

Started by user AdminCopy
Checking out git https://github.com/project-sunbird/sunbird-devops.git into /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn@script/c4fe951fa600823acbc5bfd42b2e86f254b19077cb5da3c34e45f46a40859550 to read pipelines/deploy/yarn/Jenkinsfile
The recommended git tool is: NONE
No credentials specified

git rev-parse --resolve-git-dir /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn@script/c4fe951fa600823acbc5bfd42b2e86f254b19077cb5da3c34e45f46a40859550/.git # timeout=10
Fetching changes from the remote Git repository
git config remote.origin.url https://github.com/project-sunbird/sunbird-devops.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/project-sunbird/sunbird-devops.git
git --version # timeout=10
git --version # 'git version 2.17.1'
git fetch --tags --progress --depth=1 -- https://github.com/project-sunbird/sunbird-devops.git +refs/heads/:refs/remotes/origin/ # timeout=10
git rev-parse origin/release-4.6.0_RC4^{commit} # timeout=10
git rev-parse release-4.6.0_RC4^{commit} # timeout=10
Checking out Revision 298c0e0cb57f5d8fa32bbc3676ae57c6c2127a6f (release-4.6.0_RC4)
git config core.sparsecheckout # timeout=10
git checkout -f 298c0e0cb57f5d8fa32bbc3676ae57c6c2127a6f # timeout=10
Commit message: "Issue #SB-28497 feat:updated enrollment list size env (#3180)"
First time build. Skipping changelog.
Loading library deploy-conf@heads/shared-lib
Attempting to resolve heads/shared-lib from remote references...
git --version # timeout=10
git --version # 'git version 2.17.1'
git ls-remote -- https://github.com/project-sunbird/sunbird-devops.git # timeout=10
The recommended git tool is: NONE
No credentials specified
git rev-parse --resolve-git-dir /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn@libs/c52531edb7fdb9b8dbe725c4c94c86be8730335d19b6061a918ce6459cf3f9e8/.git # timeout=10
Fetching changes from the remote Git repository
git config remote.origin.url https://github.com/project-sunbird/sunbird-devops.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/project-sunbird/sunbird-devops.git
git --version # timeout=10
git --version # 'git version 2.17.1'
git fetch --no-tags --progress --depth=1 -- https://github.com/project-sunbird/sunbird-devops.git +refs/heads/:refs/remotes/origin/ refs/heads/shared-lib # timeout=10
Checking out Revision 778da7ce7f97efd003eed98071921a837d209343 (778da7ce7f97efd003eed98071921a837d209343)
git config core.sparsecheckout # timeout=10
git checkout -f 778da7ce7f97efd003eed98071921a837d209343 # timeout=10
Commit message: "fix: move variables to be accessible across both try blocks"
git rev-list --no-walk 778da7ce7f97efd003eed98071921a837d209343 # timeout=10
[Pipeline] Start of Pipeline
[Pipeline] node
Running on Jenkins in /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn
[Pipeline] {
[Pipeline] stage
[Pipeline] { (checkout public repo)
[Pipeline] echo
Found .git folder. Clearing it..
[Pipeline] sh

git clean -fxd
Removing ansible/.samza_deploy.yml.swp
Removing ansible/distribution-1.0-SNAPSHOT-distribution.tar.gz
Removing ansible/inventory/env/hosts
Removing ansible/inventory/env/secrets.yml
Removing ansible/roles/samza-jobs/defaults/allfiles/
Removing ansible/roles/samza-jobs/defaults/jobs/
Removing lms_artifacts.zip:release-3.7.0_RC1
Removing metadata.json
Skipping repository private/
Removing private@tmp/
[Pipeline] checkout
The recommended git tool is: NONE
No credentials specified

git rev-parse --resolve-git-dir /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/.git # timeout=10
Fetching changes from the remote Git repository
git config remote.origin.url https://github.com/project-sunbird/sunbird-devops.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/project-sunbird/sunbird-devops.git
git --version # timeout=10
git --version # 'git version 2.17.1'
git fetch --tags --progress --depth=1 -- https://github.com/project-sunbird/sunbird-devops.git +refs/heads/:refs/remotes/origin/ # timeout=10
git rev-parse origin/release-4.6.0_RC4^{commit} # timeout=10
git rev-parse release-4.6.0_RC4^{commit} # timeout=10
Checking out Revision 298c0e0cb57f5d8fa32bbc3676ae57c6c2127a6f (release-4.6.0_RC4)
git config core.sparsecheckout # timeout=10
git checkout -f 298c0e0cb57f5d8fa32bbc3676ae57c6c2127a6f # timeout=10
Commit message: "Issue #SB-28497 feat:updated enrollment list size env (#3180)"
[Pipeline] }
[Pipeline] // stage
[Pipeline] ansiColor
[Pipeline] {

[Pipeline] ansiColor
[Pipeline] {

[Pipeline] sh

echo Deploy/dev/Kubernetes/Yarn
[Pipeline] sh
echo Deploy/dev/Kubernetes/Yarn
[Pipeline] sh
echo Deploy/dev/Kubernetes/Yarn
[Pipeline] stage
[Pipeline] { (parameter checks)
[Pipeline] copyArtifacts
Copied 2 artifacts from "ArtifactUpload » dev » Core » Yarn" build number 1
[Pipeline] sh
jq -r .artifact_name metadata.json
[Pipeline] sh
jq -r .node_name metadata.json
[Pipeline] echo
artifact_version not specified, using the artifact_version specified in metadata.json.
[Pipeline] sh
jq -r .artifact_version metadata.json
[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] stage
[Pipeline] { (get artifact)
[Pipeline] sh

pwd
[Pipeline] ansiColor
[Pipeline] {

[Pipeline] echo
Option chosen is JenkinsJob, using the artifacts copied
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (deploy artifact)
[Pipeline] sh

unzip lms_artifacts.zip:release-3.7.0_RC1
Archive: lms_artifacts.zip:release-3.7.0_RC1
inflating: distribution-1.0-SNAPSHOT-distribution.tar.gz
mv distribution-1.0-SNAPSHOT-distribution.tar.gz ansible
rm -rf ansible/roles/samza-jobs/defaults/jobs
mkdir ansible/roles/samza-jobs/defaults/jobs ansible/roles/samza-jobs/defaults/allfiles
chmod 777 ansible/roles/samza-jobs/defaults/jobs
tar -xvf ansible/distribution-1.0-SNAPSHOT-distribution.tar.gz -C ansible/roles/samza-jobs/defaults/allfiles/
notification-job-0.0.1-distribution.tar.gz
[Pipeline] echo
{env=dev, module=Kubernetes, jobName=Yarn, absolute_job_path=ArtifactUpload/dev/Core/Yarn, agent=master, artifact_name=lms_artifacts.zip, artifact_version=release-3.7.0_RC1, currentWs=/var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn, artifact=lms_artifacts.zip:release-3.7.0_RC1, ansiblePlaybook=/var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/ansible/samza_deploy.yml, ansibleExtraArgs=--extra-vars "job_names_to_kill=null job_workspace=/var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/ansible" --vault-password-file /var/lib/jenkins/secrets/vault-pass}
[Pipeline] ansiColor
[Pipeline] {

[Pipeline] stage
[Pipeline] { (ansible-run)
[Pipeline] echo
{env=dev, module=Kubernetes, jobName=Yarn, absolute_job_path=ArtifactUpload/dev/Core/Yarn, agent=master, artifact_name=lms_artifacts.zip, artifact_version=release-3.7.0_RC1, currentWs=/var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn, artifact=lms_artifacts.zip:release-3.7.0_RC1, ansiblePlaybook=/var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/ansible/samza_deploy.yml, ansibleExtraArgs=--extra-vars "job_names_to_kill=null job_workspace=/var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/ansible" --vault-password-file /var/lib/jenkins/secrets/vault-pass}
[Pipeline] dir
Running in /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/private
[Pipeline] {
[Pipeline] echo
Info: Branch override is disabled
[Pipeline] checkout
The recommended git tool is: NONE
using credential github-cred

git rev-parse --resolve-git-dir /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/private/.git # timeout=10
Fetching changes from the remote Git repository
git config remote.origin.url https://github.com/monojit18/ansible-copy.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/monojit18/ansible-copy.git
git --version # timeout=10
git --version # 'git version 2.17.1'
using GIT_ASKPASS to set credentials
git fetch --no-tags --progress --depth=1 -- https://github.com/monojit18/ansible-copy.git +refs/heads/:refs/remotes/origin/ # timeout=10
git rev-parse origin/main^{commit} # timeout=10
Checking out Revision 8221b5771ebb7828d69ee554ffd6ab3d19b1411e (origin/main)
git config core.sparsecheckout # timeout=10
git checkout -f 8221b5771ebb7828d69ee554ffd6ab3d19b1411e # timeout=10
Commit message: "Update secrets.yml"
git rev-list --no-walk 8221b5771ebb7828d69ee554ffd6ab3d19b1411e # timeout=10
[Pipeline] }
[Pipeline] // dir
[Pipeline] sh

rsync -Lkr /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/private/ansible/inventory/dev/Kubernetes/common.yml /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/private/ansible/inventory/dev/Kubernetes/hosts /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/private/ansible/inventory/dev/Kubernetes/secrets.yml /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/ansible/inventory/env/
[ -f /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/ansible/inventory/env/kubernetes.yaml ]
ansible-playbook -i /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/ansible/inventory/env/hosts /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/ansible/samza_deploy.yml --extra-vars job_names_to_kill=null job_workspace=/var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/ansible --vault-password-file /var/lib/jenkins/secrets/vault-pass
[WARNING]: Invalid characters were found in group names but not replaced, use
-vvvv to see details

[WARNING]: * Failed to parse /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/
Yarn/ansible/inventory/env/hosts with yaml plugin: Syntax Error while loading
YAML. found unexpected ':' The error appears to be in '/var/lib/jenkins/work
space/Deploy/dev/Kubernetes/Yarn/ansible/inventory/env/hosts': line 1, column
5, but may be elsewhere in the file depending on the exact syntax problem. The
offending line appears to be: [all:vars] ^ here

[WARNING]: * Failed to parse /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/
Yarn/ansible/inventory/env/hosts with ini plugin: /var/lib/jenkins/workspace/De
ploy/dev/Kubernetes/Yarn/ansible/inventory/env/hosts:156: Section
[core:children] includes undefined group: postgresql-slave

[WARNING]: Unable to parse /var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yar
n/ansible/inventory/env/hosts as an inventory source

[WARNING]: No inventory was parsed, only implicit localhost is available

[WARNING]: provided hosts list is empty, only localhost is available. Note that
the implicit localhost does not match 'all'

PLAY [Move the selected samza app tar files to another dir] ********************
[WARNING]: While constructing a mapping from /var/lib/jenkins/workspace/Deploy/
dev/Kubernetes/Yarn/ansible/inventory/env/group_vars/all.yml, line 4, column 1,
found a duplicate dict key (app_es_snapshot_host). Using last defined value
only.

[WARNING]: While constructing a mapping from /var/lib/jenkins/workspace/Deploy/
dev/Kubernetes/Yarn/ansible/inventory/env/group_vars/all.yml, line 4, column 1,
found a duplicate dict key (sunbird_es_host). Using last defined value only.

[WARNING]: While constructing a mapping from /var/lib/jenkins/workspace/Deploy/
dev/Kubernetes/Yarn/ansible/inventory/env/group_vars/all.yml, line 4, column 1,
found a duplicate dict key (log_es_snapshot_host). Using last defined value
only.

TASK [Gathering Facts] *********************************************************
ok: [localhost]

TASK [find the selected samza app tar files path] ******************************
fatal: [localhost]: FAILED! => {}

MSG:

The task includes an option with an undefined variable. The error was: 'dict object' has no attribute 'null'

The error appears to be in '/var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/ansible/samza_deploy.yml': line 5, column 7, but may
be elsewhere in the file depending on the exact syntax problem.

The offending line appears to be:

tasks:
- name: find the selected samza app tar files path
^ here

PLAY RECAP *********************************************************************
localhost : ok=1 changed=0 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0

[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] ansiColor
[Pipeline] {

[Pipeline] stage
[Pipeline] { (slack_notify)
[Pipeline] sh

git rev-parse --short HEAD
[Pipeline] sh
rev
cut -d / -f1
rev
git name-rev --name-only HEAD
[Pipeline] sh
echo Deploy/dev/Kubernetes/Yarn
[Pipeline] echo
Could not find env specific Slack channel. Check for global slack channel..
[Pipeline] echo
Could not find slack environment variable. Skipping slack notification..
[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] ansiColor
[Pipeline] {

[Pipeline] stage
[Pipeline] { (email_notify)
[Pipeline] sh

echo Deploy/dev/Kubernetes/Yarn
[Pipeline] echo
Could not find env specific email group. Check for global email group..
[Pipeline] echo
Could not find global email group variable. Skipping email notification..
[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
ERROR: script returned exit code 2
Finished: FAILURE

The gist of the issue is at the following section:
TASK [find the selected samza app tar files path] ******************************
fatal: [localhost]: FAILED! => {}

MSG:

The task includes an option with an undefined variable. The error was: 'dict object' has no attribute 'null'

The error appears to be in '/var/lib/jenkins/workspace/Deploy/dev/Kubernetes/Yarn/ansible/samza_deploy.yml': line 5, column 7, but may
be elsewhere in the file depending on the exact syntax problem.

The offending line appears to be:

tasks:
- name: find the selected samza app tar files path
^ here

It seems the job is looking for a parameter - job_names_to_deploy
Can you please help/suggest here?

Answered by monojit18

Oct 7, 2022

Thanks @keshavprasadms for the help.
I could make the Yarn job successful with the option - job_names_to_display=lms.indexer_1

But failed to get success with job_names_to_display=lms.notification-job_1
Following is the error I am getting. can you please help/suggest?

TASK [samza-jobs : Start the jobs] *********************************************
failed: [10.0.4.16] (item=['notification-job-0.0.1-distribution.tar.gz', {'changed': True, 'end': '2022-10-06 11:42:03.359847', 'stdout': '/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/config/notification-job.properties', 'cmd': 'ls -d -1 /home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.…

View full answer

beepdot · 2022-10-06T05:22:07Z

beepdot
Oct 6, 2022

Please ensure you select the job parameters job_names_to_deploy by shift + clicking on the options before deployment. It looks like you haven't selected any job names.

2 replies

monojit18 Oct 6, 2022
Author

Thanks @keshavprasadms
Yes, I saw that the job is expecting that value; but I do not see that option job_names_to_deploy in my job.
Can you please tell me the value(s) that should b there so that I can add that manually in the job configuration and try?

beepdot Oct 6, 2022

https://github.com/project-sunbird/sunbird-devops/blob/master/deploy/jenkins/jobs/Deploy/jobs/dev/jobs/Kubernetes/jobs/Yarn/config.xml#L176-L177
Please update your job config.

monojit18 · 2022-10-07T03:06:29Z

monojit18
Oct 7, 2022
Author

Thanks @keshavprasadms for the help.
I could make the Yarn job successful with the option - job_names_to_display=lms.indexer_1

But failed to get success with job_names_to_display=lms.notification-job_1
Following is the error I am getting. can you please help/suggest?

TASK [samza-jobs : Start the jobs] *********************************************
failed: [10.0.4.16] (item=['notification-job-0.0.1-distribution.tar.gz', {'changed': True, 'end': '2022-10-06 11:42:03.359847', 'stdout': '/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/config/notification-job.properties', 'cmd': 'ls -d -1 /home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/config/.properties', 'rc': 0, 'start': '2022-10-06 11:42:03.356983', 'stderr': '', 'delta': '0:00:00.002864', 'invocation': {'module_args': {'creates': None, 'executable': None, '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'ls -d -1 /home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/config/.properties', 'removes': None, 'argv': None, 'warn': True, 'chdir': None, 'stdin_add_newline': True, 'stdin': None}}, 'stdout_lines': ['/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/config/notification-job.properties'], 'stderr_lines': [], 'failed': False, 'item': 'notification-job-0.0.1-distribution.tar.gz', 'ansible_loop_var': 'item'}]) => {
"ansible_loop_var": "item",
"changed": true,
"cmd": "/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/bin/run-job.sh --config-factory=org.apache.samza.config.factories.PropertiesConfigFactory --config-path=/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/config/notification-job.properties",
"delta": "0:00:02.555232",
"end": "2022-10-06 11:42:08.557815",
"item": [
"notification-job-0.0.1-distribution.tar.gz",
{
"ansible_loop_var": "item",
"changed": true,
"cmd": "ls -d -1 /home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/config/.properties",
"delta": "0:00:00.002864",
"end": "2022-10-06 11:42:03.359847",
"failed": false,
"invocation": {
"module_args": {
"_raw_params": "ls -d -1 /home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/config/.properties",
"_uses_shell": true,
"argv": null,
"chdir": null,
"creates": null,
"executable": null,
"removes": null,
"stdin": null,
"stdin_add_newline": true,
"strip_empty_ends": true,
"warn": true
}
},
"item": "notification-job-0.0.1-distribution.tar.gz",
"rc": 0,
"start": "2022-10-06 11:42:03.356983",
"stderr": "",
"stderr_lines": [],
"stdout": "/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/config/notification-job.properties",
"stdout_lines": [
"/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/config/notification-job.properties"
]
}
],
"rc": 1,
"start": "2022-10-06 11:42:06.002583"
}

STDOUT:

home_dir=/home/devops
framework base (location of this script). base_dir=/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz
java -Dlog4j.configuration=file:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/bin/log4j-console.xml -Dsamza.log.dir=/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz -Djava.io.tmpdir=/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/tmp -Xmx768M -XX:+PrintGCDateStamps -Xloggc:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/gc.log -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10241024 -d64 -cp /home/hduser/.samza/conf:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/accessors-smart-1.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/aopalliance-1.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/asm-5.0.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/avro-1.7.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-beanutils-1.7.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-beanutils-core-1.8.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-cli-1.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-codec-1.11.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-collections-3.2.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-collections4-4.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-compress-1.19.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-configuration-1.6.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-daemon-1.0.13.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-digester-1.8.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-el-1.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-httpclient-3.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-io-2.5.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-lang-2.6.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-lang3-3.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-logging-1.1.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-math3-3.1.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-net-3.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/config-1.3.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/curator-client-2.6.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/curator-framework-4.2.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/curator-recipes-2.6.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/grizzled-slf4j_2.11-1.3.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/gson-2.2.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/guava-17.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/guice-4.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/guice-servlet-4.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/hadoop-annotations-3.3.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/hadoop-auth-3.3.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/hadoop-common-2.6.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/hadoop-hdfs-3.3.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/hadoop-hdfs-client-3.3.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/hadoop-yarn-api-2.6.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/hadoop-yarn-client-3.3.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/hadoop-yarn-common-3.3.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/htrace-core-3.0.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/htrace-core4-4.1.0-incubating.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/httpclient-4.5.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/httpcore-4.4.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-annotations-2.6.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-core-2.10.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-core-asl-1.9.13.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-databind-2.10.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-jaxrs-1.9.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-jaxrs-base-2.10.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-jaxrs-json-provider-2.10.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-mapper-asl-1.9.13.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-module-jaxb-annotations-2.10.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-xc-1.9.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jakarta.activation-api-1.2.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jakarta.xml.bind-api-2.3.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jasper-compiler-5.5.23.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jasper-runtime-5.5.23.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/java-xmlbuilder-0.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/javax.inject-1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/javax.servlet-api-3.1.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jaxb-api-2.2.11.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jaxb-impl-2.2.3-1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jcip-annotations-1.0-1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jersey-client-1.19.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jersey-core-1.19.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jersey-guice-1.19.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jersey-json-1.19.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jersey-server-1.19.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jersey-servlet-1.19.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jets3t-0.9.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jettison-1.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-6.1.26.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-client-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-http-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-io-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-security-9.2.7.v20150116.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-server-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-servlet-9.2.7.v20150116.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-util-6.1.26.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-util-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-util-ajax-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-webapp-9.2.7.v20150116.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-xml-9.2.7.v20150116.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jline-0.9.94.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jline-3.9.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jobs-common-0.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/joda-time-2.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jopt-simple-3.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jsch-0.1.42.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/json-smart-2.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jsp-api-2.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jsr305-1.3.9.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jsr311-api-1.1.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/junit-3.8.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/juniversalchardet-1.0.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kafka-clients-0.11.0.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kafka_2.11-0.11.0.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-admin-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-client-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-common-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-core-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-crypto-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-identity-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-server-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-simplekdc-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-util-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerby-asn1-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerby-config-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerby-pkix-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerby-util-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerby-xdr-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/leveldbjni-all-1.8.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/log4j-1.2.17.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/log4j-api-2.8.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/log4j-core-2.8.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/lz4-1.3.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/metrics-core-2.2.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/mime-util-2.1.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/netty-3.10.6.Final.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/netty-all-4.1.50.Final.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/nimbus-jose-jwt-7.9.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/notification-job-0.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/notification-sdk-1.0-SNAPSHOT.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/okhttp-2.7.5.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/okhttp-3.12.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/okio-1.15.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/paranamer-2.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/protobuf-java-2.5.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/resteasy-jackson2-provider-3.0.14.Final.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/samza-api-0.14.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/samza-core_2.11-0.14.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/samza-kafka_2.11-0.14.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/samza-log4j-0.14.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/samza-yarn_2.11-0.14.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scala-compiler-2.11.8.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scala-library-2.11.8.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scala-parser-combinators_2.11-1.0.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scala-reflect-2.11.8.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scala-xml_2.11-1.0.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scalate-core_2.11-1.8.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scalate-util_2.11-1.8.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scalatra-common_2.11-2.5.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scalatra-scalate_2.11-2.5.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scalatra_2.11-2.5.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/servlet-api-2.5.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/slf4j-api-1.6.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/slf4j-log4j12-1.6.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/snappy-java-1.1.2.6.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/token-provider-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/websocket-api-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/websocket-client-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/websocket-common-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/xmlenc-0.52.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/zkclient-0.8.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/zookeeper-3.4.6.jar org.apache.samza.job.JobRunner --config-factory=org.apache.samza.config.factories.PropertiesConfigFactory --config-path=/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/config/notification-job.properties
2022-10-06 11:42:06.439 [main] JobRunner [INFO] job factory: org.apache.samza.job.yarn.YarnJobFactory
2022-10-06 11:42:06.515 [main] VerifiableProperties [INFO] Verifying properties
2022-10-06 11:42:06.518 [main] VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
2022-10-06 11:42:06.518 [main] VerifiableProperties [INFO] Property client.id is overridden to samza_admin-dev_lms_notification-1
2022-10-06 11:42:06.518 [main] VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-aabd4226-6203-4ba9-a0fb-384d011c3d91
2022-10-06 11:42:06.518 [main] VerifiableProperties [INFO] Property zookeeper.connect is overridden to 10.0.4.18:2181
2022-10-06 11:42:06.531 [main] VerifiableProperties [INFO] Verifying properties
2022-10-06 11:42:06.531 [main] VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
2022-10-06 11:42:06.531 [main] VerifiableProperties [INFO] Property client.id is overridden to samza_consumer-dev_lms_notification-1
2022-10-06 11:42:06.531 [main] VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-23ff0f59-bca6-4fb4-ae0a-4bb5924b55f8
2022-10-06 11:42:06.532 [main] VerifiableProperties [INFO] Property zookeeper.connect is overridden to 10.0.4.18:2181
2022-10-06 11:42:06.551 [main] VerifiableProperties [INFO] Verifying properties
2022-10-06 11:42:06.551 [main] VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
2022-10-06 11:42:06.551 [main] VerifiableProperties [INFO] Property client.id is overridden to samza_admin-dev_lms_notification-1
2022-10-06 11:42:06.552 [main] VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-1d450a39-7f1a-42db-b641-c1c9e94538bc
2022-10-06 11:42:06.552 [main] VerifiableProperties [INFO] Property zookeeper.connect is overridden to 10.0.4.18:2181
2022-10-06 11:42:06.562 [main] VerifiableProperties [INFO] Verifying properties
2022-10-06 11:42:06.562 [main] VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
2022-10-06 11:42:06.562 [main] VerifiableProperties [INFO] Property client.id is overridden to samza_admin-dev_lms_notification-1
2022-10-06 11:42:06.562 [main] VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-940182d8-00ad-4ef7-ab11-364c320e17c9
2022-10-06 11:42:06.562 [main] VerifiableProperties [INFO] Property zookeeper.connect is overridden to 10.0.4.18:2181
2022-10-06 11:42:06.572 [main] JobRunner [INFO] Creating coordinator stream
2022-10-06 11:42:06.573 [main] VerifiableProperties [INFO] Verifying properties
2022-10-06 11:42:06.574 [main] VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest
2022-10-06 11:42:06.574 [main] VerifiableProperties [INFO] Property client.id is overridden to samza_admin-dev_lms_notification-1
2022-10-06 11:42:06.574 [main] VerifiableProperties [INFO] Property group.id is overridden to undefined-samza-consumer-group-d547bf1c-e170-49ae-9f3b-9fa853d230e6
2022-10-06 11:42:06.574 [main] VerifiableProperties [INFO] Property zookeeper.connect is overridden to 10.0.4.18:2181
2022-10-06 11:42:06.612 [main] KafkaSystemAdmin [INFO] Create topic __samza_coordinator_dev.lms.notification_1 in system kafka
2022-10-06 11:42:06.623 [ZkClient-EventThread-11-10.0.4.18:2181] ZkEventThread [INFO] Starting ZkClient event thread.
2022-10-06 11:42:06.630 [main] ZooKeeper [INFO] Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
2022-10-06 11:42:06.630 [main] ZooKeeper [INFO] Client environment:host.name=yarn.us-central1-a.c.sunbird-3108500.internal
2022-10-06 11:42:06.630 [main] ZooKeeper [INFO] Client environment:java.version=1.8.0_121
2022-10-06 11:42:06.630 [main] ZooKeeper [INFO] Client environment:java.vendor=Oracle Corporation
2022-10-06 11:42:06.630 [main] ZooKeeper [INFO] Client environment:java.home=/opt/jdk1.8.0_121/jre
2022-10-06 11:42:06.630 [main] ZooKeeper [INFO] Client environment:java.class.path=/home/hduser/.samza/conf:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/accessors-smart-1.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/aopalliance-1.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/asm-5.0.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/avro-1.7.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-beanutils-1.7.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-beanutils-core-1.8.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-cli-1.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-codec-1.11.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-collections-3.2.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-collections4-4.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-compress-1.19.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-configuration-1.6.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-daemon-1.0.13.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-digester-1.8.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-el-1.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-httpclient-3.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-io-2.5.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-lang-2.6.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-lang3-3.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-logging-1.1.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-math3-3.1.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/commons-net-3.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/config-1.3.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/curator-client-2.6.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/curator-framework-4.2.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/curator-recipes-2.6.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/grizzled-slf4j_2.11-1.3.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/gson-2.2.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/guava-17.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/guice-4.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/guice-servlet-4.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/hadoop-annotations-3.3.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/hadoop-auth-3.3.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/hadoop-common-2.6.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/hadoop-hdfs-3.3.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/hadoop-hdfs-client-3.3.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/hadoop-yarn-api-2.6.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/hadoop-yarn-client-3.3.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/hadoop-yarn-common-3.3.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/htrace-core-3.0.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/htrace-core4-4.1.0-incubating.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/httpclient-4.5.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/httpcore-4.4.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-annotations-2.6.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-core-2.10.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-core-asl-1.9.13.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-databind-2.10.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-jaxrs-1.9.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-jaxrs-base-2.10.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-jaxrs-json-provider-2.10.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-mapper-asl-1.9.13.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-module-jaxb-annotations-2.10.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jackson-xc-1.9.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jakarta.activation-api-1.2.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jakarta.xml.bind-api-2.3.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jasper-compiler-5.5.23.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jasper-runtime-5.5.23.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/java-xmlbuilder-0.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/javax.inject-1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/javax.servlet-api-3.1.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jaxb-api-2.2.11.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jaxb-impl-2.2.3-1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jcip-annotations-1.0-1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jersey-client-1.19.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jersey-core-1.19.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jersey-guice-1.19.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jersey-json-1.19.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jersey-server-1.19.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jersey-servlet-1.19.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jets3t-0.9.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jettison-1.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-6.1.26.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-client-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-http-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-io-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-security-9.2.7.v20150116.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-server-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-servlet-9.2.7.v20150116.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-util-6.1.26.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-util-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-util-ajax-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-webapp-9.2.7.v20150116.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jetty-xml-9.2.7.v20150116.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jline-0.9.94.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jline-3.9.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jobs-common-0.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/joda-time-2.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jopt-simple-3.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jsch-0.1.42.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/json-smart-2.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jsp-api-2.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jsr305-1.3.9.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/jsr311-api-1.1.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/junit-3.8.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/juniversalchardet-1.0.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kafka-clients-0.11.0.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kafka_2.11-0.11.0.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-admin-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-client-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-common-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-core-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-crypto-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-identity-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-server-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-simplekdc-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerb-util-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerby-asn1-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerby-config-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerby-pkix-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerby-util-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/kerby-xdr-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/leveldbjni-all-1.8.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/log4j-1.2.17.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/log4j-api-2.8.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/log4j-core-2.8.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/lz4-1.3.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/metrics-core-2.2.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/mime-util-2.1.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/netty-3.10.6.Final.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/netty-all-4.1.50.Final.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/nimbus-jose-jwt-7.9.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/notification-job-0.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/notification-sdk-1.0-SNAPSHOT.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/okhttp-2.7.5.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/okhttp-3.12.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/okio-1.15.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/paranamer-2.3.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/protobuf-java-2.5.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/resteasy-jackson2-provider-3.0.14.Final.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/samza-api-0.14.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/samza-core_2.11-0.14.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/samza-kafka_2.11-0.14.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/samza-log4j-0.14.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/samza-yarn_2.11-0.14.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scala-compiler-2.11.8.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scala-library-2.11.8.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scala-parser-combinators_2.11-1.0.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scala-reflect-2.11.8.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scala-xml_2.11-1.0.4.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scalate-core_2.11-1.8.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scalate-util_2.11-1.8.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scalatra-common_2.11-2.5.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scalatra-scalate_2.11-2.5.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/scalatra_2.11-2.5.0.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/servlet-api-2.5.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/slf4j-api-1.6.2.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/slf4j-log4j12-1.6.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/snappy-java-1.1.2.6.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/token-provider-1.0.1.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/websocket-api-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/websocket-client-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/websocket-common-9.4.20.v20190813.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/xmlenc-0.52.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/zkclient-0.8.jar:/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/lib/zookeeper-3.4.6.jar
2022-10-06 11:42:06.630 [main] ZooKeeper [INFO] Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2022-10-06 11:42:06.631 [main] ZooKeeper [INFO] Client environment:java.io.tmpdir=/home/hduser/samza-jobs/dev/extract/notification-job-0.0.1-distribution.tar.gz/tmp
2022-10-06 11:42:06.631 [main] ZooKeeper [INFO] Client environment:java.compiler=
2022-10-06 11:42:06.631 [main] ZooKeeper [INFO] Client environment:os.name=Linux
2022-10-06 11:42:06.631 [main] ZooKeeper [INFO] Client environment:os.arch=amd64
2022-10-06 11:42:06.631 [main] ZooKeeper [INFO] Client environment:os.version=5.4.0-1087-gcp
2022-10-06 11:42:06.631 [main] ZooKeeper [INFO] Client environment:user.name=hduser
2022-10-06 11:42:06.631 [main] ZooKeeper [INFO] Client environment:user.home=/home/hduser
2022-10-06 11:42:06.631 [main] ZooKeeper [INFO] Client environment:user.dir=/home/devops
2022-10-06 11:42:06.631 [main] ZooKeeper [INFO] Initiating client connection, connectString=10.0.4.18:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@2f4948e4
2022-10-06 11:42:06.644 [main] ZkClient [INFO] Waiting for keeper state SyncConnected
2022-10-06 11:42:06.647 [main-SendThread(10.0.4.18:2181)] ClientCnxn [INFO] Opening socket connection to server 10.0.4.18/10.0.4.18:2181. Will not attempt to authenticate using SASL (unknown error)
2022-10-06 11:42:06.654 [main-SendThread(10.0.4.18:2181)] ClientCnxn [INFO] Socket connection established to 10.0.4.18/10.0.4.18:2181, initiating session
2022-10-06 11:42:06.661 [main-SendThread(10.0.4.18:2181)] ClientCnxn [INFO] Session establishment complete on server 10.0.4.18/10.0.4.18:2181, sessionid = 0x100196895940163, negotiated timeout = 6000
2022-10-06 11:42:06.662 [main-EventThread] ZkClient [INFO] zookeeper state changed (SyncConnected)
2022-10-06 11:42:06.807 [main] AdminUtils$ [INFO] Topic creation {"version":1,"partitions":{"0":[1]}}
2022-10-06 11:42:06.809 [ZkClient-EventThread-11-10.0.4.18:2181] ZkEventThread [INFO] Terminate ZkClient event thread.
2022-10-06 11:42:06.811 [main] ZooKeeper [INFO] Session: 0x100196895940163 closed
2022-10-06 11:42:06.811 [main-EventThread] ClientCnxn [INFO] EventThread shut down
2022-10-06 11:42:06.811 [main] JobRunner [INFO] Created coordinator stream __samza_coordinator_dev.lms.notification_1.
2022-10-06 11:42:06.907 [main] JobRunner [INFO] Storing config in coordinator stream.
2022-10-06 11:42:06.907 [main] CoordinatorStreamSystemProducer [INFO] Starting coordinator stream producer.
2022-10-06 11:42:06.912 [main] ProducerConfig [INFO] ProducerConfig values:
acks = 1
batch.size = 16384
bootstrap.servers = [10.0.4.18:9092]
buffer.memory = 33554432
client.id = samza_producer-dev_lms_notification-1
compression.type = none
connections.max.idle.ms = 540000
enable.idempotence = false
interceptor.classes = null
key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer
linger.ms = 10
max.block.ms = 60000
max.in.flight.requests.per.connection = 1
max.request.size = 1048576
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner
receive.buffer.bytes = 32768
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retries = 2147483647
retry.backoff.ms = 100
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
transaction.timeout.ms = 60000
transactional.id = null
value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer

2022-10-06 11:42:06.924 [main] AppInfoParser [INFO] Kafka version : 0.11.0.2
2022-10-06 11:42:06.924 [main] AppInfoParser [INFO] Kafka commitId : 73be1e1168f91ee2
2022-10-06 11:42:07.064 [main] JobRunner [INFO] Loading old config from coordinator stream.
2022-10-06 11:42:07.094 [main] VerifiableProperties [INFO] Verifying properties
2022-10-06 11:42:07.095 [main] VerifiableProperties [INFO] Property client.id is overridden to samza_admin-dev_lms_notification-1
2022-10-06 11:42:07.095 [main] VerifiableProperties [INFO] Property metadata.broker.list is overridden to 10.0.4.18:9092
2022-10-06 11:42:07.095 [main] VerifiableProperties [INFO] Property request.timeout.ms is overridden to 30000
2022-10-06 11:42:07.116 [main] ClientUtils$ [INFO] Fetching metadata from broker BrokerEndPoint(0,10.0.4.18,9092) with correlation id 0 for 1 topic(s) Set(__samza_coordinator_dev.lms.notification_1)
2022-10-06 11:42:07.117 [main] SyncProducer [INFO] Connected to 10.0.4.18:9092 for producing
2022-10-06 11:42:07.132 [main] SyncProducer [INFO] Disconnecting from 10.0.4.18:9092
2022-10-06 11:42:07.164 [main] CoordinatorStreamSystemConsumer [INFO] Got metadata {__samza_coordinator_dev.lms.notification_1=SystemStreamMetadata [streamName=__samza_coordinator_dev.lms.notification_1, partitionMetadata={Partition [partition=0]=SystemStreamPartitionMetadata [oldestOffset=0, newestOffset=32, upcomingOffset=33]}]}
2022-10-06 11:42:07.168 [main] CoordinatorStreamSystemConsumer [INFO] Starting coordinator stream system consumer.
2022-10-06 11:42:07.171 [main] KafkaSystemConsumer [INFO] Refreshing brokers for: Map([__samza_coordinator_dev.lms.notification_1,0] -> 0)
2022-10-06 11:42:07.179 [main] BrokerProxy [INFO] Creating new SimpleConsumer for host kp.us-central1-a.c.sunbird-3108500.internal:9092 for system kafka
2022-10-06 11:42:07.182 [main] GetOffset [INFO] Validating offset 0 for topic and partition [__samza_coordinator_dev.lms.notification_1,0]
2022-10-06 11:42:07.200 [main] GetOffset [INFO] Able to successfully read from offset 0 for topic and partition [__samza_coordinator_dev.lms.notification_1,0]. Using it to instantiate consumer.
2022-10-06 11:42:07.201 [main] BrokerProxy [INFO] Starting BrokerProxy for kp.us-central1-a.c.sunbird-3108500.internal:9092
2022-10-06 11:42:07.202 [main] CoordinatorStreamSystemConsumer [INFO] Bootstrapping configuration from coordinator stream.
2022-10-06 11:42:08.224 [main] CoordinatorStreamSystemConsumer [INFO] Stopping coordinator stream system consumer.
2022-10-06 11:42:08.276 [main] BrokerProxy [INFO] Shutting down BrokerProxy for kp.us-central1-a.c.sunbird-3108500.internal:9092
2022-10-06 11:42:08.277 [main] BrokerProxy [INFO] closing simple consumer...
2022-10-06 11:42:08.330 [Samza BrokerProxy BrokerProxy thread pointed at kp.us-central1-a.c.sunbird-3108500.internal:9092 for client samza_consumer-dev_lms_notification-1] BrokerProxy [INFO] Shutting down due to interrupt.
2022-10-06 11:42:08.408 [main] JobRunner [INFO] Deleting old configs that are no longer defined: Set()
2022-10-06 11:42:08.409 [main] CoordinatorStreamSystemProducer [INFO] Stopping coordinator stream producer.
2022-10-06 11:42:08.409 [main] KafkaSystemProducer [INFO] Stopping producer for system: kafka
2022-10-06 11:42:08.410 [main] KafkaProducer [INFO] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms.

STDERR:

java version "1.8.0_121"
Java(TM) SE Runtime Environment (build 1.8.0_121-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.121-b13, mixed mode)
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/crypto/key/KeyProviderTokenIssuer
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.apache.samza.job.yarn.YarnJobFactory.getJob(YarnJobFactory.scala:37)
at org.apache.samza.job.yarn.YarnJobFactory.getJob(YarnJobFactory.scala:31)
at org.apache.samza.job.JobRunner.run(JobRunner.scala:120)
at org.apache.samza.job.JobRunner$.doOperation(JobRunner.scala:53)
at org.apache.samza.job.JobRunner$.main(JobRunner.scala:48)
at org.apache.samza.job.JobRunner.main(JobRunner.scala)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.crypto.key.KeyProviderTokenIssuer
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 18 more

MSG:

non-zero return code

PLAY RECAP *********************************************************************
10.0.4.16 : ok=13 changed=8 unreachable=0 failed=1 skipped=3 rescued=0 ignored=0
localhost : ok=3 changed=1 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0

[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] ansiColor
[Pipeline] {

[Pipeline] stage
[Pipeline] { (slack_notify)
[Pipeline] sh

git rev-parse --short HEAD
[Pipeline] sh
git name-rev --name-only HEAD
- revrev
cut -d / -f1
[Pipeline] sh
echo Deploy/dev/Kubernetes/Yarn
[Pipeline] echo
Could not find env specific Slack channel. Check for global slack channel..
[Pipeline] echo
Could not find slack environment variable. Skipping slack notification..
[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] ansiColor
[Pipeline] {

[Pipeline] stage
[Pipeline] { (email_notify)
[Pipeline] sh

echo Deploy/dev/Kubernetes/Yarn
[Pipeline] echo
Could not find env specific email group. Check for global email group..
[Pipeline] echo
Could not find global email group variable. Skipping email notification..
[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
ERROR: script returned exit code 2
Finished: FAILURE

4 replies

beepdot Oct 7, 2022

What was the github tag used to run the Build/Core/Yarn job?

monojit18 Oct 7, 2022
Author

Thanks @keshavprasadms

Build: release-3.7.0_RC1
Deploy: release-4.6.0_RC4

beepdot Oct 7, 2022

Please rebuild the yarn job using below tag - https://github.com/project-sunbird/sunbird-lms-jobs/tree/release-2.5.0_RC3
Once successful, your deployment job should succeed.
The build tag is incorrectly mentioned.

monojit18 Oct 11, 2022
Author

Thanks @keshavprasadms
This worked for me with release-2.5.1_RC3.
Marking this as answered

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Sunbird-ED (Sunbird for Education)

Deploy->Kubernetes->Yarn is failing #210

{{title}}

Replies: 2 comments 6 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

Sunbird-ED (Sunbird for Education)

Deploy->Kubernetes->Yarn is failing #210

monojit18 Oct 4, 2022

tasks: - name: find the selected samza app tar files path ^ here

Replies: 2 comments · 6 replies

beepdot Oct 6, 2022

monojit18 Oct 6, 2022 Author

beepdot Oct 6, 2022

monojit18 Oct 7, 2022 Author

beepdot Oct 7, 2022

monojit18 Oct 7, 2022 Author

beepdot Oct 7, 2022

monojit18 Oct 11, 2022 Author

monojit18
Oct 4, 2022

tasks:
- name: find the selected samza app tar files path
^ here

Replies: 2 comments 6 replies

beepdot
Oct 6, 2022

monojit18 Oct 6, 2022
Author

monojit18
Oct 7, 2022
Author

monojit18 Oct 7, 2022
Author

monojit18 Oct 11, 2022
Author