Skip to content

Conversation

@DennisDawson
Copy link

Minor updates, added troubleshooting section to address issues I found. Mostly, I'm putting this up to get discussion going on what we'll do with this example in the docs for 1.0.

@tomwhite
Copy link
Contributor

@joey what do you think still needs to be done on this before it can be merged?

@joey
Copy link
Member

joey commented Feb 24, 2015

@tomwhite we need to decide on how to handle the running of the spark-submit script. The easiest way to handle that from a user perspective would be to wrap that in a shell script. I could also take care of the problem that Dennis was hitting on a fresh checkout at the same time.

I also need to test this on the 5.2 VM to see if we should just add a prep step to fix the spark directory permissions.

Thoughts?

@tomwhite
Copy link
Contributor

Thanks @joey. Writing a little shell script would be good.

I'm going to go ahead and release 1.0 without this - we can update the example later on.

@joey
Copy link
Member

joey commented Feb 24, 2015

Makes sense to me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants