Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gas scraper initial #11

Open
wants to merge 4 commits into
base: dev
Choose a base branch
from
Open

gas scraper initial #11

wants to merge 4 commits into from

Conversation

tan-patrick
Copy link

No description provided.

@celwell
Copy link
Member

celwell commented Jul 12, 2016

It looks like the results are a tab delimited file with a .csv comma delimited file extension.

@tan-patrick
Copy link
Author

This was because addresses also had commas in them. Do you have any suggestions?

@celwell
Copy link
Member

celwell commented Jul 12, 2016

JSON would be a good format

@tan-patrick
Copy link
Author

Sounds good.

@tan-patrick
Copy link
Author

Should be fixed.

@celwell
Copy link
Member

celwell commented Jul 12, 2016

file extension should be .json instead of .csv since it's json

@tan-patrick
Copy link
Author

Oh, thanks for catching that. Should be changed.

@celwell
Copy link
Member

celwell commented Jul 13, 2016

also needed to install pip install cssselect

@celwell
Copy link
Member

celwell commented Jul 13, 2016

Why does this use the old gasbuddy pages?

This is what the new ones look like: http://www.gasbuddy.com/Station/14162

@tan-patrick
Copy link
Author

Hm, I'm not sure. I think I must've looked at Los Angeles gas stations and
got sent to that page. I will work on converting that.
On Wed, Jul 13, 2016 at 10:06 AM Christopher Elwell <
[email protected]> wrote:

Why does this use the old gasbuddy pages?

This is what the new ones look like: http://www.gasbuddy.com/Station/14162


You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
#11 (comment),
or mute the thread
https://github.com/notifications/unsubscribe/AET_1XukgfCxqQIRRCrM4tnYoe9Cg6u9ks5qVRstgaJpZM4JKuGP
.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants