-
Notifications
You must be signed in to change notification settings - Fork 88
Description
In the 0_data_scraping.ipynb program file, you have called config.py which apparently is not present in the repo. As I can understand, it contains API credentials. So just to run the program, I commented the execfile line as you can see in the code below and added my credentials manually.
config = {} #execfile("config.py", config)
After commenting on the above line, I added the line manually with the credentials like this,
config = {"access_key": "xxx", "access_secret": "xxx", "consumer_key": "xxx", "consumer_secret": "xxx"}
After I run the code, I get nothing. How will I scrape data from New York Times and how does it actually establish a connection to MongoDB. How does the data get stored in MongoDB, as I can see there is a database by the name db which you call in the code. Could you help me understand?
Also, 0_data_scraping.ipynb program file has so many functions but you haven't called them anywhere in the program file. Could you explain a step by step procedure on how to sequentially execute the program files.