Skip to content

execfile config.py #2

@nishal999

Description

@nishal999

In the 0_data_scraping.ipynb program file, you have called config.py which apparently is not present in the repo. As I can understand, it contains API credentials. So just to run the program, I commented the execfile line as you can see in the code below and added my credentials manually.

config = {} #execfile("config.py", config)

After commenting on the above line, I added the line manually with the credentials like this,
config = {"access_key": "xxx", "access_secret": "xxx", "consumer_key": "xxx", "consumer_secret": "xxx"}

After I run the code, I get nothing. How will I scrape data from New York Times and how does it actually establish a connection to MongoDB. How does the data get stored in MongoDB, as I can see there is a database by the name db which you call in the code. Could you help me understand?

Also, 0_data_scraping.ipynb program file has so many functions but you haven't called them anywhere in the program file. Could you explain a step by step procedure on how to sequentially execute the program files.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions