Skip to content

Commit 1bd5b4c

Browse files
authored
Create README.md
1 parent 34247ac commit 1bd5b4c

File tree

1 file changed

+26
-0
lines changed

1 file changed

+26
-0
lines changed

README.md

+26
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,26 @@
1+
# tweet_scraper
2+
this project can be used to scrape tweets and append them to previously scraped tweets from the same user.
3+
I built this so I could accumulate twitter data and train an RNN on it so it can post to twitter itself.
4+
5+
The RNN I am using is also open source and can be found here https://github.com/jcjohnson/torch-rnn
6+
7+
Usage
8+
9+
```
10+
python getTweets.py screen_name amount [filename]
11+
```
12+
13+
The filename is an optional argument to specify which file you want to write the tweets to
14+
The filename can be used to append to files
15+
16+
The id of last tweet scraped is kept in a file called lastTweetScraped.txt which will be created if it does not exist in the current directory.
17+
18+
TODO's:
19+
20+
add specifity for arguments
21+
-f file
22+
-af append to file
23+
-stop Scrape only new tweets, ie. all up to last tweet scraped as specified in the lastTweetScraped.txt file
24+
25+
Maybe scrape just a range
26+
Better File I/O functionality

0 commit comments

Comments
 (0)