File tree 1 file changed +26
-0
lines changed
1 file changed +26
-0
lines changed Original file line number Diff line number Diff line change
1
+ # tweet_scraper
2
+ this project can be used to scrape tweets and append them to previously scraped tweets from the same user.
3
+ I built this so I could accumulate twitter data and train an RNN on it so it can post to twitter itself.
4
+
5
+ The RNN I am using is also open source and can be found here https://github.com/jcjohnson/torch-rnn
6
+
7
+ Usage
8
+
9
+ ```
10
+ python getTweets.py screen_name amount [filename]
11
+ ```
12
+
13
+ The filename is an optional argument to specify which file you want to write the tweets to
14
+ The filename can be used to append to files
15
+
16
+ The id of last tweet scraped is kept in a file called lastTweetScraped.txt which will be created if it does not exist in the current directory.
17
+
18
+ TODO's:
19
+
20
+ add specifity for arguments
21
+ -f file
22
+ -af append to file
23
+ -stop Scrape only new tweets, ie. all up to last tweet scraped as specified in the lastTweetScraped.txt file
24
+
25
+ Maybe scrape just a range
26
+ Better File I/O functionality
You can’t perform that action at this time.
0 commit comments