Merge pull request #63 from stephenhky/gcp

Moved corpus datasets and testing word2vec model to Google Cloud

README.md

@@ -85,7 +85,7 @@ If you would like to contribute, feel free to submit the pull requests. You can
 
 ## News
 
-* 03/01/2019: `shorttext` 1.1.0 released.
+* 03/03/2019: `shorttext` 1.1.0 released.
 * 02/14/2019: `shorttext` 1.0.8 released.
 * 01/30/2019: `shorttext` 1.0.7 released.
 * 01/29/2019: `shorttext` 1.0.6 released.

docs/news.rst

@@ -1,7 +1,7 @@
 News
 ====
 
-* 03/01/2019: `shorttext` 1.1.0 released.
+* 03/03/2019: `shorttext` 1.1.0 released.
 * 02/14/2019: `shorttext` 1.0.8 released.
 * 01/30/2019: `shorttext` 1.0.7 released.
 * 01/29/2019: `shorttext` 1.0.6 released.
@@ -45,10 +45,11 @@ News
 What's New
 ----------
 
-Release 1.1.0 (March 1, 2019)
+Release 1.1.0 (March 3, 2019)
 -----------------------------
 
-* Size of embedded vectors set to 300 again when necessary. (Possibly break compatibility)
+* Size of embedded vectors set to 300 again when necessary; (possibly break compatibility)
+* Moving corpus data from Github to Google Cloud Storage.
 
 
 Release 1.0.8 (February 14, 2019)

setup.py

@@ -85,6 +85,6 @@ def package_description():
       scripts=['bin/ShortTextCategorizerConsole',
                'bin/ShortTextWordEmbedSimilarity',
                'bin/switch_kerasbackend'],
-      # include_package_data=False,
+      #include_package_data=False,
       test_suite="test",
       zip_safe=False)

shorttext/data/data_retrieval.py

@@ -103,7 +103,7 @@ def inaugural():
     :rtype: dict
     """
     zfile = zipfile.ZipFile(get_or_download_data("USInaugural.zip",
-                                                 "https://github.com/stephenhky/PyShortTextCategorization/blob/master/data/USInaugural.zip?raw=true",
+                                                 "http://storage.googleapis.com/pyshorttext/USPresidentInaugural/USInaugural.zip",
                                                  asbytes=True),
                             )
     address_jsonstr = zfile.open("addresses.json").read()
@@ -144,7 +144,7 @@ def nihreports(txt_col='PROJECT_TITLE', label_col='FUNDING_ICs', sample_size=512
         raise KeyError('Undefined label column: '+label_col+'. Must be FUNDING_ICs or IC_NAME.')
 
     zfile = zipfile.ZipFile(get_or_download_data('nih_full.csv.zip',
-                                                 'https://github.com/stephenhky/PyShortTextCategorization/blob/master/data/nih_full.csv.zip?raw=true',
+                                                 'http://storage.googleapis.com/pyshorttext/nih_grant_public/nih_full.csv.zip',
                                                  asbytes=True),
                             'r',
                             zipfile.ZIP_DEFLATED)