Reorganizing PySplice (#45)

* REORGANIZATION: Reorganized

* Added Gorilla Patch Applying

* REORGANIZATION: added path, reorganized stats, and added other packages for stats

* REORGANIZATION: migrated packages

* REORGANIZATION: fixed imports and added stuff

* Applied patches on runtime

* REORGANIZATION: fixed patches

* Fixed set tag logic

* REORGANIZATION: fixed timer yield

* REORGANIZATION: removed check splice ctx decorator

* fixed bug with decor

* fixed path

* removed garbage

* Reorg: added 500 lines of deployment code 😢

* 👌'

* reorganization 🥵

* fixed the bug with the order of params

* removed class attr reference in get mleap

* fixed bug with spark support vs ctx

* reorg: fixed splice --> spark error

* reorg

* fixed timer millisec -> sec

Co-authored-by: Ben Epstein <[email protected]>

Author: abaveja313

.gitignore

@@ -21,6 +21,6 @@ splicemachine/.DS_Store
 *.pyc
 *.pyo
 **/__pycache__
-splicemachine/ml/test/
-splicemachine/ml/utilities.pyc
+splicemachine/stats/test/
+splicemachine/stats/utilities.pyc
 ./splicemachine/ml/.vscode/

requirements.txt

@@ -0,0 +1,14 @@
+py4j==0.10.8.1
+pytest==5.1.3
+mlflow==1.6.0
+mleap==0.15.0
+graphviz==0.13
+requests
+gorilla==0.3.0
+tqdm==4.43.0
+pyspark-dist-explore==0.1.8
+numpy==1.18.2
+pandas==1.0.3
+scipy==1.4.1
+
+

setup.py

@@ -16,18 +16,15 @@
 
 from setuptools import setup, find_packages
 
-dependencies = [
-    "py4j==0.10.8.1",
-    "pytest==5.1.3",
-    "mlflow==1.6.0",
-    "mleap==0.15.0",
-    "graphviz==0.13",
-    "future"
-]
+REQUIREMENTS_FILE = "requirements.txt"
+
+with open(REQUIREMENTS_FILE, "r") as dependencies_file:
+    DEPENDENCIES = dependencies_file.readlines()
+
 setup(
     name="splicemachine",
-    version="1.0.10",
-    install_requires=dependencies,
+    version="2.0.0",
+    install_requires=DEPENDENCIES,
     packages=find_packages(),
     license='Apache License, Version 2.0',
     long_description=open('README.md').read(),