Skip to content
This repository was archived by the owner on Apr 15, 2022. It is now read-only.

Commit

Permalink
Dbaas 2571 (#23)
Browse files Browse the repository at this point in the history
* DBAAS-2387: Added createTable function to create a new schema.table from a dataframe

* DBAAS-2387: Added an optional upper param to insert, upsert and update in case of mixed case columns in SQL tables

* Added a replaceDataframeSchema function to properly set the case of each column name of the dataframe

* DBAAS-2387: fixed schema_table_name in params

* DBAAS-2387: Added 26 Unit Tests; Refactored Create Table Function; Refactored Tests

* removed pyc files and __pycache__ via gitignore

* removed pytest cache

* DBAAS-2387: removed changes from .gitignore

* DBAAS-2571: Updating MLManager to have new features released in MLFlow 1.0

* DBAAS-2571: More features for MLFlow 1.0 Upgrade; deprecated SpliceMLContext; Fixed specificity in Binary Classification Evaluator

* DBAAS-2571: Added Deploymenet to Sagemaker programmatically

* DBAAS-2571: Fixed minor bugs and renamed functions

* DBAAS-2571: Fixed typo in if-statement checking validity of MLFlow REST tracking endpoint URL

* DBAAS-2571: Added Governance for new runs as well as support for overriding username

* DBAAS-2571: Fixed get user function to be less verbose

* DBAAS-2571: Added more checks

* DBAAS-2571: Removed useless dependencies

* DBAAS-2571: Removed mutable initial argument

* DBAAS-2571: Fixed user governance

* DBAAS-2571: Added database store support via py4j for models & artifacts

* DBAAS-2571: Fixed typo in reset run

* DBAAS-2571: Updated JVM

* DBAAS-2571: Added Basic Auth to Job Initiation and added Azure Deployment

* DBAAS-2571: Added support for OneVsRest for Model Hyperparameter extraction

* Missing comma in dependencies

* Update setup.py

* Update setup.py

* Update context.py
  • Loading branch information
Ben-Epstein authored Sep 25, 2019
1 parent 8e037f8 commit ea6779e
Show file tree
Hide file tree
Showing 6 changed files with 847 additions and 137 deletions.
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,6 +1,9 @@
/.idea
/.vscode
.DS_Store
splicemachine/.DS_Store
*.pyc
*.pyo
**/__pycache__
splicemachine/ml/test/
splicemachine/ml/utilities.pyc
27 changes: 9 additions & 18 deletions setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -17,22 +17,11 @@
from setuptools import setup, find_packages

dependencies = [
"atomicwrites==1.1.5",
"attrs==18.1.0",
"more-itertools==4.2.0",
"pluggy==0.6.0",
"py==1.5.3",
"py4j==0.10.7",
"pytest==3.6.1",
"six==1.11.0",
"mlflow==0.8.0",
"graphviz==0.8.4",
"numpy==1.15.0",
"h2o_pysparkling_2.2",
"pandas==0.22.0",
"pyspark-dist-explore==0.1.7",
"tqdm==4.32.2",
"statsmodels==0.9.0"
"py4j==0.10.8.1",
"pytest==5.1.3",
"mlflow==1.1.0",
"graphviz==0.13",
"future"
]
setup(
name="splicemachine",
Expand All @@ -42,7 +31,9 @@
license='Apache License, Version 2.0',
long_description=open('README.md').read(),
author="Splice Machine, Inc.",
author_email="[email protected]",
description="This package contains all of the classes and functions you need to interact with Splice Machine's scale out, Hadoop on SQL RDBMS from Python. It also contains several machine learning utilities for use with Apache Spark.",
author_email="[email protected]",
description="This package contains all of the classes and functions you need to interact "
"with Splice Machine's scale out, Hadoop on SQL RDBMS from Python. It also contains"
" several machine learning utilities for use with Apache Spark.",
url="https://github.com/splicemachine/pysplice/"
)
Loading

0 comments on commit ea6779e

Please sign in to comment.