Aaron_Huizenga_DS_Sprint_Challenge_6.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "Aaron_Huizenga_DS_Sprint_Challenge_6.ipynb",
      "provenance": [],
      "collapsed_sections": [],
      "include_colab_link": true
    },
    "kernelspec": {
      "display_name": "Python 3",
      "language": "python",
      "name": "python3"
    },
    "language_info": {
      "codemirror_mode": {
        "name": "ipython",
        "version": 3
      },
      "file_extension": ".py",
      "mimetype": "text/x-python",
      "name": "python",
      "nbconvert_exporter": "python",
      "pygments_lexer": "ipython3",
      "version": "3.7.3"
    }
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/nusc2016/DS-Unit-2-Kaggle-Challenge/blob/master/Aaron_Huizenga_DS_Sprint_Challenge_6.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "colab_type": "text",
        "id": "M3XH_XLsy_Bn"
      },
      "source": [
        "_Lambda School Data Science, Unit 2_\n",
        " \n",
        "# Sprint Challenge: Predict Steph Curry's shots 🏀\n",
        "\n",
        "For your Sprint Challenge, you'll use a dataset with all Steph Curry's NBA field goal attempts. (Regular season and playoff games, from October 28, 2009, through June 5, 2019.) \n",
        "\n",
        "You'll predict whether each shot was made, using information about the shot and the game. This is hard to predict! Try to get above 60% accuracy. The dataset was collected with the [nba_api](https://github.com/swar/nba_api) Python library."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab_type": "code",
        "id": "Nw3CL7TE7tNq",
        "colab": {}
      },
      "source": [
        "%%capture\n",
        "import sys\n",
        "\n",
        "if 'google.colab' in sys.modules:\n",
        "    # Install packages in Colab\n",
        "    !pip install category_encoders==2.*\n",
        "    !pip install pandas-profiling==2.*"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab_type": "code",
        "id": "-Nm24pCHy_Bo",
        "colab": {}
      },
      "source": [
        "# Read data\n",
        "import pandas as pd\n",
        "url = 'https://drive.google.com/uc?export=download&id=1fL7KPyxgGYfQDsuJoBWHIWwCAf-HTFpX'\n",
        "df = pd.read_csv(url)\n",
        "\n",
        "# Check data shape\n",
        "assert df.shape == (13958, 20)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "colab_type": "text",
        "id": "B8BvDKLFy_Bq"
      },
      "source": [
        "To demonstrate mastery on your Sprint Challenge, do all the required, numbered instructions in this notebook.\n",
        "\n",
        "To earn a score of \"3\", also do all the stretch goals.\n",
        "\n",
        "You are permitted and encouraged to do as much data exploration as you want.\n",
        "\n",
        "**1. Begin with baselines for classification.** Your target to predict is `shot_made_flag`. What is your baseline accuracy, if you guessed the majority class for every prediction?\n",
        "\n",
        "**2. Hold out your test set.** Use the 2018-19 season to test. NBA seasons begin in October and end in June. You'll know you've split the data correctly when your test set has 1,709 observations.\n",
        "\n",
        "**3. Engineer new feature.** Engineer at least **1** new feature, from this list, or your own idea.\n",
        "- **Homecourt Advantage**: Is the home team (`htm`) the Golden State Warriors (`GSW`) ?\n",
        "- **Opponent**: Who is the other team playing the Golden State Warriors?\n",
        "- **Seconds remaining in the period**: Combine minutes remaining with seconds remaining, to get the total number of seconds remaining in the period.\n",
        "- **Seconds remaining in the game**: Combine period, and seconds remaining in the period, to get the total number of seconds remaining in the game. A basketball game has 4 periods, each 12 minutes long.\n",
        "- **Made previous shot**: Was Steph Curry's previous shot successful?\n",
        "\n",
        "**4. Decide how to validate** your model. Choose one of the following options. Any of these options are good. You are not graded on which you choose.\n",
        "- **Train/validate/test split: train on the 2009-10 season through 2016-17 season, validate with the 2017-18 season.** You'll know you've split the data correctly when your train set has 11,081 observations, and your validation set has 1,168 observations.\n",
        "- **Train/validate/test split: random 80/20%** train/validate split.\n",
        "- **Cross-validation** with independent test set. You may use any scikit-learn cross-validation method.\n",
        "\n",
        "**5.** Use a scikit-learn **pipeline** to **encode categoricals** and fit a **Decision Tree** or **Random Forest** model.\n",
        "\n",
        "**6.** Get your model's **validation accuracy.** (Multiple times if you try multiple iterations.) \n",
        "\n",
        "**7.** Get your model's **test accuracy.** (One time, at the end.)\n",
        "\n",
        "\n",
        "**8.** Given a **confusion matrix** for a hypothetical binary classification model, **calculate accuracy, precision, and recall.**\n",
        "\n",
        "### Stretch Goals\n",
        "- Engineer 4+ new features total, either from the list above, or your own ideas.\n",
        "- Make 2+ visualizations to explore relationships between features and target.\n",
        "- Optimize 3+ hyperparameters by trying 10+ \"candidates\" (possible combinations of hyperparameters). You can use `RandomizedSearchCV` or do it manually.\n",
        "- Get and plot your model's feature importances.\n",
        "\n"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "2ri6SXBTKr7v",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "# Before I establish the baseline, I want to make sure that I have what I will \n",
        "# need and then some, so that I can optimize this set to its fullest extent. \n",
        "\n",
        "%matplotlib inline\n",
        "import itertools\n",
        "import numpy as np\n",
        "import pandas as pd\n",
        "import seaborn as sns\n",
        "import plotly.express as px\n",
        "import category_encoders as ce\n",
        "import matplotlib.pyplot as plt\n",
        "from sklearn.metrics import r2_score\n",
        "from sklearn.impute import KNNImputer\n",
        "from sklearn.decomposition import PCA\n",
        "from scipy.stats import randint, uniform\n",
        "from sklearn.impute import SimpleImputer\n",
        "from sklearn.metrics import accuracy_score\n",
        "from sklearn.pipeline import make_pipeline\n",
        "from sklearn.compose import ColumnTransformer\n",
        "from sklearn.preprocessing import RobustScaler\n",
        "from sklearn.metrics import mean_squared_error\n",
        "from sklearn.metrics import mean_absolute_error\n",
        "from sklearn.tree import DecisionTreeClassifier\n",
        "from sklearn.neural_network import MLPRegressor\n",
        "from sklearn.preprocessing import StandardScaler\n",
        "from sklearn.preprocessing import OrdinalEncoder\n",
        "from sklearn.neural_network import MLPClassifier\n",
        "from sklearn.decomposition import FactorAnalysis\n",
        "from sklearn.metrics import plot_confusion_matrix\n",
        "from sklearn.ensemble import RandomForestRegressor\n",
        "from sklearn.ensemble import RandomForestClassifier\n",
        "from sklearn.model_selection import cross_val_score\n",
        "from sklearn.linear_model import LogisticRegression\n",
        "from sklearn.model_selection import validation_curve\n",
        "from sklearn.model_selection import train_test_split\n",
        "from sklearn.model_selection import RandomizedSearchCV\n",
        "from sklearn.experimental import enable_iterative_imputer\n",
        "from sklearn.feature_selection import f_regression, SelectKBest\n",
        "from sklearn.model_selection import GridSearchCV, RandomizedSearchCV\n",
        "import warnings\n",
        "warnings.filterwarnings(action='ignore', category=FutureWarning, module='numpy')"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "colab_type": "text",
        "id": "t6Jt3qjQ-zig"
      },
      "source": [
        "## 1. Begin with baselines for classification. \n",
        "\n",
        ">Your target to predict is `shot_made_flag`. What would your baseline accuracy be, if you guessed the majority class for every prediction?"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "RA-H4U3vRJvz",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 255
        },
        "outputId": "d751b34d-527f-4b62-805b-ec9c58f2134d"
      },
      "source": [
        "df.describe"
      ],
      "execution_count": 75,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "<bound method NDFrame.describe of         game_id  game_event_id  ...     season_type  scoremargin_before_shot\n",
              "0      20900015              4  ...  Regular Season                      2.0\n",
              "1      20900015             17  ...  Regular Season                      0.0\n",
              "2      20900015             53  ...  Regular Season                     -4.0\n",
              "3      20900015            141  ...  Regular Season                     -4.0\n",
              "4      20900015            249  ...  Regular Season                      0.0\n",
              "...         ...            ...  ...             ...                      ...\n",
              "13953  41800403            570  ...        Playoffs                    -13.0\n",
              "13954  41800403            573  ...        Playoffs                    -14.0\n",
              "13955  41800403            602  ...        Playoffs                    -17.0\n",
              "13956  41800403            608  ...        Playoffs                    -16.0\n",
              "13957  41800403            658  ...        Playoffs                    -12.0\n",
              "\n",
              "[13958 rows x 20 columns]>"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 75
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "TecU_sddROaf",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 374
        },
        "outputId": "e4220d41-435e-4c56-ec5c-a97a4f91a74d"
      },
      "source": [
        "df.dtypes"
      ],
      "execution_count": 76,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "game_id                      int64\n",
              "game_event_id                int64\n",
              "player_name                 object\n",
              "period                       int64\n",
              "minutes_remaining            int64\n",
              "seconds_remaining            int64\n",
              "action_type                 object\n",
              "shot_type                   object\n",
              "shot_zone_basic             object\n",
              "shot_zone_area              object\n",
              "shot_zone_range             object\n",
              "shot_distance                int64\n",
              "loc_x                        int64\n",
              "loc_y                        int64\n",
              "shot_made_flag               int64\n",
              "game_date                   object\n",
              "htm                         object\n",
              "vtm                         object\n",
              "season_type                 object\n",
              "scoremargin_before_shot    float64\n",
              "dtype: object"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 76
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "PCVN3e-gRP8y",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "67fd1606-67aa-4250-b71a-eddb3cb51783"
      },
      "source": [
        "df.shape"
      ],
      "execution_count": 77,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "(13958, 20)"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 77
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "s-3n6_K2RS6P",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 309
        },
        "outputId": "280b31ba-b8ba-4596-df87-c3cf3bb15377"
      },
      "source": [
        "df.head()"
      ],
      "execution_count": 78,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>game_id</th>\n",
              "      <th>game_event_id</th>\n",
              "      <th>player_name</th>\n",
              "      <th>period</th>\n",
              "      <th>minutes_remaining</th>\n",
              "      <th>seconds_remaining</th>\n",
              "      <th>action_type</th>\n",
              "      <th>shot_type</th>\n",
              "      <th>shot_zone_basic</th>\n",
              "      <th>shot_zone_area</th>\n",
              "      <th>shot_zone_range</th>\n",
              "      <th>shot_distance</th>\n",
              "      <th>loc_x</th>\n",
              "      <th>loc_y</th>\n",
              "      <th>shot_made_flag</th>\n",
              "      <th>game_date</th>\n",
              "      <th>htm</th>\n",
              "      <th>vtm</th>\n",
              "      <th>season_type</th>\n",
              "      <th>scoremargin_before_shot</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>20900015</td>\n",
              "      <td>4</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>11</td>\n",
              "      <td>25</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Above the Break 3</td>\n",
              "      <td>Right Side Center(RC)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>26</td>\n",
              "      <td>99</td>\n",
              "      <td>249</td>\n",
              "      <td>0</td>\n",
              "      <td>2009-10-28</td>\n",
              "      <td>GSW</td>\n",
              "      <td>HOU</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>2.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>20900015</td>\n",
              "      <td>17</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>9</td>\n",
              "      <td>31</td>\n",
              "      <td>Step Back Jump shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Mid-Range</td>\n",
              "      <td>Left Side Center(LC)</td>\n",
              "      <td>16-24 ft.</td>\n",
              "      <td>18</td>\n",
              "      <td>-122</td>\n",
              "      <td>145</td>\n",
              "      <td>1</td>\n",
              "      <td>2009-10-28</td>\n",
              "      <td>GSW</td>\n",
              "      <td>HOU</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>0.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>20900015</td>\n",
              "      <td>53</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>6</td>\n",
              "      <td>2</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>In The Paint (Non-RA)</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>8-16 ft.</td>\n",
              "      <td>14</td>\n",
              "      <td>-60</td>\n",
              "      <td>129</td>\n",
              "      <td>0</td>\n",
              "      <td>2009-10-28</td>\n",
              "      <td>GSW</td>\n",
              "      <td>HOU</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>-4.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>20900015</td>\n",
              "      <td>141</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>2</td>\n",
              "      <td>9</td>\n",
              "      <td>49</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Mid-Range</td>\n",
              "      <td>Left Side(L)</td>\n",
              "      <td>16-24 ft.</td>\n",
              "      <td>19</td>\n",
              "      <td>-172</td>\n",
              "      <td>82</td>\n",
              "      <td>0</td>\n",
              "      <td>2009-10-28</td>\n",
              "      <td>GSW</td>\n",
              "      <td>HOU</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>-4.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>20900015</td>\n",
              "      <td>249</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>2</td>\n",
              "      <td>2</td>\n",
              "      <td>19</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Mid-Range</td>\n",
              "      <td>Left Side Center(LC)</td>\n",
              "      <td>16-24 ft.</td>\n",
              "      <td>16</td>\n",
              "      <td>-68</td>\n",
              "      <td>148</td>\n",
              "      <td>0</td>\n",
              "      <td>2009-10-28</td>\n",
              "      <td>GSW</td>\n",
              "      <td>HOU</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>0.0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "    game_id  game_event_id  ...     season_type  scoremargin_before_shot\n",
              "0  20900015              4  ...  Regular Season                      2.0\n",
              "1  20900015             17  ...  Regular Season                      0.0\n",
              "2  20900015             53  ...  Regular Season                     -4.0\n",
              "3  20900015            141  ...  Regular Season                     -4.0\n",
              "4  20900015            249  ...  Regular Season                      0.0\n",
              "\n",
              "[5 rows x 20 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 78
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "1wkEixUiRXpH",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "7645a5bc-1397-4904-b4c0-a0eebf9dde09"
      },
      "source": [
        "target = df['shot_made_flag']\n",
        "majority_value = target.mode()[0]\n",
        "majority_value"
      ],
      "execution_count": 79,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 79
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "VF7Wz19FRdJH",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "180afcbf-8bdc-4613-b9f4-47f0d789c5ce"
      },
      "source": [
        "y_pred = [majority_value] * len(df)\n",
        "train_acc = accuracy_score(target, y_pred)\n",
        "print(f'The training majority baseline is {train_acc*100:.02f}%')"
      ],
      "execution_count": 80,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "The training majority baseline is 52.71%\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "colab_type": "text",
        "id": "Dz2QHBiVy_Br"
      },
      "source": [
        "## 2. Hold out your test set.\n",
        "\n",
        ">Use the 2018-19 season to test. NBA seasons begin in October and end in June. You'll know you've split the data correctly when your test set has 1,709 observations."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "KCyaMoT-RjlM",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "mask = (df['game_date'] > '2018-10-1') & (df['game_date'] <= '2019-6-31')"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "KqqqShUxRk6P",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 660
        },
        "outputId": "ac0c5ed5-c6a6-470d-caf3-9dc44681897d"
      },
      "source": [
        "test = df.loc[mask]\n",
        "test"
      ],
      "execution_count": 82,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>game_id</th>\n",
              "      <th>game_event_id</th>\n",
              "      <th>player_name</th>\n",
              "      <th>period</th>\n",
              "      <th>minutes_remaining</th>\n",
              "      <th>seconds_remaining</th>\n",
              "      <th>action_type</th>\n",
              "      <th>shot_type</th>\n",
              "      <th>shot_zone_basic</th>\n",
              "      <th>shot_zone_area</th>\n",
              "      <th>shot_zone_range</th>\n",
              "      <th>shot_distance</th>\n",
              "      <th>loc_x</th>\n",
              "      <th>loc_y</th>\n",
              "      <th>shot_made_flag</th>\n",
              "      <th>game_date</th>\n",
              "      <th>htm</th>\n",
              "      <th>vtm</th>\n",
              "      <th>season_type</th>\n",
              "      <th>scoremargin_before_shot</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>12249</th>\n",
              "      <td>21800002</td>\n",
              "      <td>10</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>11</td>\n",
              "      <td>31</td>\n",
              "      <td>Step Back Jump shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Above the Break 3</td>\n",
              "      <td>Right Side Center(RC)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>24</td>\n",
              "      <td>226</td>\n",
              "      <td>90</td>\n",
              "      <td>1</td>\n",
              "      <td>2018-10-16</td>\n",
              "      <td>GSW</td>\n",
              "      <td>OKC</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>0.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>12250</th>\n",
              "      <td>21800002</td>\n",
              "      <td>58</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>7</td>\n",
              "      <td>57</td>\n",
              "      <td>Driving Floating Jump Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>In The Paint (Non-RA)</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>Less Than 8 ft.</td>\n",
              "      <td>6</td>\n",
              "      <td>-2</td>\n",
              "      <td>63</td>\n",
              "      <td>1</td>\n",
              "      <td>2018-10-16</td>\n",
              "      <td>GSW</td>\n",
              "      <td>OKC</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>4.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>12251</th>\n",
              "      <td>21800002</td>\n",
              "      <td>131</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>3</td>\n",
              "      <td>46</td>\n",
              "      <td>Driving Layup Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Restricted Area</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>Less Than 8 ft.</td>\n",
              "      <td>2</td>\n",
              "      <td>5</td>\n",
              "      <td>29</td>\n",
              "      <td>1</td>\n",
              "      <td>2018-10-16</td>\n",
              "      <td>GSW</td>\n",
              "      <td>OKC</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>4.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>12252</th>\n",
              "      <td>21800002</td>\n",
              "      <td>141</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>2</td>\n",
              "      <td>58</td>\n",
              "      <td>Driving Reverse Layup Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Restricted Area</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>Less Than 8 ft.</td>\n",
              "      <td>1</td>\n",
              "      <td>-6</td>\n",
              "      <td>18</td>\n",
              "      <td>0</td>\n",
              "      <td>2018-10-16</td>\n",
              "      <td>GSW</td>\n",
              "      <td>OKC</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>7.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>12253</th>\n",
              "      <td>21800002</td>\n",
              "      <td>145</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>2</td>\n",
              "      <td>49</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Left Corner 3</td>\n",
              "      <td>Left Side(L)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>22</td>\n",
              "      <td>-228</td>\n",
              "      <td>8</td>\n",
              "      <td>1</td>\n",
              "      <td>2018-10-16</td>\n",
              "      <td>GSW</td>\n",
              "      <td>OKC</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>7.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>13953</th>\n",
              "      <td>41800403</td>\n",
              "      <td>570</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>4</td>\n",
              "      <td>8</td>\n",
              "      <td>1</td>\n",
              "      <td>Pullup Jump shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>In The Paint (Non-RA)</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>8-16 ft.</td>\n",
              "      <td>12</td>\n",
              "      <td>3</td>\n",
              "      <td>120</td>\n",
              "      <td>1</td>\n",
              "      <td>2019-06-05</td>\n",
              "      <td>GSW</td>\n",
              "      <td>TOR</td>\n",
              "      <td>Playoffs</td>\n",
              "      <td>-13.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>13954</th>\n",
              "      <td>41800403</td>\n",
              "      <td>573</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>4</td>\n",
              "      <td>7</td>\n",
              "      <td>16</td>\n",
              "      <td>Floating Jump shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Mid-Range</td>\n",
              "      <td>Right Side(R)</td>\n",
              "      <td>8-16 ft.</td>\n",
              "      <td>11</td>\n",
              "      <td>114</td>\n",
              "      <td>-5</td>\n",
              "      <td>0</td>\n",
              "      <td>2019-06-05</td>\n",
              "      <td>GSW</td>\n",
              "      <td>TOR</td>\n",
              "      <td>Playoffs</td>\n",
              "      <td>-14.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>13955</th>\n",
              "      <td>41800403</td>\n",
              "      <td>602</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>4</td>\n",
              "      <td>5</td>\n",
              "      <td>27</td>\n",
              "      <td>Step Back Jump shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Above the Break 3</td>\n",
              "      <td>Left Side Center(LC)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>26</td>\n",
              "      <td>-217</td>\n",
              "      <td>149</td>\n",
              "      <td>0</td>\n",
              "      <td>2019-06-05</td>\n",
              "      <td>GSW</td>\n",
              "      <td>TOR</td>\n",
              "      <td>Playoffs</td>\n",
              "      <td>-17.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>13956</th>\n",
              "      <td>41800403</td>\n",
              "      <td>608</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>4</td>\n",
              "      <td>4</td>\n",
              "      <td>50</td>\n",
              "      <td>Driving Floating Jump Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>In The Paint (Non-RA)</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>Less Than 8 ft.</td>\n",
              "      <td>7</td>\n",
              "      <td>59</td>\n",
              "      <td>49</td>\n",
              "      <td>0</td>\n",
              "      <td>2019-06-05</td>\n",
              "      <td>GSW</td>\n",
              "      <td>TOR</td>\n",
              "      <td>Playoffs</td>\n",
              "      <td>-16.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>13957</th>\n",
              "      <td>41800403</td>\n",
              "      <td>658</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>4</td>\n",
              "      <td>2</td>\n",
              "      <td>47</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Above the Break 3</td>\n",
              "      <td>Left Side Center(LC)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>24</td>\n",
              "      <td>-226</td>\n",
              "      <td>104</td>\n",
              "      <td>0</td>\n",
              "      <td>2019-06-05</td>\n",
              "      <td>GSW</td>\n",
              "      <td>TOR</td>\n",
              "      <td>Playoffs</td>\n",
              "      <td>-12.0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>1709 rows × 20 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "        game_id  game_event_id  ...     season_type  scoremargin_before_shot\n",
              "12249  21800002             10  ...  Regular Season                      0.0\n",
              "12250  21800002             58  ...  Regular Season                      4.0\n",
              "12251  21800002            131  ...  Regular Season                      4.0\n",
              "12252  21800002            141  ...  Regular Season                      7.0\n",
              "12253  21800002            145  ...  Regular Season                      7.0\n",
              "...         ...            ...  ...             ...                      ...\n",
              "13953  41800403            570  ...        Playoffs                    -13.0\n",
              "13954  41800403            573  ...        Playoffs                    -14.0\n",
              "13955  41800403            602  ...        Playoffs                    -17.0\n",
              "13956  41800403            608  ...        Playoffs                    -16.0\n",
              "13957  41800403            658  ...        Playoffs                    -12.0\n",
              "\n",
              "[1709 rows x 20 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 82
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "WVtmUHUORsFD",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "train = df[~mask]"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "oo_DuPt4RtmA",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 626
        },
        "outputId": "9bd2d607-0c06-4279-cf49-dfe948a967e2"
      },
      "source": [
        "train"
      ],
      "execution_count": 84,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>game_id</th>\n",
              "      <th>game_event_id</th>\n",
              "      <th>player_name</th>\n",
              "      <th>period</th>\n",
              "      <th>minutes_remaining</th>\n",
              "      <th>seconds_remaining</th>\n",
              "      <th>action_type</th>\n",
              "      <th>shot_type</th>\n",
              "      <th>shot_zone_basic</th>\n",
              "      <th>shot_zone_area</th>\n",
              "      <th>shot_zone_range</th>\n",
              "      <th>shot_distance</th>\n",
              "      <th>loc_x</th>\n",
              "      <th>loc_y</th>\n",
              "      <th>shot_made_flag</th>\n",
              "      <th>game_date</th>\n",
              "      <th>htm</th>\n",
              "      <th>vtm</th>\n",
              "      <th>season_type</th>\n",
              "      <th>scoremargin_before_shot</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>20900015</td>\n",
              "      <td>4</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>11</td>\n",
              "      <td>25</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Above the Break 3</td>\n",
              "      <td>Right Side Center(RC)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>26</td>\n",
              "      <td>99</td>\n",
              "      <td>249</td>\n",
              "      <td>0</td>\n",
              "      <td>2009-10-28</td>\n",
              "      <td>GSW</td>\n",
              "      <td>HOU</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>2.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>20900015</td>\n",
              "      <td>17</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>9</td>\n",
              "      <td>31</td>\n",
              "      <td>Step Back Jump shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Mid-Range</td>\n",
              "      <td>Left Side Center(LC)</td>\n",
              "      <td>16-24 ft.</td>\n",
              "      <td>18</td>\n",
              "      <td>-122</td>\n",
              "      <td>145</td>\n",
              "      <td>1</td>\n",
              "      <td>2009-10-28</td>\n",
              "      <td>GSW</td>\n",
              "      <td>HOU</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>0.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>20900015</td>\n",
              "      <td>53</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>6</td>\n",
              "      <td>2</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>In The Paint (Non-RA)</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>8-16 ft.</td>\n",
              "      <td>14</td>\n",
              "      <td>-60</td>\n",
              "      <td>129</td>\n",
              "      <td>0</td>\n",
              "      <td>2009-10-28</td>\n",
              "      <td>GSW</td>\n",
              "      <td>HOU</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>-4.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>20900015</td>\n",
              "      <td>141</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>2</td>\n",
              "      <td>9</td>\n",
              "      <td>49</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Mid-Range</td>\n",
              "      <td>Left Side(L)</td>\n",
              "      <td>16-24 ft.</td>\n",
              "      <td>19</td>\n",
              "      <td>-172</td>\n",
              "      <td>82</td>\n",
              "      <td>0</td>\n",
              "      <td>2009-10-28</td>\n",
              "      <td>GSW</td>\n",
              "      <td>HOU</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>-4.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>20900015</td>\n",
              "      <td>249</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>2</td>\n",
              "      <td>2</td>\n",
              "      <td>19</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Mid-Range</td>\n",
              "      <td>Left Side Center(LC)</td>\n",
              "      <td>16-24 ft.</td>\n",
              "      <td>16</td>\n",
              "      <td>-68</td>\n",
              "      <td>148</td>\n",
              "      <td>0</td>\n",
              "      <td>2009-10-28</td>\n",
              "      <td>GSW</td>\n",
              "      <td>HOU</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>0.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>12244</th>\n",
              "      <td>41700404</td>\n",
              "      <td>582</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>4</td>\n",
              "      <td>6</td>\n",
              "      <td>19</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Left Corner 3</td>\n",
              "      <td>Left Side(L)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>24</td>\n",
              "      <td>-240</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>2018-06-08</td>\n",
              "      <td>CLE</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Playoffs</td>\n",
              "      <td>25.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>12245</th>\n",
              "      <td>41700404</td>\n",
              "      <td>588</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>4</td>\n",
              "      <td>5</td>\n",
              "      <td>48</td>\n",
              "      <td>Driving Floating Jump Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Mid-Range</td>\n",
              "      <td>Left Side(L)</td>\n",
              "      <td>8-16 ft.</td>\n",
              "      <td>14</td>\n",
              "      <td>-115</td>\n",
              "      <td>89</td>\n",
              "      <td>0</td>\n",
              "      <td>2018-06-08</td>\n",
              "      <td>CLE</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Playoffs</td>\n",
              "      <td>28.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>12246</th>\n",
              "      <td>41700404</td>\n",
              "      <td>591</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>4</td>\n",
              "      <td>5</td>\n",
              "      <td>13</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Above the Break 3</td>\n",
              "      <td>Left Side Center(LC)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>34</td>\n",
              "      <td>-116</td>\n",
              "      <td>330</td>\n",
              "      <td>0</td>\n",
              "      <td>2018-06-08</td>\n",
              "      <td>CLE</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Playoffs</td>\n",
              "      <td>26.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>12247</th>\n",
              "      <td>41700404</td>\n",
              "      <td>603</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>4</td>\n",
              "      <td>4</td>\n",
              "      <td>27</td>\n",
              "      <td>Cutting Layup Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Restricted Area</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>Less Than 8 ft.</td>\n",
              "      <td>1</td>\n",
              "      <td>14</td>\n",
              "      <td>11</td>\n",
              "      <td>0</td>\n",
              "      <td>2018-06-08</td>\n",
              "      <td>CLE</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Playoffs</td>\n",
              "      <td>25.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>12248</th>\n",
              "      <td>41700404</td>\n",
              "      <td>614</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>4</td>\n",
              "      <td>3</td>\n",
              "      <td>49</td>\n",
              "      <td>Driving Layup Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>In The Paint (Non-RA)</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>Less Than 8 ft.</td>\n",
              "      <td>6</td>\n",
              "      <td>13</td>\n",
              "      <td>59</td>\n",
              "      <td>0</td>\n",
              "      <td>2018-06-08</td>\n",
              "      <td>CLE</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Playoffs</td>\n",
              "      <td>25.0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>12249 rows × 20 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "        game_id  game_event_id  ...     season_type  scoremargin_before_shot\n",
              "0      20900015              4  ...  Regular Season                      2.0\n",
              "1      20900015             17  ...  Regular Season                      0.0\n",
              "2      20900015             53  ...  Regular Season                     -4.0\n",
              "3      20900015            141  ...  Regular Season                     -4.0\n",
              "4      20900015            249  ...  Regular Season                      0.0\n",
              "...         ...            ...  ...             ...                      ...\n",
              "12244  41700404            582  ...        Playoffs                     25.0\n",
              "12245  41700404            588  ...        Playoffs                     28.0\n",
              "12246  41700404            591  ...        Playoffs                     26.0\n",
              "12247  41700404            603  ...        Playoffs                     25.0\n",
              "12248  41700404            614  ...        Playoffs                     25.0\n",
              "\n",
              "[12249 rows x 20 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 84
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "colab_type": "text",
        "id": "P9Nihzk6y_CF"
      },
      "source": [
        "## 3. Engineer new feature.\n",
        "\n",
        ">Engineer at least **1** new feature, from this list, or your own idea.\n",
        ">\n",
        ">- **Homecourt Advantage**: Is the home team (`htm`) the Golden State Warriors (`GSW`) ?\n",
        ">- **Opponent**: Who is the other team playing the Golden State Warriors?\n",
        ">- **Seconds remaining in the period**: Combine minutes remaining with seconds remaining, to get the total number of seconds remaining in the period.\n",
        ">- **Seconds remaining in the game**: Combine period, and seconds remaining in the period, to get the total number of seconds remaining in the game. A basketball game has 4 periods, each 12 minutes long.\n",
        ">- **Made previous shot**: Was Steph Curry's previous shot successful?\n",
        "\n",
        "    "
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "eUNZCC_WR5jA",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 289
        },
        "outputId": "d109a0dd-763f-43c4-91c1-db9f452fda1f"
      },
      "source": [
        "train['seconds_in_period_remaining'] = (train['minutes_remaining'] * 60) + train['seconds_remaining']\n",
        "test['seconds_in_period_remaining'] = (test['minutes_remaining'] * 60) + test['seconds_remaining']"
      ],
      "execution_count": 85,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "/usr/local/lib/python3.6/dist-packages/ipykernel_launcher.py:1: SettingWithCopyWarning:\n",
            "\n",
            "\n",
            "A value is trying to be set on a copy of a slice from a DataFrame.\n",
            "Try using .loc[row_indexer,col_indexer] = value instead\n",
            "\n",
            "See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy\n",
            "\n",
            "/usr/local/lib/python3.6/dist-packages/ipykernel_launcher.py:2: SettingWithCopyWarning:\n",
            "\n",
            "\n",
            "A value is trying to be set on a copy of a slice from a DataFrame.\n",
            "Try using .loc[row_indexer,col_indexer] = value instead\n",
            "\n",
            "See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy\n",
            "\n"
          ],
          "name": "stderr"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "O3Njk1yhSBDJ",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 221
        },
        "outputId": "ec38770e-587f-4337-9354-af4e06ea4fc2"
      },
      "source": [
        "test['seconds_in_period_remaining']"
      ],
      "execution_count": 86,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "12249    691\n",
              "12250    477\n",
              "12251    226\n",
              "12252    178\n",
              "12253    169\n",
              "        ... \n",
              "13953    481\n",
              "13954    436\n",
              "13955    327\n",
              "13956    290\n",
              "13957    167\n",
              "Name: seconds_in_period_remaining, Length: 1709, dtype: int64"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 86
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "colab_type": "text",
        "id": "eLs7pt7NFJLF"
      },
      "source": [
        "## **4. Decide how to validate** your model. \n",
        "\n",
        ">Choose one of the following options. Any of these options are good. You are not graded on which you choose.\n",
        ">\n",
        ">- **Train/validate/test split: train on the 2009-10 season through 2016-17 season, validate with the 2017-18 season.** You'll know you've split the data correctly when your train set has 11,081 observations, and your validation set has 1,168 observations.\n",
        ">- **Train/validate/test split: random 80/20%** train/validate split.\n",
        ">- **Cross-validation** with independent test set. You may use any scikit-learn cross-validation method."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "r8shMJYHSH-B",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "train, val = train_test_split(train, train_size= 0.861, random_state=42)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "jiXOtcxRSKES",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 626
        },
        "outputId": "0889a93f-cb08-4f3f-fd4d-ef2b96f06ed2"
      },
      "source": [
        "train"
      ],
      "execution_count": 88,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>game_id</th>\n",
              "      <th>game_event_id</th>\n",
              "      <th>player_name</th>\n",
              "      <th>period</th>\n",
              "      <th>minutes_remaining</th>\n",
              "      <th>seconds_remaining</th>\n",
              "      <th>action_type</th>\n",
              "      <th>shot_type</th>\n",
              "      <th>shot_zone_basic</th>\n",
              "      <th>shot_zone_area</th>\n",
              "      <th>shot_zone_range</th>\n",
              "      <th>shot_distance</th>\n",
              "      <th>loc_x</th>\n",
              "      <th>loc_y</th>\n",
              "      <th>shot_made_flag</th>\n",
              "      <th>game_date</th>\n",
              "      <th>htm</th>\n",
              "      <th>vtm</th>\n",
              "      <th>season_type</th>\n",
              "      <th>scoremargin_before_shot</th>\n",
              "      <th>seconds_in_period_remaining</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>5147</th>\n",
              "      <td>21300899</td>\n",
              "      <td>26</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>9</td>\n",
              "      <td>24</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Mid-Range</td>\n",
              "      <td>Right Side Center(RC)</td>\n",
              "      <td>16-24 ft.</td>\n",
              "      <td>22</td>\n",
              "      <td>174</td>\n",
              "      <td>138</td>\n",
              "      <td>0</td>\n",
              "      <td>2014-03-04</td>\n",
              "      <td>IND</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>-2.0</td>\n",
              "      <td>564</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>9004</th>\n",
              "      <td>41500144</td>\n",
              "      <td>19</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>9</td>\n",
              "      <td>45</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Above the Break 3</td>\n",
              "      <td>Right Side Center(RC)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>25</td>\n",
              "      <td>159</td>\n",
              "      <td>203</td>\n",
              "      <td>0</td>\n",
              "      <td>2016-04-24</td>\n",
              "      <td>HOU</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Playoffs</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>585</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>7825</th>\n",
              "      <td>21500300</td>\n",
              "      <td>250</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>2</td>\n",
              "      <td>2</td>\n",
              "      <td>45</td>\n",
              "      <td>Floating Jump shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Mid-Range</td>\n",
              "      <td>Right Side(R)</td>\n",
              "      <td>8-16 ft.</td>\n",
              "      <td>15</td>\n",
              "      <td>84</td>\n",
              "      <td>129</td>\n",
              "      <td>1</td>\n",
              "      <td>2015-12-06</td>\n",
              "      <td>BKN</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>9.0</td>\n",
              "      <td>165</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>7738</th>\n",
              "      <td>21500236</td>\n",
              "      <td>123</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "      <td>3</td>\n",
              "      <td>Driving Reverse Layup Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Restricted Area</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>Less Than 8 ft.</td>\n",
              "      <td>1</td>\n",
              "      <td>-17</td>\n",
              "      <td>-1</td>\n",
              "      <td>0</td>\n",
              "      <td>2015-11-27</td>\n",
              "      <td>PHX</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>17.0</td>\n",
              "      <td>3</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3884</th>\n",
              "      <td>41200161</td>\n",
              "      <td>190</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>2</td>\n",
              "      <td>7</td>\n",
              "      <td>19</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Mid-Range</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>16-24 ft.</td>\n",
              "      <td>17</td>\n",
              "      <td>-34</td>\n",
              "      <td>168</td>\n",
              "      <td>0</td>\n",
              "      <td>2013-04-20</td>\n",
              "      <td>DEN</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Playoffs</td>\n",
              "      <td>4.0</td>\n",
              "      <td>439</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>11964</th>\n",
              "      <td>41700233</td>\n",
              "      <td>112</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>2</td>\n",
              "      <td>32</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Above the Break 3</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>25</td>\n",
              "      <td>-16</td>\n",
              "      <td>258</td>\n",
              "      <td>0</td>\n",
              "      <td>2018-05-04</td>\n",
              "      <td>NOP</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Playoffs</td>\n",
              "      <td>-13.0</td>\n",
              "      <td>152</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>5191</th>\n",
              "      <td>21300942</td>\n",
              "      <td>289</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>3</td>\n",
              "      <td>8</td>\n",
              "      <td>42</td>\n",
              "      <td>Pullup Jump shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Above the Break 3</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>25</td>\n",
              "      <td>-18</td>\n",
              "      <td>254</td>\n",
              "      <td>0</td>\n",
              "      <td>2014-03-09</td>\n",
              "      <td>GSW</td>\n",
              "      <td>PHX</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>522</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>5390</th>\n",
              "      <td>21301141</td>\n",
              "      <td>372</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>3</td>\n",
              "      <td>2</td>\n",
              "      <td>45</td>\n",
              "      <td>Pullup Jump shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Mid-Range</td>\n",
              "      <td>Left Side Center(LC)</td>\n",
              "      <td>16-24 ft.</td>\n",
              "      <td>18</td>\n",
              "      <td>-128</td>\n",
              "      <td>132</td>\n",
              "      <td>0</td>\n",
              "      <td>2014-04-04</td>\n",
              "      <td>GSW</td>\n",
              "      <td>SAC</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>33.0</td>\n",
              "      <td>165</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>860</th>\n",
              "      <td>20900982</td>\n",
              "      <td>295</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>3</td>\n",
              "      <td>9</td>\n",
              "      <td>35</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Left Corner 3</td>\n",
              "      <td>Left Side(L)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>22</td>\n",
              "      <td>-228</td>\n",
              "      <td>20</td>\n",
              "      <td>1</td>\n",
              "      <td>2010-03-13</td>\n",
              "      <td>GSW</td>\n",
              "      <td>TOR</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>3.0</td>\n",
              "      <td>575</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>7270</th>\n",
              "      <td>41400315</td>\n",
              "      <td>557</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>4</td>\n",
              "      <td>2</td>\n",
              "      <td>59</td>\n",
              "      <td>Pullup Jump shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Above the Break 3</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>27</td>\n",
              "      <td>-16</td>\n",
              "      <td>274</td>\n",
              "      <td>0</td>\n",
              "      <td>2015-05-27</td>\n",
              "      <td>GSW</td>\n",
              "      <td>HOU</td>\n",
              "      <td>Playoffs</td>\n",
              "      <td>13.0</td>\n",
              "      <td>179</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>10546 rows × 21 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "        game_id  ...  seconds_in_period_remaining\n",
              "5147   21300899  ...                          564\n",
              "9004   41500144  ...                          585\n",
              "7825   21500300  ...                          165\n",
              "7738   21500236  ...                            3\n",
              "3884   41200161  ...                          439\n",
              "...         ...  ...                          ...\n",
              "11964  41700233  ...                          152\n",
              "5191   21300942  ...                          522\n",
              "5390   21301141  ...                          165\n",
              "860    20900982  ...                          575\n",
              "7270   41400315  ...                          179\n",
              "\n",
              "[10546 rows x 21 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 88
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "obPuayaPSOO4",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 609
        },
        "outputId": "ae14bfbe-2dae-4f8c-d2ae-8e64a1024a35"
      },
      "source": [
        "val"
      ],
      "execution_count": 89,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>game_id</th>\n",
              "      <th>game_event_id</th>\n",
              "      <th>player_name</th>\n",
              "      <th>period</th>\n",
              "      <th>minutes_remaining</th>\n",
              "      <th>seconds_remaining</th>\n",
              "      <th>action_type</th>\n",
              "      <th>shot_type</th>\n",
              "      <th>shot_zone_basic</th>\n",
              "      <th>shot_zone_area</th>\n",
              "      <th>shot_zone_range</th>\n",
              "      <th>shot_distance</th>\n",
              "      <th>loc_x</th>\n",
              "      <th>loc_y</th>\n",
              "      <th>shot_made_flag</th>\n",
              "      <th>game_date</th>\n",
              "      <th>htm</th>\n",
              "      <th>vtm</th>\n",
              "      <th>season_type</th>\n",
              "      <th>scoremargin_before_shot</th>\n",
              "      <th>seconds_in_period_remaining</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>5026</th>\n",
              "      <td>21300788</td>\n",
              "      <td>375</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>3</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>Step Back Jump shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Above the Break 3</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>25</td>\n",
              "      <td>0</td>\n",
              "      <td>254</td>\n",
              "      <td>1</td>\n",
              "      <td>2014-02-12</td>\n",
              "      <td>GSW</td>\n",
              "      <td>MIA</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>-5.0</td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>6676</th>\n",
              "      <td>21400999</td>\n",
              "      <td>2</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>11</td>\n",
              "      <td>44</td>\n",
              "      <td>Step Back Jump shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Mid-Range</td>\n",
              "      <td>Right Side Center(RC)</td>\n",
              "      <td>16-24 ft.</td>\n",
              "      <td>22</td>\n",
              "      <td>99</td>\n",
              "      <td>203</td>\n",
              "      <td>0</td>\n",
              "      <td>2015-03-16</td>\n",
              "      <td>GSW</td>\n",
              "      <td>LAL</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>0.0</td>\n",
              "      <td>704</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>9794</th>\n",
              "      <td>21600405</td>\n",
              "      <td>84</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>3</td>\n",
              "      <td>20</td>\n",
              "      <td>Cutting Layup Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Restricted Area</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>Less Than 8 ft.</td>\n",
              "      <td>2</td>\n",
              "      <td>-1</td>\n",
              "      <td>23</td>\n",
              "      <td>1</td>\n",
              "      <td>2016-12-17</td>\n",
              "      <td>GSW</td>\n",
              "      <td>POR</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>9.0</td>\n",
              "      <td>200</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>5577</th>\n",
              "      <td>41300166</td>\n",
              "      <td>57</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>6</td>\n",
              "      <td>5</td>\n",
              "      <td>Driving Layup Shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Restricted Area</td>\n",
              "      <td>Center(C)</td>\n",
              "      <td>Less Than 8 ft.</td>\n",
              "      <td>1</td>\n",
              "      <td>13</td>\n",
              "      <td>12</td>\n",
              "      <td>1</td>\n",
              "      <td>2014-05-01</td>\n",
              "      <td>GSW</td>\n",
              "      <td>LAC</td>\n",
              "      <td>Playoffs</td>\n",
              "      <td>-7.0</td>\n",
              "      <td>365</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>9399</th>\n",
              "      <td>21600054</td>\n",
              "      <td>405</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>3</td>\n",
              "      <td>1</td>\n",
              "      <td>11</td>\n",
              "      <td>Pullup Jump shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Mid-Range</td>\n",
              "      <td>Right Side Center(RC)</td>\n",
              "      <td>16-24 ft.</td>\n",
              "      <td>22</td>\n",
              "      <td>102</td>\n",
              "      <td>198</td>\n",
              "      <td>0</td>\n",
              "      <td>2016-11-01</td>\n",
              "      <td>POR</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>23.0</td>\n",
              "      <td>71</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2536</th>\n",
              "      <td>21200036</td>\n",
              "      <td>503</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>3</td>\n",
              "      <td>0</td>\n",
              "      <td>59</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Above the Break 3</td>\n",
              "      <td>Right Side Center(RC)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>26</td>\n",
              "      <td>143</td>\n",
              "      <td>227</td>\n",
              "      <td>0</td>\n",
              "      <td>2012-11-03</td>\n",
              "      <td>LAC</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>6.0</td>\n",
              "      <td>59</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>6504</th>\n",
              "      <td>21400838</td>\n",
              "      <td>81</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>1</td>\n",
              "      <td>4</td>\n",
              "      <td>42</td>\n",
              "      <td>Pullup Jump shot</td>\n",
              "      <td>2PT Field Goal</td>\n",
              "      <td>Mid-Range</td>\n",
              "      <td>Left Side Center(LC)</td>\n",
              "      <td>16-24 ft.</td>\n",
              "      <td>18</td>\n",
              "      <td>-116</td>\n",
              "      <td>142</td>\n",
              "      <td>1</td>\n",
              "      <td>2015-02-24</td>\n",
              "      <td>WAS</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>-5.0</td>\n",
              "      <td>282</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4189</th>\n",
              "      <td>21300091</td>\n",
              "      <td>197</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>2</td>\n",
              "      <td>5</td>\n",
              "      <td>25</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Right Corner 3</td>\n",
              "      <td>Right Side(R)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>23</td>\n",
              "      <td>231</td>\n",
              "      <td>-13</td>\n",
              "      <td>1</td>\n",
              "      <td>2013-11-09</td>\n",
              "      <td>MEM</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>-8.0</td>\n",
              "      <td>325</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3422</th>\n",
              "      <td>21200853</td>\n",
              "      <td>491</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>4</td>\n",
              "      <td>3</td>\n",
              "      <td>42</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Above the Break 3</td>\n",
              "      <td>Right Side Center(RC)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>24</td>\n",
              "      <td>207</td>\n",
              "      <td>140</td>\n",
              "      <td>1</td>\n",
              "      <td>2013-02-27</td>\n",
              "      <td>NYK</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>-2.0</td>\n",
              "      <td>222</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2818</th>\n",
              "      <td>21200299</td>\n",
              "      <td>344</td>\n",
              "      <td>Stephen Curry</td>\n",
              "      <td>3</td>\n",
              "      <td>5</td>\n",
              "      <td>34</td>\n",
              "      <td>Jump Shot</td>\n",
              "      <td>3PT Field Goal</td>\n",
              "      <td>Left Corner 3</td>\n",
              "      <td>Left Side(L)</td>\n",
              "      <td>24+ ft.</td>\n",
              "      <td>24</td>\n",
              "      <td>-242</td>\n",
              "      <td>3</td>\n",
              "      <td>1</td>\n",
              "      <td>2012-12-10</td>\n",
              "      <td>CHA</td>\n",
              "      <td>GSW</td>\n",
              "      <td>Regular Season</td>\n",
              "      <td>13.0</td>\n",
              "      <td>334</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>1703 rows × 21 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "       game_id  ...  seconds_in_period_remaining\n",
              "5026  21300788  ...                            1\n",
              "6676  21400999  ...                          704\n",
              "9794  21600405  ...                          200\n",
              "5577  41300166  ...                          365\n",
              "9399  21600054  ...                           71\n",
              "...        ...  ...                          ...\n",
              "2536  21200036  ...                           59\n",
              "6504  21400838  ...                          282\n",
              "4189  21300091  ...                          325\n",
              "3422  21200853  ...                          222\n",
              "2818  21200299  ...                          334\n",
              "\n",
              "[1703 rows x 21 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 89
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "colab_type": "text",
        "id": "oQ2lWlu7JPRt"
      },
      "source": [
        "## 5. Use a scikit-learn pipeline to encode categoricals and fit a Decision Tree or Random Forest model."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "XHERGdvhSMYN",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "target = 'shot_made_flag'\n",
        "train, val = train_test_split(train, test_size=len(test),  \n",
        "                              stratify=train[target], random_state=42)\n",
        "\n",
        "\n",
        "\n",
        "# Arrange data into X features matrix and y target vector\n",
        "X_train = train.drop(columns=target)\n",
        "y_train = train[target]\n",
        "X_val = val.drop(columns=target)\n",
        "y_val = val[target]\n",
        "X_test = test.drop('shot_made_flag', axis=1)\n",
        "\n",
        "# Make pipeline!\n",
        "pipeline = make_pipeline(\n",
        "    ce.OrdinalEncoder(), \n",
        "    SimpleImputer(strategy='mean'), \n",
        "    RandomForestClassifier(n_estimators=100, random_state=42, n_jobs=-1,))\n",
        "\n"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "colab_type": "text",
        "id": "8kJXxFpty_CH"
      },
      "source": [
        "## 6.Get your model's validation accuracy\n",
        "\n",
        "> (Multiple times if you try multiple iterations.)"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "538QtvbuShPz",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 51
        },
        "outputId": "8a019f3c-6767-47ba-b89f-c3897952b676"
      },
      "source": [
        "# Fit on train, score on val\n",
        "pipeline.fit(X_train, y_train)\n",
        "y_pred = pipeline.predict(X_val)\n",
        "print('Train Accuracy', pipeline.score(X_train, y_train))\n",
        "print('Validation Accuracy', accuracy_score(y_val, y_pred))"
      ],
      "execution_count": 91,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Train Accuracy 1.0\n",
            "Validation Accuracy 0.6483323581041545\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "colab_type": "text",
        "id": "YvyYY9tfy_CL"
      },
      "source": [
        "## 7. Get your model's test accuracy\n",
        "\n",
        "> (One time, at the end.)"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "h6EUULB7SnrS",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 51
        },
        "outputId": "ba362a20-5d47-459e-9d58-505b9e6728b9"
      },
      "source": [
        "pipeline.fit(X_train, y_train)\n",
        "y_pred = pipeline.predict(X_test)\n",
        "print('Train Accuracy', pipeline.score(X_train, y_train))\n",
        "print('Test Accuracy', accuracy_score(y_val, y_pred))"
      ],
      "execution_count": 92,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Train Accuracy 1.0\n",
            "Test Accuracy 0.5102399063779989\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "xGL5stLvJCn1",
        "colab_type": "text"
      },
      "source": [
        "## 8. Given a confusion matrix, calculate accuracy, precision, and recall.\n",
        "\n",
        "Imagine this is the confusion matrix for a binary classification model. Use the confusion matrix to calculate the model's accuracy, precision, and recall.\n",
        "\n",
        "<table>\n",
        "  <tr>\n",
        "    <td colspan=\"2\" rowspan=\"2\"></td>\n",
        "    <td colspan=\"2\">Predicted</td>\n",
        "  </tr>\n",
        "  <tr>\n",
        "    <td>Negative</td>\n",
        "    <td>Positive</td>\n",
        "  </tr>\n",
        "  <tr>\n",
        "    <td rowspan=\"2\">Actual</td>\n",
        "    <td>Negative</td>\n",
        "    <td style=\"border: solid\">85</td>\n",
        "    <td style=\"border: solid\">58</td>\n",
        "  </tr>\n",
        "  <tr>\n",
        "    <td>Positive</td>\n",
        "    <td style=\"border: solid\">8</td>\n",
        "    <td style=\"border: solid\"> 36</td>\n",
        "  </tr>\n",
        "</table>"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "nEvt7NkUJNao",
        "colab_type": "text"
      },
      "source": [
        "### Calculate accuracy "
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "OtHH7wnQTuv2",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 276
        },
        "outputId": "a6b8c365-520f-4229-d3cc-8b7f114736db"
      },
      "source": [
        "# If we are working with the data then the matrix would look like this\n",
        "\n",
        "plot_confusion_matrix(pipeline, X_val, y_val, values_format='.0f', xticks_rotation='vertical');"
      ],
      "execution_count": 93,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAATgAAAEDCAYAAAChwhgEAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+j8jraAAAdjElEQVR4nO3deZhcVb3u8e/bnYROh4x0CJ2BQQkyHYkxhMnLgaAyyBX0gvOFi2gcAD1wROBcRQXxyD1iQDiAEZAgCiKCRg8yGOAAIoQAIUCYIglkDp0JMnWS7t/9o3aTJnRX106quqp2v5/n2U9Xrb322qsJ+WWtvdZeSxGBmVkW1ZS7AmZmpeIAZ2aZ5QBnZpnlAGdmmeUAZ2aZ5QBnZpnVq9wVaK9hSG3sPqp3uathKbw8q77cVbAUNrCWjdGs7Snj6CP7xfIVLQXlfXJW8z0Rccz23G97VFSA231Ub6bfM6rc1bAUjh4+ptxVsBQej2nbXUbTihYev2dkQXl7N/6jYbtvuB0qKsCZWTUIWqK13JUoiAOcmaUSQCvV8QaUA5yZpdaKW3BmlkFB0FIl77A7wJlZKgFscgvOzLLKz+DMLJMC3EU1s+yqjg6qX9Uys5SCoKXAoyuSBkm6XdKLkl6QdIikIZLuk/RK8nNwkleSfiZpjqRZksZ2Vb4DnJmlE9BS4FGAK4C7I2Jv4ADgBeB8YFpEjAamJd8BjgVGJ8dE4JquCneAM7NUArGpwCMfSQOBw4HrASJiY0SsAk4ApiTZpgAnJp9PAG6KnMeAQZIa893DAc7MUgmgNQo7gAZJM9odE9sVtQfwBvBLSU9Luk5SP2BYRCxO8iwBhiWfRwDz212/IEnrlAcZzCy1li5aZ+00RcS4Ts71AsYCZ0XE45KuYEt3FICICEnbPGTrFpyZpRLkAlwhRxcWAAsi4vHk++3kAt7Stq5n8nNZcn4h0H65oZFJWqcc4MwstdZQQUc+EbEEmC/pfUnSUcBsYCpwapJ2KvDH5PNU4JRkNPVgYHW7rmyH3EU1s1RaERupLVZxZwG/ltQHeBU4jVzD6zZJpwOvAZ9K8t4FHAfMAdYlefNygDOz1LpqnRUqImYCHT2jO6qDvAGckaZ8BzgzS6XtGVw1cIAzs5RES1TH43sHODNLJbeirwOcmWWUu6hmlkkRYlMUbRS1pBzgzCyV3CCDu6hmlkkeZDCzjPIgg5llWkuRJvqWmgOcmaUSyM/gzCybAtgU1RE6qqOWZlYxArmLambZ5UEGM8ukCDxNxMyySrT6VS0zy6IANnqQwcyyKOh6OfJK4QBnZql5HpyZZVJuX1QHODPLpIK2BKwIDnBmlopbcGaWWV7w0swyrVom+lZHLc2sYuTWg1NBR1ckzZP0rKSZkmYkad+XtDBJmynpuHb5L5A0R9JLko7uqny34MwspaKv6HtkRDRtlTYpIn7yjrtK+wKfAfYDhgN/lbRXRLR0VrBbcGaWSm6QQQUdRXYCcGtENEfEXGAOMD7fBQ5wZpZKkBtkKOQAGiTNaHdMfFdxcK+kJ7c6d6akWZJukDQ4SRsBzG+XZ0GS1il3Uc0stRTLJTVFxLg85z8UEQsl7QzcJ+lF4BrgYnLB72LgMuCL21JPt+DMLJXcckkq6Oi6rFiY/FwG3AmMj4ilEdESEa3AL9jSDV0IjGp3+cgkrVMOcGaWWjGewUnqJ6l/22fgo8BzkhrbZfsE8FzyeSrwGUk7SNoDGA1Mz3cPd1HNLJXcaiJFaRsNA+6UBLlY9JuIuFvSrySNIddFnQd8BSAinpd0GzAb2AyckW8Eta1Q205rVtcy6VujmPdiHRKc89PX+dtdg3jsvgH07hM07tbMv06az44DW3hzRS0XT9ydl2fW85FPreDMH+VtYVsJDB2+kXOveJ1BQzdDwF0378Qfrh/Ke/Zbzzd+vIA+da20bBZXXTCSl2bWM2rPDZzz0/ns+U/rmXLpLtx+7c7l/hXKrhjvokbEq8ABHaT/7zzXXAJcUug9ShrgJB0DXAHUAtdFxI9Leb9yuebCEYw74k2++4t5bNoomtfXsP7wt/jivy2ithdc98NGbr1yZ770ncX0qQtOPXcJ816qY96LdeWueo/UsllMvmg4c56tp2+/Fq66+2Weeqg/X/rOIm7+6TBmPDCAAye8yenfWcS3T9qTN1fWcs13R3DoMavLXfWKEIjNrdXxqlbJnsFJqgX+EzgW2Bf4bDJRL1PWvlnDs4/145jPrQCgd59gx4EtfPCIt6hN/vnY54PraFrcG4C6+lb2P2gtfXaIclW5x1uxrDdznq0HYP3aWubPqaOhcRMR0K9/rsfTb0ALK5bm/sxWL+/Ny8/Us3lzdayg0R2K9SZDqZWyBTcemJM0Q5F0K7mJerNLeM9ut+T1HRi402YuO3tXXn2+jtHvX8/XLl5IXX3r23nuuWUI/3zCqjLW0jozbORG3rv/el58qp5rLxzBj255lS9fuBgpOPvjo8tdvYrUNopaDUo5ilrQpDxJE9smAb6xPO/zworU0gJznq3n+FOauPq+l6mrb+W3V215RvObK4ZR2yuY8MmVZayldaSuvoXvXjePay8czro1tRx/6nJ+/r3hfGHcvvz8+yM456fzuy6kh2qNmoKOcit7DSJickSMi4hxQ3eqjn59ew2NmxjauIm9x64D4EPHr2LOs30BuPe3Q5j+1wGcd9VrqDr+wesxansF371uHvffMZi//WUQAB85eQWP3DUQgIf+NJC9xqwrZxUrVtueDGV4VSu1Uga41JPyqtGQnTfTMHwj8+fsAMDMh/uz6+hmnnigP7+7eme+f+Or1NX7eVtlCc65bD7zX6njjslD305dvrQ37z9kLQBjPrSGRXN3KFcFK56fwcETwOhkQt5CcqsAfK6E9yubM364kEvP3I3Nm8Quu27kXye9zlnH7cWmZnHBp/cEYO8PruWbly4A4JTx+7J2TQ2bN4q/3zOQH93yD3bbq7mcv0KPst/4tXz45JW8OruOq+97CYBf/nsjl587kq9dtIja2mBjcw2XnzsSgMFDN3HlX16hvn8L0QonfqmJiUe8j3Vrqq/HUQwBVTOKqojStS6SdZwuJzdN5IZkDkunxh1QF9PvGZUvi1WYo4ePKXcVLIXHYxpvxortaloN2XvnOOqG/1VQ3tsPu/bJLt5FLamSzoOLiLuAu0p5DzPrXm0LXlYDv8lgZqlVwgBCIRzgzCyVtgUvq4EDnJmlkntVq+wzzAriAGdmqfkZnJllU7iLamYZ5WdwZpZpDnBmlklt76JWAwc4M0utyBs/l4wDnJmlEh5kMLMsCwc4M8smP4MzswxzC87MMqma5sFVx1CImVWOZNOZQo6uSJon6VlJMyXNSNKGSLpP0ivJz8FJuiT9TNIcSbMkje2qfAc4M0slyHVRCzkKdGREjGm3MOb5wLSIGA1MS75DbgvS0ckxEbimq4Id4MwspZJvOnMCMCX5PAU4sV36TZHzGDBIUmO+ghzgzCy1iMIOoKFtW9DkmLh1UcC9kp5sd25YRCxOPi8BhiWfC9qKtD0PMphZaim6n01d7MnwoYhYKGln4D5JL77zPhGStnnjGAc4M0slAlqKtOBlRCxMfi6TdCcwHlgqqTEiFidd0GVJ9tRbkbqLamappeiidkpSP0n92z4DHwWeA6YCpybZTgX+mHyeCpySjKYeDKxu15XtkFtwZpZakSb6DgPulAS5WPSbiLhb0hPAbZJOB14DPpXkvws4DpgDrANO6+oGDnBmlkqQagpI5+VEvAoc0EH6cuCoDtIDOCPNPRzgzCy10m0XX1wOcGaWTvhdVDPLsGit8gAn6UrytEQj4hslqZGZVbyuRkgrRb4W3Ixuq4WZVY22d1GrQacBLiKmtP8uqT4i1pW+SmZW0QKokgDX5URfSYdImg28mHw/QNLVJa+ZmVWsYkz07Q6FvMlwOXA0sBwgIp4BDi9lpcyswkWBR5kVNIoaEfOT2cZtWkpTHTOrfKr+UdR25ks6FAhJvYFvAi+UtlpmVrGqaB5cIV3Ur5J7PWIEsAgYQ8rXJcwsY7LSRY2IJuDz3VAXM6saGWnBSXqPpD9JekPSMkl/lPSe7qicmVWoKmnBFdJF/Q1wG9AIDAd+B9xSykqZWQULoFWFHWVWSICrj4hfRcTm5LgZqCt1xcysclXLPLh876IOST7+RdL5wK3kYvenyS08Z2Y9VQUEr0LkG2R4ktyv0dbO/Eq7cwFcUKpKmVmFq5JpIvneRd2jOytiZtVj2/e56l4FvckgaX9gX9o9e4uIm0pVKTOrYBUyQlqILgOcpO8BR5ALcHcBxwKPAA5wZj1SZYyQFqKQUdSTyG0AsSQiTiO3ScTAktbKzCpblcyDK6SLuj4iWiVtljSA3Caso7q6yMwyrAKCVyEKCXAzJA0CfkFuZHUN8PeS1srMKlcVLXhZyLuoX08+XivpbmBARMwqbbXMrJIVcxRVUi25LRIWRsTxkm4E/hlYnWT5PxExU7k1264gt/nzuiT9qXxl55voOzbfua4KNrMMK24XtW0JtgHt0s6NiNu3yncsMDo5DgKuSX52Kl8L7rI85wKYkK/gbfHKy4M57siTil2sldDcW+vLXQVLYeMFjxalnGK14CSNBD4GXAKc00X2E4Cbkh3uH5M0SFJjRCzu7IJ8E32P3JYKm1kPUPgzuAZJ7XfomxwRk9t9vxz4NtB/q+sukXQhMA04PyKaya1JOb9dngVJWvoAZ2bWoXRTQJoiYlxHJyQdDyyLiCclHdHu1AXAEqAPMBk4D7hoW6payDw4M7N3Ks48uMOAj0uaR24xjwmSbo6IxZHTDPwSGJ/kX8g7p6iNTNI65QBnZqkpCjvyiYgLImJkROwOfAa4PyK+IKkRIBk1PRF4LrlkKnCKcg4GVud7/gaFvaolckuWvyciLpK0K7BLREzv6lozy6jWkpb+a0lDya1kNJPcvjCQe1X0OGAOuWkip3VVUCHP4K4m9+tMINcPfgv4PXBg6mqbWdUrpHWWVkQ8CDyYfO5whkYyeppqw6tCAtxBETFW0tPJTVZK6pPmJmaWMVl5kwHYlMw0DoCk6VjaBqqZVbYqeRe1kEGGnwF3AjtLuoTcUkk/KmmtzKyiFWOQoTsU8i7qryU9SW7JJAEnRoR3tjfrySogeBWikFHUXcmNWPypfVpEvF7KiplZhQpQlTykKuQZ3H+xZfOZOmAP4CVgvxLWy8wqWVZacBHxT+2/J6uMfL2T7GbWA1TC87VCpH6TIVkmKe8SJWZmlaCQZ3DtlzCpAcYCi0pWIzOrfFXSgivkGVz7ZUw2k3sm9/vSVMfMKl5WBhmSCb79I+Jb3VQfM6sG1d6Ck9QrIjZLOqw7K2RmlU1UzyBDvhbcdHLP22ZKmgr8DljbdjIi7ihx3cysUmUgwLWpA5aTW02kbT5cAA5wZj1RhbyGVYh8AW7nZAT1ObYEtjZV8uuZWUlUSQTIF+BqgR15Z2BrUyW/npmVQhZGURdHxDZt9GBmGVclTZx8Aa46VrQzs+6VbletssoX4I7qtlqYWVWp+kGGiFjRnRUxsypS7QHOzKwzVd+CMzPrUFA1u7I4wJlZKqJ6RiC9s72ZpRcFHgWQVCvpaUl/Tr7vIelxSXMk/bZtm1JJOyTf5yTnd++qbAc4M0utyLtqfRNov5HVpcCkiNgTWAmcnqSfDqxM0icl+fJygDOz9IrUgpM0EvgYcF3yXeTee789yTIFODH5fELyneT8UUn+TvkZnJmlk27BywZJM9p9nxwRk9t9vxz4NlsW1t0JWBURm5PvC4ARyecRwHyAZCm31Un+ps5u7gBnZukV3v1siohxHZ2QdDywLCKelHREkWr2Dg5wZpZakebBHQZ8XNJx5JZlGwBcAQxqW3AXGAksTPIvBEYBCyT1AgaSW8qtU34GZ2bpFeEZXERcEBEjI2J34DPA/RHxeeAB4KQk26nAH5PPU5PvJOfvj4i8d3GAM7PUijyKurXzgHMkzSH3jO36JP16YKck/Rzg/K4KchfVzNIpwWoiEfEg8GDy+VVgfAd5NgAnpynXAc7MUhHZWPDSzKxjftnezLJK+Z/tVwwHODNLJyMr+pqZdcjrwZlZdjnAmVlWeRTVzLIpIzvbm5l1zAHOzLJIuAVnZlnmeXA9Q+/eLfy/K/6b3n1aqa1t5ZH/Hsmvb9yXc//vdEbvtZLNLTW8/OJgrrxsLC0tNUDwlbOe4cCDltC8oZafXjqOf7wyuNy/Rs/UGgz/t1doGdybpeftQd2zbzHk14shIOpqeONro9i8yw4MmbKIutlrAKhpbqXmzc28fsP+Za58GaVb8LKsShbgJN0AtC1ol9n/GzZtquGCcw5nw4Ze1Na28pMrH2TG48N44K+j+I9LDgTg29+ZztEfm8tdU9/LuIOWMGLEGr70haN53z4rOPPspzn76xPK/Fv0TAP+0sSm4XXUrG8BoOH6hSw9d3c2jaij/71NDLpjGU1fH8WKU4dvuebuJvrMW1+uKleMaglwpVwu6UbgmBKWXyHEhg25fyd69WqltjYAMePxRto2WHv5xSE0DM39pTj4sMVMu3c3QLz0wk7067eJwUP8F6a71S7fSP1Tb/HWhCFvp4WgZl3ub27NulZaBr/73/9+f1vFmkMHdVs9K1YRd9UqpZK14CLioUK29cqCmprgip9PY/iINfz5D+/lpRe2/KWprW1lwkde5+dXHQBAQ8N63ljW9+3zTU19aWjYwMoVfd9VrpXOTlMWs+Lzu1CzfktTpGniKIZdOpfoU0Nr3xoWXbznO67p9cZGer2xkQ3779jd1a041TLI4AUvi6C1VZz15Q9zysnHsdfeK9lt99VvnzvjX57muVkNPP9sQxlraO31ffJNWgb2YuN76t+RPvCuN1h63h7Mv3of1hwxmJ1+tegd5/s9uoq1Bw2EmmrZ9rhEgtwgQyFHmZV9kEHSRGAiQF2vAWWuzfZZu7YPs2YO5YPjl/LavIF87pTZDBzUzJUXjn07T1NTX4buvKVL2tCwnqamunJUt8eqe3kt9U++Sd+n30Sbgpr1LQy7dC69FzbTPDoX9NYcMohd/n3uO67r9/dVLD9tREdF9jhuwRUoIiZHxLiIGNenV33XF1SYAQOb6ddvIwB9+rTwgQ8uZcHr/Tn6uLmMPXApl158EBFb/sV//NFGjvroa0Dwvn2Ws3Ztb3dPu9nKzzYy/+p9WHDVPrzxjV3ZsN+OLP3W7tSsb6HXomYA+s5aw6YRO7x9Te+FG6hZ00LzXtX3/2ixtS14WchRbmVvwVW7ITtt4F/Pf4KamkA18PCDI5n+WCN/+usdLFtSz2X/+QAAjz48gltu2ocnHtuFAw9awvU330Nzcy2TLu1wRzXrbrWi6csjGTbpNULQ2q+Wpq+OfPt0v0dXsfbQQZB/n+GeoUK6n4Uo5TSRW4AjyG38ugD4XkRcn/+q6jPv1YGcNfHD70r/nx/+ZCdXiKuv+EBpK2UF27DfjmzYLzdosG78QNaNH9hhvlUn79Kd1ap41dJFLeUo6mdLVbaZlVlPD3Bmll09vgVnZhkVQGt1RLiyj6KaWfUpxiiqpDpJ0yU9I+l5ST9I0m+UNFfSzOQYk6RL0s8kzZE0S9LY/HdwC87MtkVxRlGbgQkRsUZSb+ARSX9Jzp0bEbdvlf9YYHRyHARck/zslFtwZpaaorAjn8hZk3ztnRz5rjoBuCm57jFgkKTGfPdwgDOzdAp90T4XqhokzWh3TGxflKRaSTOBZcB9EfF4cuqSpBs6SVLbjOsRwPx2ly9I0jrlLqqZpZJb0bfgLmpTRHQ6mz0iWoAxkgYBd0raH7gAWAL0ASYD5wEXbUtd3YIzs9TUEgUdhYqIVcADwDERsTjphjYDvwTGJ9kWAqPaXTYySeuUA5yZpZOui9opSUOTlhuS+gIfAV5se64mScCJwHPJJVOBU5LR1IOB1RGxON893EU1s5SK9i5qIzBFUi25xtZtEfFnSfdLGkquNzwT+GqS/y7gOGAOsA44rasbOMCZWWrFeJMhImYB73oxOyI6XMM/IgI4I809HODMLL2evpqImWWUd9Uys0yrkndRHeDMLLUU8+DKygHOzNJzgDOzTArAz+DMLItEuItqZhnWWh1NOAc4M0vHXVQzyzJ3Uc0suxzgzCybvPGzmWVV4ABnZtmVZjHLcnKAM7P03IIzs0yqoo2fHeDMLCUPMphZljnAmVlmOcCZWSZFQEtLuWtREAc4M0vPLTgzy6QqGkX1xs9mll5EYUcekuokTZf0jKTnJf0gSd9D0uOS5kj6raQ+SfoOyfc5yfndu6qmA5yZpVeEAAc0AxMi4gBgDHBMsmP9pcCkiNgTWAmcnuQ/HViZpE9K8uXlAGdm6bQNMhRy5C0mIiLWJF97J0cAE4Dbk/QpwInJ5xOS7yTnj5KkfPdwgDOz9IrTgkNSraSZwDLgPuAfwKqI2JxkWQCMSD6PAObnbh+bgdXATvnK9yCDmaVX+Chqg6QZ7b5PjojJW4qJFmCMpEHAncDexaukA5yZpRZpRlGbImJclyVGrJL0AHAIMEhSr6SVNhJYmGRbCIwCFkjqBQwElucr111UM0snIKK1oCMfSUOTlhuS+gIfAV4AHgBOSrKdCvwx+Tw1+U5y/v6I/E1Jt+DMLL3izINrBKZIqiXX2LotIv4saTZwq6QfAk8D1yf5rwd+JWkOsAL4TFc3cIAzs3SK9KpWRMwCPtBB+qvA+A7SNwAnp7mHA5yZpedXtcwsq8IbP5tZNnnBSzPLqip62d4BzszS62IKSKVwgDOzVCKC8IKXZpZVUSVdVHUxEbhbSXoDeK3c9SiBBqCp3JWwVLL6Z7ZbRAzdngIk3U3uv08hmiLimO253/aoqACXVZJmFPI+nlUO/5llg99FNbPMcoAzs8xygOsek7vOYhXGf2YZ4GdwZpZZbsGZWWY5wJlZZjnAmVlm+U2GEpC0N7ktztp2A1oITI2IF8pXK7Oexy24IpN0HnArIGB6cgi4RdL55aybpSfptHLXwbadR1GLTNLLwH4RsWmr9D7A8xExujw1s20h6fWI2LXc9bBt4y5q8bUCw3n3O7WNyTmrMJJmdXYKGNaddbHicoArvn8Bpkl6hWQXbmBXYE/gzLLVyvIZBhwNrNwqXcCj3V8dKxYHuCKLiLsl7UVuV6D2gwxPJLt4W+X5M7BjRMzc+oSkB7u/OlYsfgZnZpnlUVQzyywHODPLLAe4KiKpRdJMSc9J+p2k+u0o60ZJJyWfr5O0b568R0g6dBvuMU/Su1Z+7Sx9qzxrUt7r+5K+lbaOlm0OcNVlfUSMiYj9gY3AV9uflLRNg0YR8aWImJ0nyxFA6gBnVm4OcNXrYWDPpHX1sKSpwGxJtZL+Q9ITkmZJ+gqAcq6S9JKkvwI7txUk6UFJ45LPx0h6StIzkqZJ2p1cID07aT3+D0lDJf0+uccTkg5Lrt1J0r2Snpd0HblpFnlJ+oOkJ5NrJm51blKSPk3S0CTtvZLuTq55OHktzqxDniZShZKW2rHA3UnSWGD/iJibBInVEXGgpB2Av0m6F/gA8D5gX3LzvmYDN2xV7lDgF8DhSVlDImKFpGuBNRHxkyTfb4BJEfGIpF2Be4B9gO8Bj0TERZI+BpxewK/zxeQefYEnJP0+IpYD/YAZEXG2pAuTss8ktxDlVyPiFUkHAVcDE7bhP6P1AA5w1aWvpLa5Wg8D15PrOk6PiLlJ+keB97c9XwMGAqOBw4Fbkrl4iyTd30H5BwMPtZUVESs6qceHgX2ltxtoAyTtmNzjk8m1/yVp64mzHfmGpE8kn0cldV1O7q2P3ybpNwN3JPc4FPhdu3vvUMA9rIdygKsu6yNiTPuE5C/62vZJwFkRcc9W+Y4rYj1qgIMjYkMHdSmYpCPIBctDImJdMqm2rpPskdx31db/Dcw642dw2XMP8DVJvQEk7SWpH/AQ8OnkGV0jcGQH1z4GHC5pj+TaIUn6W0D/dvnuBc5q+yKpLeA8BHwuSTsWGNxFXQcCK5Pgtje5FmSbGqCtFfo5cl3fN4G5kk5O7iFJB3RxD+vBHOCy5zpyz9eekvQc8HNyLfU7gVeSczcBf9/6woh4A5hIrjv4DFu6iH8CPtE2yAB8AxiXDGLMZsto7g/IBcjnyXVVX++irncDvSS9APyYXIBtsxYYn/wOE4CLkvTPA6cn9Xue3Lp7Zh3yq1pmllluwZlZZjnAmVlmOcCZWWY5wJlZZjnAmVlmOcCZWWY5wJlZZjnAmVlm/X+gCxrXE3AV2wAAAABJRU5ErkJggg==\n",
            "text/plain": [
              "<Figure size 432x288 with 2 Axes>"
            ]
          },
          "metadata": {
            "tags": [],
            "needs_background": "light"
          }
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "FFszS2A5JJmv",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "f56e528c-da73-4a79-c997-bfc9760c5fac"
      },
      "source": [
        "# The following functions would calculate the appropriate calls according to the\n",
        "# dataset\n",
        "\n",
        "acc = (618 + 492)/ 1709\n",
        "acc"
      ],
      "execution_count": 94,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.6495026331187829"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 94
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "XjHTmk8sJO4v",
        "colab_type": "text"
      },
      "source": [
        "### Calculate precision"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "7qX1gbcMJQS_",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "b82a45c1-26a0-4adc-b6aa-4da74f864a79"
      },
      "source": [
        "precision = 492/(492+284)\n",
        "precision"
      ],
      "execution_count": 95,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.634020618556701"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 95
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "pFug3ZKaJQ7A",
        "colab_type": "text"
      },
      "source": [
        "### Calculate recall"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "L0OKc3JxJR4r",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 170
        },
        "outputId": "7400bcc6-5049-4e66-f116-c1150bce6fca"
      },
      "source": [
        "from sklearn.metrics import classification_report\n",
        "print(classification_report(y_val, y_pred))"
      ],
      "execution_count": 97,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "              precision    recall  f1-score   support\n",
            "\n",
            "           0       0.53      0.63      0.58       902\n",
            "           1       0.48      0.37      0.42       807\n",
            "\n",
            "    accuracy                           0.51      1709\n",
            "   macro avg       0.50      0.50      0.50      1709\n",
            "weighted avg       0.50      0.51      0.50      1709\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    }
  ]
}