best_classifier_comp_inf8245e.ipynb

{"cells":[{"cell_type":"markdown","metadata":{"id":"c5TZWlc5OEK3"},"source":["# Concert enjoyment | Best classifier\n","This notebook includes only the best classifier (XGBoost) that was developed by the team 'The Overfitters' in the Kaggle competition.\n","\n","INF8245E, December 2022"]},{"cell_type":"markdown","source":["## Instructions on how to run code\n","\n"],"metadata":{"id":"Fzb4-xD-nzvl"}},{"cell_type":"markdown","source":["\n","\n","1.   Under section 0. *Loading data and packages*, in cell [2], change the path of the test set by changing the path parameter in the following function call\n","`test_data = pd.read_csv(\"./public/data/test.csv\")` from `\"./public/data/test.csv\"` to the path of the .csv file that contains the test set\n","2.   Run the entire notebook by going to *Run* -> *Run all*\n","3.   A file called output.csv, containing the output predictions on the test set, will be downloaded automatically"],"metadata":{"id":"1-z7pK3YoFFi"}},{"cell_type":"markdown","metadata":{"id":"7k2vnSGfdsrU"},"source":["## 0. Loading data and packages"]},{"cell_type":"code","execution_count":1,"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"voTzx24EOQDJ","outputId":"f69df545-47c2-4157-861b-44c427029456","executionInfo":{"status":"ok","timestamp":1669912974179,"user_tz":300,"elapsed":6390,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[{"output_type":"stream","name":"stdout","text":["Cloning into 'public'...\n","remote: Enumerating objects: 37, done.\u001b[K\n","remote: Counting objects: 100% (37/37), done.\u001b[K\n","remote: Compressing objects: 100% (32/32), done.\u001b[K\n","remote: Total 37 (delta 7), reused 23 (delta 2), pack-reused 0\u001b[K\n","Unpacking objects: 100% (37/37), done.\n"]}],"source":["!rm -rf public\n","!git clone https://github.com/zhanwen-xin/concert-enjoyment-classification-data.git public"]},{"cell_type":"code","execution_count":2,"metadata":{"id":"qfUiEb5zXIaF","executionInfo":{"status":"ok","timestamp":1669912982474,"user_tz":300,"elapsed":8303,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Import Packages  \n","import pandas as pd\n","import numpy as np\n","import sklearn\n","\n","# Load data\n","train_data = pd.read_csv(\"./public/data/train.csv\")\n","test_data = pd.read_csv(\"./public/data/test.csv\") #Change this path to the correct .csv file that contains the test set"]},{"cell_type":"markdown","metadata":{"id":"bxkEXsjU5UC9"},"source":["### 0.1 Visualize dataset"]},{"cell_type":"markdown","metadata":{"id":"MaclL5IEFmMG"},"source":["#### Original training set"]},{"cell_type":"code","execution_count":3,"metadata":{"colab":{"base_uri":"https://localhost:8080/","height":0},"id":"nLy63bQObdQR","outputId":"8f9197f6-1234-440b-c884-ddce318a6f70","executionInfo":{"status":"ok","timestamp":1669912982475,"user_tz":300,"elapsed":19,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[{"output_type":"execute_result","data":{"text/plain":["                              Id                      Band Name  \\\n","0       ConcertExperience_180106    Teenage Crazy Blue Knickers   \n","1       ConcertExperience_146268                   Beyond Devon   \n","2       ConcertExperience_128743                     Ron Talent   \n","3       ConcertExperience_140839                  Devon Revival   \n","4        ConcertExperience_19149                   Beyond Devon   \n","...                          ...                            ...   \n","169995   ConcertExperience_14055            Crazy Joystick Cult   \n","169996  ConcertExperience_192792            Crazy Joystick Cult   \n","169997  ConcertExperience_152942                Why Frogs, Why?   \n","169998  ConcertExperience_138957  Twilight of the Joystick Gods   \n","169999  ConcertExperience_132336                Joystick Attack   \n","\n","            Band Genre          Band Country of Origin  Band Debut  \\\n","0       Indie/Alt Rock  United States of America (USA)      1976.0   \n","1            Pop Music  United States of America (USA)      1968.0   \n","2          Rock n Roll                          Canada      1955.0   \n","3                  RnB  United States of America (USA)      1992.0   \n","4            Pop Music  United States of America (USA)      1968.0   \n","...                ...                             ...         ...   \n","169995             RnB                          Canada      1985.0   \n","169996             RnB                          Canada      1985.0   \n","169997     Heavy Metal                          Canada      2005.0   \n","169998     Hip Hop/Rap  United States of America (USA)      1995.0   \n","169999     Heavy Metal             United Kingdom (UK)      2008.0   \n","\n","        Concert ID  Concert Attendance Inside Venue   Rain Seated  \\\n","0            900.0              2980.0        False  False    NaN   \n","1            731.0                54.0         True  False   True   \n","2              NaN            162754.0        False  False   True   \n","3            704.0              8103.0        False   True  False   \n","4             95.0                54.0        False  False  False   \n","...            ...                 ...          ...    ...    ...   \n","169995        70.0            162754.0         True  False  False   \n","169996       963.0                54.0        False  False  False   \n","169997       764.0                54.0        False  False  False   \n","169998       694.0             22026.0        False   True   True   \n","169999       661.0              2980.0         True  False  False   \n","\n","        Personnality Trait 1  Personnality Trait 2  Personnality Trait 3  \\\n","0                   0.330843             -0.958408             -0.943548   \n","1                  -2.069449              0.017777             -1.910675   \n","2                  -0.484268              1.968772             -0.064167   \n","3                  -0.858054              1.022827             -0.348389   \n","4                  -0.793029             -1.166528             -0.043766   \n","...                      ...                   ...                   ...   \n","169995             -0.095021              0.175175              0.914245   \n","169996             -0.733719             -0.285776             -0.323312   \n","169997              0.744969             -0.965547              1.020598   \n","169998              0.821976              0.351411              0.175762   \n","169999             -1.017410              0.883248             -0.184107   \n","\n","        Personnality Trait 4  Concert Goer Age    Concert Goer ID  \\\n","0                  -1.636806              29.0  concert_goer_1985   \n","1                   0.610265              43.0  concert_goer_1874   \n","2                  -1.260871              68.0   concert_goer_442   \n","3                  -1.147251              17.0  concert_goer_1149   \n","4                   0.969661              59.0   concert_goer_930   \n","...                      ...               ...                ...   \n","169995              0.357359              50.0   concert_goer_707   \n","169996              0.641180              71.0  concert_goer_1373   \n","169997              1.027389              27.0  concert_goer_1286   \n","169998              1.455654              39.0  concert_goer_1845   \n","169999              0.631731              46.0  concert_goer_1281   \n","\n","        Height (cm)  Concert Goer Country of Origin   Concert Enjoyment  \n","0             140.0                        Paraguay       Did Not Enjoy  \n","1             158.0             United Kingdom (UK)             Enjoyed  \n","2             159.0  United States of America (USA)       Did Not Enjoy  \n","3             150.0                          Canada  Worst Concert Ever  \n","4             166.0             United Kingdom (UK)       Did Not Enjoy  \n","...             ...                             ...                 ...  \n","169995        180.0  United States of America (USA)       Did Not Enjoy  \n","169996        143.0                        Bulgaria  Worst Concert Ever  \n","169997        176.0                          Canada       Did Not Enjoy  \n","169998        176.0                          Canada       Did Not Enjoy  \n","169999        146.0                          Canada   Best Concert Ever  \n","\n","[170000 rows x 19 columns]"],"text/html":["\n","  <div id=\"df-420cc082-abed-4cde-9e11-2f415b0514a0\">\n","    <div class=\"colab-df-container\">\n","      <div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>Id</th>\n","      <th>Band Name</th>\n","      <th>Band Genre</th>\n","      <th>Band Country of Origin</th>\n","      <th>Band Debut</th>\n","      <th>Concert ID</th>\n","      <th>Concert Attendance</th>\n","      <th>Inside Venue</th>\n","      <th>Rain</th>\n","      <th>Seated</th>\n","      <th>Personnality Trait 1</th>\n","      <th>Personnality Trait 2</th>\n","      <th>Personnality Trait 3</th>\n","      <th>Personnality Trait 4</th>\n","      <th>Concert Goer Age</th>\n","      <th>Concert Goer ID</th>\n","      <th>Height (cm)</th>\n","      <th>Concert Goer Country of Origin</th>\n","      <th>Concert Enjoyment</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>ConcertExperience_180106</td>\n","      <td>Teenage Crazy Blue Knickers</td>\n","      <td>Indie/Alt Rock</td>\n","      <td>United States of America (USA)</td>\n","      <td>1976.0</td>\n","      <td>900.0</td>\n","      <td>2980.0</td>\n","      <td>False</td>\n","      <td>False</td>\n","      <td>NaN</td>\n","      <td>0.330843</td>\n","      <td>-0.958408</td>\n","      <td>-0.943548</td>\n","      <td>-1.636806</td>\n","      <td>29.0</td>\n","      <td>concert_goer_1985</td>\n","      <td>140.0</td>\n","      <td>Paraguay</td>\n","      <td>Did Not Enjoy</td>\n","    </tr>\n","    <tr>\n","      <th>1</th>\n","      <td>ConcertExperience_146268</td>\n","      <td>Beyond Devon</td>\n","      <td>Pop Music</td>\n","      <td>United States of America (USA)</td>\n","      <td>1968.0</td>\n","      <td>731.0</td>\n","      <td>54.0</td>\n","      <td>True</td>\n","      <td>False</td>\n","      <td>True</td>\n","      <td>-2.069449</td>\n","      <td>0.017777</td>\n","      <td>-1.910675</td>\n","      <td>0.610265</td>\n","      <td>43.0</td>\n","      <td>concert_goer_1874</td>\n","      <td>158.0</td>\n","      <td>United Kingdom (UK)</td>\n","      <td>Enjoyed</td>\n","    </tr>\n","    <tr>\n","      <th>2</th>\n","      <td>ConcertExperience_128743</td>\n","      <td>Ron Talent</td>\n","      <td>Rock n Roll</td>\n","      <td>Canada</td>\n","      <td>1955.0</td>\n","      <td>NaN</td>\n","      <td>162754.0</td>\n","      <td>False</td>\n","      <td>False</td>\n","      <td>True</td>\n","      <td>-0.484268</td>\n","      <td>1.968772</td>\n","      <td>-0.064167</td>\n","      <td>-1.260871</td>\n","      <td>68.0</td>\n","      <td>concert_goer_442</td>\n","      <td>159.0</td>\n","      <td>United States of America (USA)</td>\n","      <td>Did Not Enjoy</td>\n","    </tr>\n","    <tr>\n","      <th>3</th>\n","      <td>ConcertExperience_140839</td>\n","      <td>Devon Revival</td>\n","      <td>RnB</td>\n","      <td>United States of America (USA)</td>\n","      <td>1992.0</td>\n","      <td>704.0</td>\n","      <td>8103.0</td>\n","      <td>False</td>\n","      <td>True</td>\n","      <td>False</td>\n","      <td>-0.858054</td>\n","      <td>1.022827</td>\n","      <td>-0.348389</td>\n","      <td>-1.147251</td>\n","      <td>17.0</td>\n","      <td>concert_goer_1149</td>\n","      <td>150.0</td>\n","      <td>Canada</td>\n","      <td>Worst Concert Ever</td>\n","    </tr>\n","    <tr>\n","      <th>4</th>\n","      <td>ConcertExperience_19149</td>\n","      <td>Beyond Devon</td>\n","      <td>Pop Music</td>\n","      <td>United States of America (USA)</td>\n","      <td>1968.0</td>\n","      <td>95.0</td>\n","      <td>54.0</td>\n","      <td>False</td>\n","      <td>False</td>\n","      <td>False</td>\n","      <td>-0.793029</td>\n","      <td>-1.166528</td>\n","      <td>-0.043766</td>\n","      <td>0.969661</td>\n","      <td>59.0</td>\n","      <td>concert_goer_930</td>\n","      <td>166.0</td>\n","      <td>United Kingdom (UK)</td>\n","      <td>Did Not Enjoy</td>\n","    </tr>\n","    <tr>\n","      <th>...</th>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","    </tr>\n","    <tr>\n","      <th>169995</th>\n","      <td>ConcertExperience_14055</td>\n","      <td>Crazy Joystick Cult</td>\n","      <td>RnB</td>\n","      <td>Canada</td>\n","      <td>1985.0</td>\n","      <td>70.0</td>\n","      <td>162754.0</td>\n","      <td>True</td>\n","      <td>False</td>\n","      <td>False</td>\n","      <td>-0.095021</td>\n","      <td>0.175175</td>\n","      <td>0.914245</td>\n","      <td>0.357359</td>\n","      <td>50.0</td>\n","      <td>concert_goer_707</td>\n","      <td>180.0</td>\n","      <td>United States of America (USA)</td>\n","      <td>Did Not Enjoy</td>\n","    </tr>\n","    <tr>\n","      <th>169996</th>\n","      <td>ConcertExperience_192792</td>\n","      <td>Crazy Joystick Cult</td>\n","      <td>RnB</td>\n","      <td>Canada</td>\n","      <td>1985.0</td>\n","      <td>963.0</td>\n","      <td>54.0</td>\n","      <td>False</td>\n","      <td>False</td>\n","      <td>False</td>\n","      <td>-0.733719</td>\n","      <td>-0.285776</td>\n","      <td>-0.323312</td>\n","      <td>0.641180</td>\n","      <td>71.0</td>\n","      <td>concert_goer_1373</td>\n","      <td>143.0</td>\n","      <td>Bulgaria</td>\n","      <td>Worst Concert Ever</td>\n","    </tr>\n","    <tr>\n","      <th>169997</th>\n","      <td>ConcertExperience_152942</td>\n","      <td>Why Frogs, Why?</td>\n","      <td>Heavy Metal</td>\n","      <td>Canada</td>\n","      <td>2005.0</td>\n","      <td>764.0</td>\n","      <td>54.0</td>\n","      <td>False</td>\n","      <td>False</td>\n","      <td>False</td>\n","      <td>0.744969</td>\n","      <td>-0.965547</td>\n","      <td>1.020598</td>\n","      <td>1.027389</td>\n","      <td>27.0</td>\n","      <td>concert_goer_1286</td>\n","      <td>176.0</td>\n","      <td>Canada</td>\n","      <td>Did Not Enjoy</td>\n","    </tr>\n","    <tr>\n","      <th>169998</th>\n","      <td>ConcertExperience_138957</td>\n","      <td>Twilight of the Joystick Gods</td>\n","      <td>Hip Hop/Rap</td>\n","      <td>United States of America (USA)</td>\n","      <td>1995.0</td>\n","      <td>694.0</td>\n","      <td>22026.0</td>\n","      <td>False</td>\n","      <td>True</td>\n","      <td>True</td>\n","      <td>0.821976</td>\n","      <td>0.351411</td>\n","      <td>0.175762</td>\n","      <td>1.455654</td>\n","      <td>39.0</td>\n","      <td>concert_goer_1845</td>\n","      <td>176.0</td>\n","      <td>Canada</td>\n","      <td>Did Not Enjoy</td>\n","    </tr>\n","    <tr>\n","      <th>169999</th>\n","      <td>ConcertExperience_132336</td>\n","      <td>Joystick Attack</td>\n","      <td>Heavy Metal</td>\n","      <td>United Kingdom (UK)</td>\n","      <td>2008.0</td>\n","      <td>661.0</td>\n","      <td>2980.0</td>\n","      <td>True</td>\n","      <td>False</td>\n","      <td>False</td>\n","      <td>-1.017410</td>\n","      <td>0.883248</td>\n","      <td>-0.184107</td>\n","      <td>0.631731</td>\n","      <td>46.0</td>\n","      <td>concert_goer_1281</td>\n","      <td>146.0</td>\n","      <td>Canada</td>\n","      <td>Best Concert Ever</td>\n","    </tr>\n","  </tbody>\n","</table>\n","<p>170000 rows × 19 columns</p>\n","</div>\n","      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-420cc082-abed-4cde-9e11-2f415b0514a0')\"\n","              title=\"Convert this dataframe to an interactive table.\"\n","              style=\"display:none;\">\n","        \n","  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n","       width=\"24px\">\n","    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n","    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n","  </svg>\n","      </button>\n","      \n","  <style>\n","    .colab-df-container {\n","      display:flex;\n","      flex-wrap:wrap;\n","      gap: 12px;\n","    }\n","\n","    .colab-df-convert {\n","      background-color: #E8F0FE;\n","      border: none;\n","      border-radius: 50%;\n","      cursor: pointer;\n","      display: none;\n","      fill: #1967D2;\n","      height: 32px;\n","      padding: 0 0 0 0;\n","      width: 32px;\n","    }\n","\n","    .colab-df-convert:hover {\n","      background-color: #E2EBFA;\n","      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n","      fill: #174EA6;\n","    }\n","\n","    [theme=dark] .colab-df-convert {\n","      background-color: #3B4455;\n","      fill: #D2E3FC;\n","    }\n","\n","    [theme=dark] .colab-df-convert:hover {\n","      background-color: #434B5C;\n","      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n","      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n","      fill: #FFFFFF;\n","    }\n","  </style>\n","\n","      <script>\n","        const buttonEl =\n","          document.querySelector('#df-420cc082-abed-4cde-9e11-2f415b0514a0 button.colab-df-convert');\n","        buttonEl.style.display =\n","          google.colab.kernel.accessAllowed ? 'block' : 'none';\n","\n","        async function convertToInteractive(key) {\n","          const element = document.querySelector('#df-420cc082-abed-4cde-9e11-2f415b0514a0');\n","          const dataTable =\n","            await google.colab.kernel.invokeFunction('convertToInteractive',\n","                                                     [key], {});\n","          if (!dataTable) return;\n","\n","          const docLinkHtml = 'Like what you see? Visit the ' +\n","            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n","            + ' to learn more about interactive tables.';\n","          element.innerHTML = '';\n","          dataTable['output_type'] = 'display_data';\n","          await google.colab.output.renderOutput(dataTable, element);\n","          const docLink = document.createElement('div');\n","          docLink.innerHTML = docLinkHtml;\n","          element.appendChild(docLink);\n","        }\n","      </script>\n","    </div>\n","  </div>\n","  "]},"metadata":{},"execution_count":3}],"source":["train_data"]},{"cell_type":"markdown","metadata":{"id":"FkRFjD8RFudM"},"source":["#### Original test set: only 30% of the test set accessible"]},{"cell_type":"code","execution_count":4,"metadata":{"colab":{"base_uri":"https://localhost:8080/","height":0},"id":"9Pov3rxSAqHP","outputId":"7aef864c-5083-4316-e432-aebbea1ba93b","executionInfo":{"status":"ok","timestamp":1669912982476,"user_tz":300,"elapsed":17,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[{"output_type":"execute_result","data":{"text/plain":["                             Id                            Band Name  \\\n","0       ConcertExperience_70055            The Crazy Heroes of Devon   \n","1       ConcertExperience_34799             Joystick for the Jockies   \n","2      ConcertExperience_100410                   Puddle of Joystick   \n","3      ConcertExperience_106446               Flight of the Knickers   \n","4      ConcertExperience_127249                        Devon Revival   \n","...                         ...                                  ...   \n","29995   ConcertExperience_82288         Joystick of the Big Knickers   \n","29996   ConcertExperience_27139                         Big Division   \n","29997  ConcertExperience_197434                            Crazyplay   \n","29998  ConcertExperience_166029              Lord of the Crazy Frogs   \n","29999   ConcertExperience_24025  Crazy Dream and a Pinch of Joystick   \n","\n","        Band Genre          Band Country of Origin  Band Debut  Concert ID  \\\n","0      Rock n Roll  United States of America (USA)      1980.0       350.0   \n","1      Hip Hop/Rap  United States of America (USA)      2014.0       173.0   \n","2      Rock n Roll                          Canada      2010.0       502.0   \n","3              NaN                          Canada      2014.0       532.0   \n","4              RnB  United States of America (USA)      1992.0       636.0   \n","...            ...                             ...         ...         ...   \n","29995  Hip Hop/Rap  United States of America (USA)      1979.0       411.0   \n","29996  Hip Hop/Rap  United States of America (USA)      1978.0       135.0   \n","29997    Pop Music  United States of America (USA)      1995.0       987.0   \n","29998          RnB  United States of America (USA)      1968.0       830.0   \n","29999  Heavy Metal  United States of America (USA)      1995.0       120.0   \n","\n","       Concert Attendance Inside Venue   Rain Seated  Personnality Trait 1  \\\n","0                  2980.0         True  False   True              1.065107   \n","1                  8103.0         True   True  False             -0.886947   \n","2                  2980.0         True   True  False              0.744700   \n","3                 22026.0         True  False  False             -0.134180   \n","4                  2980.0        False  False  False              1.407366   \n","...                   ...          ...    ...    ...                   ...   \n","29995              2980.0         True  False  False             -0.421714   \n","29996              8103.0         True  False  False              0.615087   \n","29997              8103.0        False  False   True             -1.396551   \n","29998              8103.0        False   True  False              0.168073   \n","29999                54.0        False   True  False             -0.248370   \n","\n","       Personnality Trait 2  Personnality Trait 3  Personnality Trait 4  \\\n","0                  0.057660              0.249639             -0.933976   \n","1                  0.801365              0.525624              0.176655   \n","2                 -0.797531             -0.034166             -0.226052   \n","3                 -0.361512              0.969404             -2.341205   \n","4                 -0.084155             -0.673233              1.733714   \n","...                     ...                   ...                   ...   \n","29995             -1.549670             -0.351770              0.132489   \n","29996             -0.047092              0.339228              0.820159   \n","29997             -0.508627             -1.692584              1.640931   \n","29998             -0.785460              0.898273              1.608389   \n","29999             -0.809340              0.085226             -0.133507   \n","\n","       Concert Goer Age    Concert Goer ID  Height (cm)  \\\n","0                  74.0  concert_goer_1587        165.0   \n","1                  29.0   concert_goer_293        151.0   \n","2                  27.0  concert_goer_1068        146.0   \n","3                  38.0  concert_goer_1315        183.0   \n","4                  21.0  concert_goer_1777        177.0   \n","...                 ...                ...          ...   \n","29995              42.0  concert_goer_1710        178.0   \n","29996              37.0  concert_goer_1758        186.0   \n","29997              45.0  concert_goer_1481        158.0   \n","29998              36.0  concert_goer_1461        170.0   \n","29999              47.0  concert_goer_1617        189.0   \n","\n","       Concert Goer Country of Origin  \n","0      United States of America (USA)  \n","1                               Kenya  \n","2                              Canada  \n","3      United States of America (USA)  \n","4                                Fiji  \n","...                               ...  \n","29995  United States of America (USA)  \n","29996                          Canada  \n","29997                          Greece  \n","29998             United Kingdom (UK)  \n","29999                          Canada  \n","\n","[30000 rows x 18 columns]"],"text/html":["\n","  <div id=\"df-89d7d3e4-7884-4b0d-9f8c-6ad95a31ee30\">\n","    <div class=\"colab-df-container\">\n","      <div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>Id</th>\n","      <th>Band Name</th>\n","      <th>Band Genre</th>\n","      <th>Band Country of Origin</th>\n","      <th>Band Debut</th>\n","      <th>Concert ID</th>\n","      <th>Concert Attendance</th>\n","      <th>Inside Venue</th>\n","      <th>Rain</th>\n","      <th>Seated</th>\n","      <th>Personnality Trait 1</th>\n","      <th>Personnality Trait 2</th>\n","      <th>Personnality Trait 3</th>\n","      <th>Personnality Trait 4</th>\n","      <th>Concert Goer Age</th>\n","      <th>Concert Goer ID</th>\n","      <th>Height (cm)</th>\n","      <th>Concert Goer Country of Origin</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>ConcertExperience_70055</td>\n","      <td>The Crazy Heroes of Devon</td>\n","      <td>Rock n Roll</td>\n","      <td>United States of America (USA)</td>\n","      <td>1980.0</td>\n","      <td>350.0</td>\n","      <td>2980.0</td>\n","      <td>True</td>\n","      <td>False</td>\n","      <td>True</td>\n","      <td>1.065107</td>\n","      <td>0.057660</td>\n","      <td>0.249639</td>\n","      <td>-0.933976</td>\n","      <td>74.0</td>\n","      <td>concert_goer_1587</td>\n","      <td>165.0</td>\n","      <td>United States of America (USA)</td>\n","    </tr>\n","    <tr>\n","      <th>1</th>\n","      <td>ConcertExperience_34799</td>\n","      <td>Joystick for the Jockies</td>\n","      <td>Hip Hop/Rap</td>\n","      <td>United States of America (USA)</td>\n","      <td>2014.0</td>\n","      <td>173.0</td>\n","      <td>8103.0</td>\n","      <td>True</td>\n","      <td>True</td>\n","      <td>False</td>\n","      <td>-0.886947</td>\n","      <td>0.801365</td>\n","      <td>0.525624</td>\n","      <td>0.176655</td>\n","      <td>29.0</td>\n","      <td>concert_goer_293</td>\n","      <td>151.0</td>\n","      <td>Kenya</td>\n","    </tr>\n","    <tr>\n","      <th>2</th>\n","      <td>ConcertExperience_100410</td>\n","      <td>Puddle of Joystick</td>\n","      <td>Rock n Roll</td>\n","      <td>Canada</td>\n","      <td>2010.0</td>\n","      <td>502.0</td>\n","      <td>2980.0</td>\n","      <td>True</td>\n","      <td>True</td>\n","      <td>False</td>\n","      <td>0.744700</td>\n","      <td>-0.797531</td>\n","      <td>-0.034166</td>\n","      <td>-0.226052</td>\n","      <td>27.0</td>\n","      <td>concert_goer_1068</td>\n","      <td>146.0</td>\n","      <td>Canada</td>\n","    </tr>\n","    <tr>\n","      <th>3</th>\n","      <td>ConcertExperience_106446</td>\n","      <td>Flight of the Knickers</td>\n","      <td>NaN</td>\n","      <td>Canada</td>\n","      <td>2014.0</td>\n","      <td>532.0</td>\n","      <td>22026.0</td>\n","      <td>True</td>\n","      <td>False</td>\n","      <td>False</td>\n","      <td>-0.134180</td>\n","      <td>-0.361512</td>\n","      <td>0.969404</td>\n","      <td>-2.341205</td>\n","      <td>38.0</td>\n","      <td>concert_goer_1315</td>\n","      <td>183.0</td>\n","      <td>United States of America (USA)</td>\n","    </tr>\n","    <tr>\n","      <th>4</th>\n","      <td>ConcertExperience_127249</td>\n","      <td>Devon Revival</td>\n","      <td>RnB</td>\n","      <td>United States of America (USA)</td>\n","      <td>1992.0</td>\n","      <td>636.0</td>\n","      <td>2980.0</td>\n","      <td>False</td>\n","      <td>False</td>\n","      <td>False</td>\n","      <td>1.407366</td>\n","      <td>-0.084155</td>\n","      <td>-0.673233</td>\n","      <td>1.733714</td>\n","      <td>21.0</td>\n","      <td>concert_goer_1777</td>\n","      <td>177.0</td>\n","      <td>Fiji</td>\n","    </tr>\n","    <tr>\n","      <th>...</th>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","    </tr>\n","    <tr>\n","      <th>29995</th>\n","      <td>ConcertExperience_82288</td>\n","      <td>Joystick of the Big Knickers</td>\n","      <td>Hip Hop/Rap</td>\n","      <td>United States of America (USA)</td>\n","      <td>1979.0</td>\n","      <td>411.0</td>\n","      <td>2980.0</td>\n","      <td>True</td>\n","      <td>False</td>\n","      <td>False</td>\n","      <td>-0.421714</td>\n","      <td>-1.549670</td>\n","      <td>-0.351770</td>\n","      <td>0.132489</td>\n","      <td>42.0</td>\n","      <td>concert_goer_1710</td>\n","      <td>178.0</td>\n","      <td>United States of America (USA)</td>\n","    </tr>\n","    <tr>\n","      <th>29996</th>\n","      <td>ConcertExperience_27139</td>\n","      <td>Big Division</td>\n","      <td>Hip Hop/Rap</td>\n","      <td>United States of America (USA)</td>\n","      <td>1978.0</td>\n","      <td>135.0</td>\n","      <td>8103.0</td>\n","      <td>True</td>\n","      <td>False</td>\n","      <td>False</td>\n","      <td>0.615087</td>\n","      <td>-0.047092</td>\n","      <td>0.339228</td>\n","      <td>0.820159</td>\n","      <td>37.0</td>\n","      <td>concert_goer_1758</td>\n","      <td>186.0</td>\n","      <td>Canada</td>\n","    </tr>\n","    <tr>\n","      <th>29997</th>\n","      <td>ConcertExperience_197434</td>\n","      <td>Crazyplay</td>\n","      <td>Pop Music</td>\n","      <td>United States of America (USA)</td>\n","      <td>1995.0</td>\n","      <td>987.0</td>\n","      <td>8103.0</td>\n","      <td>False</td>\n","      <td>False</td>\n","      <td>True</td>\n","      <td>-1.396551</td>\n","      <td>-0.508627</td>\n","      <td>-1.692584</td>\n","      <td>1.640931</td>\n","      <td>45.0</td>\n","      <td>concert_goer_1481</td>\n","      <td>158.0</td>\n","      <td>Greece</td>\n","    </tr>\n","    <tr>\n","      <th>29998</th>\n","      <td>ConcertExperience_166029</td>\n","      <td>Lord of the Crazy Frogs</td>\n","      <td>RnB</td>\n","      <td>United States of America (USA)</td>\n","      <td>1968.0</td>\n","      <td>830.0</td>\n","      <td>8103.0</td>\n","      <td>False</td>\n","      <td>True</td>\n","      <td>False</td>\n","      <td>0.168073</td>\n","      <td>-0.785460</td>\n","      <td>0.898273</td>\n","      <td>1.608389</td>\n","      <td>36.0</td>\n","      <td>concert_goer_1461</td>\n","      <td>170.0</td>\n","      <td>United Kingdom (UK)</td>\n","    </tr>\n","    <tr>\n","      <th>29999</th>\n","      <td>ConcertExperience_24025</td>\n","      <td>Crazy Dream and a Pinch of Joystick</td>\n","      <td>Heavy Metal</td>\n","      <td>United States of America (USA)</td>\n","      <td>1995.0</td>\n","      <td>120.0</td>\n","      <td>54.0</td>\n","      <td>False</td>\n","      <td>True</td>\n","      <td>False</td>\n","      <td>-0.248370</td>\n","      <td>-0.809340</td>\n","      <td>0.085226</td>\n","      <td>-0.133507</td>\n","      <td>47.0</td>\n","      <td>concert_goer_1617</td>\n","      <td>189.0</td>\n","      <td>Canada</td>\n","    </tr>\n","  </tbody>\n","</table>\n","<p>30000 rows × 18 columns</p>\n","</div>\n","      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-89d7d3e4-7884-4b0d-9f8c-6ad95a31ee30')\"\n","              title=\"Convert this dataframe to an interactive table.\"\n","              style=\"display:none;\">\n","        \n","  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n","       width=\"24px\">\n","    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n","    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n","  </svg>\n","      </button>\n","      \n","  <style>\n","    .colab-df-container {\n","      display:flex;\n","      flex-wrap:wrap;\n","      gap: 12px;\n","    }\n","\n","    .colab-df-convert {\n","      background-color: #E8F0FE;\n","      border: none;\n","      border-radius: 50%;\n","      cursor: pointer;\n","      display: none;\n","      fill: #1967D2;\n","      height: 32px;\n","      padding: 0 0 0 0;\n","      width: 32px;\n","    }\n","\n","    .colab-df-convert:hover {\n","      background-color: #E2EBFA;\n","      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n","      fill: #174EA6;\n","    }\n","\n","    [theme=dark] .colab-df-convert {\n","      background-color: #3B4455;\n","      fill: #D2E3FC;\n","    }\n","\n","    [theme=dark] .colab-df-convert:hover {\n","      background-color: #434B5C;\n","      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n","      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n","      fill: #FFFFFF;\n","    }\n","  </style>\n","\n","      <script>\n","        const buttonEl =\n","          document.querySelector('#df-89d7d3e4-7884-4b0d-9f8c-6ad95a31ee30 button.colab-df-convert');\n","        buttonEl.style.display =\n","          google.colab.kernel.accessAllowed ? 'block' : 'none';\n","\n","        async function convertToInteractive(key) {\n","          const element = document.querySelector('#df-89d7d3e4-7884-4b0d-9f8c-6ad95a31ee30');\n","          const dataTable =\n","            await google.colab.kernel.invokeFunction('convertToInteractive',\n","                                                     [key], {});\n","          if (!dataTable) return;\n","\n","          const docLinkHtml = 'Like what you see? Visit the ' +\n","            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n","            + ' to learn more about interactive tables.';\n","          element.innerHTML = '';\n","          dataTable['output_type'] = 'display_data';\n","          await google.colab.output.renderOutput(dataTable, element);\n","          const docLink = document.createElement('div');\n","          docLink.innerHTML = docLinkHtml;\n","          element.appendChild(docLink);\n","        }\n","      </script>\n","    </div>\n","  </div>\n","  "]},"metadata":{},"execution_count":4}],"source":["test_data"]},{"cell_type":"markdown","metadata":{"id":"zvK6MsVef1CS"},"source":["## 1. Functions for data preprocessing"]},{"cell_type":"markdown","metadata":{"id":"YH4z_7n7oPYy"},"source":["### 1.1 Filter NaN with mean"]},{"cell_type":"code","execution_count":12,"metadata":{"id":"SQNLuO8noTzA","executionInfo":{"status":"ok","timestamp":1669913064797,"user_tz":300,"elapsed":108,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["def nan_replace_with_mean(data):\n","  '''\n","  This function is to transform the boolean value True to float 1, False to float 0.0 and NaN to 0.5\n","  args: \n","    Input:\n","        data(pandas.core.frame.DataFrame): one column of data to fit the encoder [shape: (# dataset,1)]\n","\n","    Return:\n","        transformed_data(pandas.core.frame.DataFrame): data after transformation by the fit encoder [shape: (# dataset,1)]\n","  '''\n","  mean=data.mean(axis=0)\n","  transformed_data=data.fillna(mean)\n","  return transformed_data"]},{"cell_type":"markdown","metadata":{"id":"zN3ctZyPhSSA"},"source":["### 1.2 One Hot encoder"]},{"cell_type":"code","execution_count":13,"metadata":{"id":"yI8uR-1ytFyx","executionInfo":{"status":"ok","timestamp":1669913064908,"user_tz":300,"elapsed":6,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["def onehot_encoder_fit_transform(train_data,test_data,column_head='none'):\n","  '''\n","  args: \n","    Input:\n","        train_data(pandas.core.frame.DataFrame): one column of data to fit the encoder [shape: (#fitset,1)]\n","        test_data(pandas.core.frame.DataFrame): one column of data to transform by the encoder [shape: (#dataset to transform,1)]\n","        column_head(string): name of column that user wishes to define\n","\n","    Return:\n","        transformed_data(pandas.core.frame.DataFrame): data after transformation by the fit encoder [shape: (#dataset transformed,#categories in fitset)]\n","  '''\n","  from sklearn import preprocessing\n","  encoder = preprocessing.OneHotEncoder(handle_unknown='ignore')\n","  encoder.fit(train_data)\n","  transformed_data=pd.DataFrame(encoder.transform(test_data).toarray())\n","\n","  col_num=len(transformed_data.columns)\n","  column_name=[]\n","  for i in range(col_num):\n","    column_name.append('%s%d' % (column_head, i))\n","\n","  transformed_data.columns = column_name\n","  return transformed_data"]},{"cell_type":"markdown","metadata":{"id":"cWcizwHszHFU"},"source":["### 1.3 Label binarizer encoder"]},{"cell_type":"code","execution_count":14,"metadata":{"id":"eumWhNRvLkSZ","executionInfo":{"status":"ok","timestamp":1669913065050,"user_tz":300,"elapsed":146,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["def label_binarizer_transform(data):\n","  '''\n","  This function is to transform the boolean value True to float 1, False to float 0.0 and NaN to 0.5\n","  args: \n","    Input:\n","        data(pandas.core.frame.DataFrame): one column of data to fit the encoder [shape: (# dataset to transform,1)]\n","\n","    Return:\n","        transformed_data(pandas.core.frame.DataFrame): data after transformation by the fit encoder [shape: (# dataset to transform,1)]\n","  '''\n","  transformed_data=data*1\n","  transformed_data=transformed_data.fillna(0.5)\n","  return transformed_data"]},{"cell_type":"markdown","metadata":{"id":"-dhwevXeRqFP"},"source":["### 1.4 MinMax scalar"]},{"cell_type":"code","execution_count":15,"metadata":{"id":"bptWHoHvRxdK","executionInfo":{"status":"ok","timestamp":1669913065051,"user_tz":300,"elapsed":7,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["def minmax_scalar(data):\n","  from sklearn.preprocessing import MinMaxScaler\n","  scaler_mm = MinMaxScaler()\n","  # nomalize data with minimum and maximum value\n","  data = scaler_mm.fit_transform(data)\n","  return data"]},{"cell_type":"markdown","metadata":{"id":"RRXAAQUdR9-_"},"source":["### 1.5 Standardization scalar"]},{"cell_type":"code","execution_count":16,"metadata":{"id":"bYn_hXdvSD5Y","executionInfo":{"status":"ok","timestamp":1669913065052,"user_tz":300,"elapsed":7,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["def standardize_scalar(data):\n","  from sklearn.preprocessing import StandardScaler\n","  scaler_ss = StandardScaler()\n","  # standardize data\n","  data = scaler_ss.fit_transform(data)\n","  return data"]},{"cell_type":"markdown","metadata":{"id":"BEBbi1J_x0UZ"},"source":["### 1.6 Shuffle"]},{"cell_type":"code","execution_count":17,"metadata":{"id":"XOhLoUFDx4MS","executionInfo":{"status":"ok","timestamp":1669913065052,"user_tz":300,"elapsed":6,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["def shuffle(y, X, seed=0):\n","    obs = X.shape[0]\n","    rng = np.random.default_rng(seed)\n","    perm = rng.permutation(obs)\n","    y = y[perm]\n","    X = X[perm, :]\n","    return (y, X)"]},{"cell_type":"markdown","metadata":{"id":"tpzH0QRLALOb"},"source":["### 1.7 Imputer"]},{"cell_type":"code","execution_count":18,"metadata":{"id":"uNdrMswMAQ-s","executionInfo":{"status":"ok","timestamp":1669913065053,"user_tz":300,"elapsed":7,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["from sklearn.experimental import enable_iterative_imputer\n","from sklearn.impute import IterativeImputer\n","\n","from sklearn.neighbors import KNeighborsRegressor\n","from sklearn.linear_model import BayesianRidge\n","\n","def imputeDataEstimator(data, estimator=BayesianRidge()):\n","  \"\"\"Performs multivariate data imputation on NaN values using the given estimator\n","\n","  Args:\n","    data (pandas.DataFrame): DataFrame of the entire dataset with NaNs\n","    estimator (estimator model): Model used to estimate NaN values\n","\n","  Returns:\n","    data (pandas.DataFrame): DataFrame of the entire dataset without NaNs\n","  \"\"\"\n","  imp = IterativeImputer(estimator=estimator, max_iter=10, random_state=0)\n","  data = imp.fit_transform(data.to_numpy())\n","  data = pd.DataFrame(data)\n","  return data"]},{"cell_type":"markdown","metadata":{"id":"if8dEa_Z5Mnt"},"source":["## 2. Data preprocessing"]},{"cell_type":"markdown","metadata":{"id":"l0TQ9BZnhmvt"},"source":["### 2.1 Preprocess training and test attributes"]},{"cell_type":"code","execution_count":19,"metadata":{"id":"cUMn4WQnB_M_","executionInfo":{"status":"ok","timestamp":1669913100687,"user_tz":300,"elapsed":232,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Band Name column\n","train_column=train_data[['Band Name']]\n","BNtrain_transformed=onehot_encoder_fit_transform(train_column,train_column,column_head='BN').to_numpy()\n","test_column=test_data[['Band Name']]\n","BNtest_transformed=onehot_encoder_fit_transform(train_column,test_column,column_head='BN').to_numpy()"]},{"cell_type":"code","execution_count":20,"metadata":{"id":"L7A6e8WpGxhS","executionInfo":{"status":"ok","timestamp":1669913100913,"user_tz":300,"elapsed":230,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Band Genre column\n","train_column=train_data[['Band Genre']]\n","BGtrain_transformed=onehot_encoder_fit_transform(train_column,train_column,column_head='BG').to_numpy()\n","test_column=test_data[['Band Genre']]\n","BGtest_transformed=onehot_encoder_fit_transform(train_column,test_column,column_head='BG').to_numpy()"]},{"cell_type":"code","execution_count":21,"metadata":{"id":"-ORLRJsNG6ds","executionInfo":{"status":"ok","timestamp":1669913101025,"user_tz":300,"elapsed":117,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Band Country of Origin column\n","train_column=train_data[['Band Country of Origin']]\n","BCtrain_transformed=onehot_encoder_fit_transform(train_column,train_column,column_head='BC').to_numpy()\n","test_column=test_data[['Band Country of Origin']]\n","BCtest_transformed=onehot_encoder_fit_transform(train_column,test_column,column_head='BC').to_numpy()\n","#print(BCcolumn_transformed)"]},{"cell_type":"code","execution_count":22,"metadata":{"id":"AuT0u_D6px4e","executionInfo":{"status":"ok","timestamp":1669913101026,"user_tz":300,"elapsed":11,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Band Debut column\n","train_column=train_data[['Band Debut']]\n","BDtrain_transformed=nan_replace_with_mean(train_column).to_numpy()\n","test_column=test_data[['Band Debut']]\n","BDtest_transformed=nan_replace_with_mean(test_column).to_numpy()"]},{"cell_type":"code","execution_count":23,"metadata":{"id":"gnC-bvWxqEhe","executionInfo":{"status":"ok","timestamp":1669913101026,"user_tz":300,"elapsed":10,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Concert ID column\n","train_column=train_data[['Concert ID']]\n","CItrain_transformed=nan_replace_with_mean(train_column).to_numpy()\n","test_column=test_data[['Concert ID']]\n","CItest_transformed=nan_replace_with_mean(test_column).to_numpy()"]},{"cell_type":"code","execution_count":24,"metadata":{"id":"cYLKmivyqUc8","executionInfo":{"status":"ok","timestamp":1669913101027,"user_tz":300,"elapsed":10,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Concert Attendance column\n","train_column=train_data[['Concert Attendance']]\n","CAtrain_transformed=nan_replace_with_mean(train_column).to_numpy()\n","test_column=test_data[['Concert Attendance']]\n","CAtest_transformed=nan_replace_with_mean(test_column).to_numpy()"]},{"cell_type":"code","execution_count":25,"metadata":{"id":"3xJwBxOhqeME","executionInfo":{"status":"ok","timestamp":1669913101027,"user_tz":300,"elapsed":10,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Personnality Trait 1 column\n","train_column=train_data[['Personnality Trait 1']]\n","PT1train_transformed=nan_replace_with_mean(train_column).to_numpy()\n","test_column=test_data[['Personnality Trait 1']]\n","PT1test_transformed=nan_replace_with_mean(test_column).to_numpy()"]},{"cell_type":"code","execution_count":26,"metadata":{"id":"k3sAOhvfqp7c","executionInfo":{"status":"ok","timestamp":1669913101028,"user_tz":300,"elapsed":10,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Personnality Trait 2 column\n","train_column=train_data[['Personnality Trait 2']]\n","PT2train_transformed=nan_replace_with_mean(train_column).to_numpy()\n","test_column=test_data[['Personnality Trait 2']]\n","PT2test_transformed=nan_replace_with_mean(test_column).to_numpy()"]},{"cell_type":"code","execution_count":27,"metadata":{"id":"tPbUi3DBqvdv","executionInfo":{"status":"ok","timestamp":1669913101028,"user_tz":300,"elapsed":9,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Personnality Trait 3 column\n","train_column=train_data[['Personnality Trait 3']]\n","PT3train_transformed=nan_replace_with_mean(train_column).to_numpy()\n","test_column=test_data[['Personnality Trait 3']]\n","PT3test_transformed=nan_replace_with_mean(test_column).to_numpy()"]},{"cell_type":"code","execution_count":28,"metadata":{"id":"mwg033-wq_Wh","executionInfo":{"status":"ok","timestamp":1669913101028,"user_tz":300,"elapsed":7,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Personnality Trait 4 column\n","train_column=train_data[['Personnality Trait 4']]\n","PT4train_transformed=nan_replace_with_mean(train_column).to_numpy()\n","test_column=test_data[['Personnality Trait 4']]\n","PT4test_transformed=nan_replace_with_mean(test_column).to_numpy()"]},{"cell_type":"code","execution_count":29,"metadata":{"id":"vtxeMuV1rEQa","executionInfo":{"status":"ok","timestamp":1669913101962,"user_tz":300,"elapsed":941,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Concert Goer Age column\n","train_column=train_data[['Concert Goer Age']]\n","CGAtrain_transformed=nan_replace_with_mean(train_column).to_numpy()\n","test_column=test_data[['Concert Goer Age']]\n","CGAtest_transformed=nan_replace_with_mean(test_column).to_numpy()"]},{"cell_type":"code","execution_count":30,"metadata":{"id":"h_fauFyyrRRN","executionInfo":{"status":"ok","timestamp":1669913101963,"user_tz":300,"elapsed":8,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Height (cm) column\n","train_column=train_data[['Height (cm)']]\n","HTtrain_transformed=nan_replace_with_mean(train_column).to_numpy()\n","test_column=test_data[['Height (cm)']]\n","HTtest_transformed=nan_replace_with_mean(test_column).to_numpy()"]},{"cell_type":"code","execution_count":31,"metadata":{"id":"34VuFnjfJWTT","executionInfo":{"status":"ok","timestamp":1669913101963,"user_tz":300,"elapsed":6,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Inside Venue column\n","train_column=train_data[['Inside Venue']]\n","IVtrain_transformed=label_binarizer_transform(train_column).to_numpy()\n","test_column=test_data[['Inside Venue']]\n","IVtest_transformed=label_binarizer_transform(test_column).to_numpy()\n","#print(IVcolumn_transformed)"]},{"cell_type":"code","execution_count":32,"metadata":{"id":"8DM71HZuW35e","executionInfo":{"status":"ok","timestamp":1669913101964,"user_tz":300,"elapsed":7,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Rain column\n","train_column=train_data[['Rain']]\n","RNtrain_transformed=label_binarizer_transform(train_column).to_numpy()\n","test_column=test_data[['Rain']]\n","RNtest_transformed=label_binarizer_transform(test_column).to_numpy()\n","#print(RNcolumn_transformed)"]},{"cell_type":"code","execution_count":33,"metadata":{"id":"N5oSuy6FXdrc","executionInfo":{"status":"ok","timestamp":1669913101964,"user_tz":300,"elapsed":6,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Seated column\n","train_column=train_data[['Seated']]\n","STtrain_transformed=label_binarizer_transform(train_column).to_numpy()\n","test_column=test_data[['Seated']]\n","STtest_transformed=label_binarizer_transform(test_column).to_numpy()\n","#print(STcolumn_transformed)"]},{"cell_type":"code","execution_count":34,"metadata":{"id":"j3iWB8cIXrhz","executionInfo":{"status":"ok","timestamp":1669913104247,"user_tz":300,"elapsed":2288,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Concert Goer ID column\n","train_column=train_data[['Concert Goer ID']]\n","CGtrain_transformed=onehot_encoder_fit_transform(train_column,train_column,column_head='CG').to_numpy()\n","test_column=test_data[['Concert Goer ID']]\n","CGtest_transformed=onehot_encoder_fit_transform(train_column,test_column,column_head='CG').to_numpy()\n","#print(CGcolumn_transformed)"]},{"cell_type":"code","execution_count":35,"metadata":{"id":"UIUM33M-X8yO","executionInfo":{"status":"ok","timestamp":1669913104248,"user_tz":300,"elapsed":7,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Concert Goer Country of Origin column\n","train_column=train_data[['Concert Goer Country of Origin']]\n","CGCtrain_transformed=onehot_encoder_fit_transform(train_column,train_column,column_head='CGC').to_numpy()\n","test_column=test_data[['Concert Goer Country of Origin']]\n","CGCtest_transformed=onehot_encoder_fit_transform(train_column,test_column,column_head='CGC').to_numpy()\n","#print(CGCtrain_transformed.shape)"]},{"cell_type":"markdown","metadata":{"id":"PDeXnkXjhvGf"},"source":["### 2.2 Preprocess training labels"]},{"cell_type":"code","execution_count":36,"metadata":{"id":"YWl0imwkh1Mb","executionInfo":{"status":"ok","timestamp":1669913104473,"user_tz":300,"elapsed":231,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["from sklearn import preprocessing\n","le = preprocessing.LabelEncoder()\n","le.fit([\"Worst Concert Ever\", \"Did Not Enjoy\", \"Enjoyed\", \"Best Concert Ever\"])\n","train_label=le.transform(train_data[['Concert Enjoyment']].to_numpy().ravel())"]},{"cell_type":"markdown","metadata":{"id":"M1Ari4WqSxEW"},"source":["### 2.3 Standardize and nomalize data"]},{"cell_type":"code","execution_count":37,"metadata":{"id":"XFwleEE7TQiZ","executionInfo":{"status":"ok","timestamp":1669913104474,"user_tz":300,"elapsed":7,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Assemble all\n","# Columns not used: ID, Concert goer ID\n","\n","BDtrain_transformed_mm=minmax_scalar(BDtrain_transformed)\n","BDtest_transformed_mm=minmax_scalar(BDtest_transformed)\n","\n","CGAtrain_transformed_ss=standardize_scalar(CGAtrain_transformed)\n","CGAtest_transformed_ss=standardize_scalar(CGAtest_transformed)\n","\n","HTtrain_transformed_ss=standardize_scalar(HTtrain_transformed)\n","HTtest_transformed_ss=standardize_scalar(HTtest_transformed)"]},{"cell_type":"markdown","metadata":{"id":"M7rN6iItdyr0"},"source":["### 2.4 Convert country to coordinate"]},{"cell_type":"code","execution_count":38,"metadata":{"id":"SOgfnpZHeaKH","executionInfo":{"status":"ok","timestamp":1669913104474,"user_tz":300,"elapsed":6,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["from geopy.geocoders import Nominatim\n","geolocator = Nominatim(user_agent=\"geoapiExercises\")\n","from geopy.extra.rate_limiter import RateLimiter\n","\n","def dictionaryOfCountries(data, column):\n","  \"\"\"Converts country names to corresponding coordinates\n","\n","  Args:\n","    data (pandas.DataFrame): DataFrame of the entire dataset\n","    column (string): Name of column to convert into coordinates\n","\n","  Returns:\n","    map (dictionary): Dictionary with (country as string: coordinates as tuple) as key: value\n","\n","  \"\"\"\n","  geocode = RateLimiter(geolocator.geocode, min_delay_seconds=1)\n","  map = {}\n","\n","  unique_countries = data[column].unique()\n","  for country in unique_countries:\n","    if isinstance(country, str) and country is not None and country != \"Insert Band Country of Origin\":\n","      last_index = country.rfind('(')\n","      if last_index != -1:\n","        country = country[0:last_index-1]\n","      coordinates = geocode(country)\n","      map[country] = (coordinates.latitude, coordinates.longitude)\n","    else:\n","      map[country] = (None, None)\n","\n","  return map"]},{"cell_type":"code","execution_count":39,"metadata":{"id":"xliPVcjLImRJ","executionInfo":{"status":"ok","timestamp":1669913104475,"user_tz":300,"elapsed":6,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["def country_to_coordinate(country_data: pd.DataFrame, coordinate_dict: dict) -> pd.DataFrame: \n","  \"\"\" Replace the country name with its coordinate (latitude and longitude).\n","\n","    Args:\n","        country_data (pd.DataFrame): country dataframe\n","        coordinate_dict (dict): dictionary of country's coordinate \n","    Returns:\n","        coordinate_data (pd.DataFrame): coordinate dataframe\n","  \"\"\"\n","  # remove content in the ()\n","  num_dataset=len(country_data)\n","  for i in range(num_dataset):\n","    country_i=str(country_data.iat[i,0])\n","    last_index = country_i.rfind('(')\n","    if last_index != -1:\n","        country_data.iat[i,0] = country_i[0:last_index-1]  \n","  # convert the country column to coordinate column\n","  column_name = country_data.columns\n","  country_data = country_data.rename(columns={column_name[0] : 'Latitude'})\n","  country_data['Longitude'] = country_data['Latitude']\n","  # replace country by coordinate\n","  for country in coordinate_dict.keys():\n","    country_data['Latitude'] = country_data['Latitude'].replace({country: coordinate_dict[country][0]})\n","    country_data['Longitude'] = country_data['Longitude'].replace({country: coordinate_dict[country][1]})\n","  return country_data"]},{"cell_type":"code","execution_count":40,"metadata":{"id":"INBhXgFdeiuN","executionInfo":{"status":"ok","timestamp":1669913658773,"user_tz":300,"elapsed":554304,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["dic_Bcountry_coordinates_train=dictionaryOfCountries(train_data,'Band Country of Origin')\n","band_country_coordinate_train=country_to_coordinate(train_data[['Band Country of Origin']],dic_Bcountry_coordinates_train)\n","\n","dic_Bcountry_coordinates_test=dictionaryOfCountries(test_data,'Band Country of Origin')\n","band_country_coordinate_test=country_to_coordinate(test_data[['Band Country of Origin']],dic_Bcountry_coordinates_test)\n","\n","dic_Ccountry_coordinates_train=dictionaryOfCountries(train_data,'Concert Goer Country of Origin')\n","cg_country_coordinate_train=country_to_coordinate(train_data[['Concert Goer Country of Origin']],dic_Ccountry_coordinates_train)\n","\n","dic_Ccountry_coordinates_test=dictionaryOfCountries(test_data,'Concert Goer Country of Origin')\n","cg_country_coordinate_test=country_to_coordinate(test_data[['Concert Goer Country of Origin']],dic_Ccountry_coordinates_test)"]},{"cell_type":"code","execution_count":41,"metadata":{"id":"lFTXBVSf_iel","executionInfo":{"status":"ok","timestamp":1669913659086,"user_tz":300,"elapsed":331,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Replace Nan with mean and convert to numpy array\n","bc_coordinate_train_transformed=nan_replace_with_mean(band_country_coordinate_train).to_numpy()\n","bc_coordinate_test_transformed=nan_replace_with_mean(band_country_coordinate_test).to_numpy()\n","cg_coordinate_train_transformed=nan_replace_with_mean(cg_country_coordinate_train).to_numpy()\n","cg_coordinate_test_transformed=nan_replace_with_mean(cg_country_coordinate_test).to_numpy()"]},{"cell_type":"markdown","metadata":{"id":"w-eiGgez1irB"},"source":["### 2.5 Band name (Data V3)"]},{"cell_type":"code","execution_count":42,"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"11ZKFddM7KHP","outputId":"b7e6c134-e83a-407f-84c4-853f415ff488","executionInfo":{"status":"ok","timestamp":1669913659087,"user_tz":300,"elapsed":10,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[{"output_type":"stream","name":"stderr","text":["/usr/local/lib/python3.8/dist-packages/sklearn/preprocessing/_label.py:98: DataConversionWarning: A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n","  y = column_or_1d(y, warn=True)\n","/usr/local/lib/python3.8/dist-packages/sklearn/preprocessing/_label.py:133: DataConversionWarning: A column-vector y was passed when a 1d array was expected. Please change the shape of y to (n_samples, ), for example using ravel().\n","  y = column_or_1d(y, warn=True)\n"]}],"source":["# Band Name column\n","from sklearn import preprocessing\n","le_2 = preprocessing.LabelEncoder()\n","le_2.fit(train_data[['Band Name']])\n","\n","band_name_label_train=le_2.transform(train_data[['Band Name']])\n","band_name_label_test=le_2.transform(test_data[['Band Name']])\n","\n","band_name_label_train=band_name_label_train.reshape((len(band_name_label_train), 1))\n","band_name_label_test=band_name_label_test.reshape((len(band_name_label_test), 1))"]},{"cell_type":"markdown","metadata":{"id":"CM1eT1nnA1bP"},"source":["##### Assemble"]},{"cell_type":"code","execution_count":43,"metadata":{"id":"j3oIKVKPAzij","executionInfo":{"status":"ok","timestamp":1669913659087,"user_tz":300,"elapsed":6,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# Assemble all\n","# Columns not used: ID, Concert goer ID\n","train_set=np.hstack((band_name_label_train, BGtrain_transformed,\\\n","                     bc_coordinate_train_transformed, BDtrain_transformed,\\\n","                     CAtrain_transformed,IVtrain_transformed,RNtrain_transformed,STtrain_transformed,PT1train_transformed,\\\n","                     PT2train_transformed,PT3train_transformed,PT4train_transformed,CGAtrain_transformed,\\\n","                     HTtrain_transformed,cg_coordinate_train_transformed,CItrain_transformed))\n","\n","test_set=np.hstack((band_name_label_test, BGtest_transformed,\\\n","                    bc_coordinate_test_transformed, BDtest_transformed,\\\n","                    CAtest_transformed,IVtest_transformed,RNtest_transformed,STtest_transformed,PT1test_transformed,\\\n","                    PT2test_transformed,PT3test_transformed,PT4test_transformed,CGAtest_transformed,\\\n","                    HTtest_transformed,cg_coordinate_test_transformed,CItest_transformed))"]},{"cell_type":"markdown","metadata":{"id":"uUn7s74bVEGQ"},"source":["## 3. Fit, predict and download results (best classifier)"]},{"cell_type":"markdown","metadata":{"id":"RS_WgPAYeRjN"},"source":["### 3.0 Helper functions"]},{"cell_type":"markdown","metadata":{"id":"uR31tfIgYwTW"},"source":["#### 3.0.1 Shuffle"]},{"cell_type":"code","execution_count":44,"metadata":{"id":"dKpclLtSTGv1","executionInfo":{"status":"ok","timestamp":1669913804490,"user_tz":300,"elapsed":96,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["(train_label,train_set)=shuffle(train_label,train_set)"]},{"cell_type":"markdown","metadata":{"id":"VmrbmuIAeUng"},"source":["#### 3.0.2 Download"]},{"cell_type":"code","execution_count":45,"metadata":{"id":"kukFGifxeYlv","executionInfo":{"status":"ok","timestamp":1669913804585,"user_tz":300,"elapsed":4,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# def download_predicted_label(predicted_label_number):\n","def download_predicted_label(predicted_label_number, origin_data):\n","  \"\"\" Generate an Excel file with prediction output.\n","\n","    Args:\n","        predicted_label_number (List): predicted output\n","        origin_data (DataFrame): origin input data\n","  \"\"\"\n","  y_pred_label=le.inverse_transform(predicted_label_number)\n","  y_pred_label = pd.DataFrame(y_pred_label, columns=['Predicted'])\n","  y_pred_label = pd.concat([origin_data['Id'], y_pred_label], axis=1)\n","  # To download\n","  from google.colab import files\n","  y_pred_label.to_csv('output.csv',encoding='utf-8-sig', index=False) \n","  files.download('output.csv')"]},{"cell_type":"markdown","metadata":{"id":"AsjOkrM9uNl1"},"source":["### 3.1 XGBoost"]},{"cell_type":"code","execution_count":46,"metadata":{"id":"vWKLvcAg0DQO","executionInfo":{"status":"ok","timestamp":1669913804804,"user_tz":300,"elapsed":222,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[],"source":["# calculate class weight\n","from sklearn.utils.class_weight import compute_sample_weight\n","sample_weights = compute_sample_weight(\n","    class_weight='balanced',\n","    y=train_label\n",")"]},{"cell_type":"code","execution_count":47,"metadata":{"id":"aAia491H0g1O","colab":{"base_uri":"https://localhost:8080/"},"outputId":"a889416e-88a4-41d5-f450-ae38d0f9edb7","executionInfo":{"status":"ok","timestamp":1669914551844,"user_tz":300,"elapsed":747043,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[{"output_type":"stream","name":"stdout","text":["Finished!\n"]}],"source":["from sklearn.model_selection import StratifiedKFold\n","from sklearn.model_selection import GridSearchCV\n","from xgboost import XGBClassifier\n","\n","# Set the parameters by cross-validation\n","# Optimal value (V2 data Coodinate): n_estimators=150;\n","# Optimal value (V3 data BN): n_estimators=50, reg_lambda=32, max_depth=15;\n","# Optimal value (V4 data BN+BG): n_estimators=100, reg_lambda=12, max_depth=15;\n","# Optimal value (V5 data CGI): n_estimators=50, reg_lambda=12, max_depth=19, child weight=15;\n","tuned_parameters = [\n","  {'n_estimators': [50],\n","   'max_depth':[15],\n","   'reg_lambda':[16],\n","   'min_child_weight':[5]\n","   },\n","]\n","stratified_3_fold = StratifiedKFold(n_splits=3, shuffle=True, random_state=0)\n","grid_search = GridSearchCV(\n","    XGBClassifier(sample_weight=sample_weights), tuned_parameters, scoring='accuracy', cv=stratified_3_fold\n",")\n","grid_search.fit(train_set, train_label); # train on the whole training\n","print('Finished!')"]},{"cell_type":"code","execution_count":48,"metadata":{"id":"DXc4MZZx3Ec1","colab":{"base_uri":"https://localhost:8080/"},"outputId":"289fc829-cf3f-498b-c485-7e3eae6669e2","executionInfo":{"status":"ok","timestamp":1669914551845,"user_tz":300,"elapsed":10,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[{"output_type":"stream","name":"stdout","text":["Best parameter set found on development set:\n","\n","{'max_depth': 15, 'min_child_weight': 5, 'n_estimators': 50, 'reg_lambda': 16}\n"]}],"source":["print(\"Best parameter set found on development set:\")\n","print()\n","print(grid_search.best_params_)"]},{"cell_type":"code","execution_count":49,"metadata":{"id":"pt345bpp3HO9","colab":{"base_uri":"https://localhost:8080/"},"outputId":"3d4d4f4b-e69b-46fd-895d-4fc52a3226c7","executionInfo":{"status":"ok","timestamp":1669914551846,"user_tz":300,"elapsed":8,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[{"output_type":"stream","name":"stdout","text":["Grid scores on development set:\n","\n","0.656 (+/-0.004) for {'max_depth': 15, 'min_child_weight': 5, 'n_estimators': 50, 'reg_lambda': 16}\n"]}],"source":["print(\"Grid scores on development set:\")\n","print()\n","means = grid_search.cv_results_['mean_test_score']\n","stds = grid_search.cv_results_['std_test_score']\n","for mean, std, params in zip(means, stds, grid_search.cv_results_['params']):\n","    print(\"%0.3f (+/-%0.03f) for %r\"\n","          % (mean, std * 2, params))"]},{"cell_type":"code","execution_count":50,"metadata":{"id":"X93GIX7PC_Mb","colab":{"base_uri":"https://localhost:8080/","height":0},"outputId":"8e990740-ab2f-433a-bc27-523278e1a080","executionInfo":{"status":"ok","timestamp":1669914554473,"user_tz":300,"elapsed":2633,"user":{"displayName":"Benjamin Åstrand","userId":"02272870937422467244"}}},"outputs":[{"output_type":"display_data","data":{"text/plain":["<IPython.core.display.Javascript object>"],"application/javascript":["\n","    async function download(id, filename, size) {\n","      if (!google.colab.kernel.accessAllowed) {\n","        return;\n","      }\n","      const div = document.createElement('div');\n","      const label = document.createElement('label');\n","      label.textContent = `Downloading \"${filename}\": `;\n","      div.appendChild(label);\n","      const progress = document.createElement('progress');\n","      progress.max = size;\n","      div.appendChild(progress);\n","      document.body.appendChild(div);\n","\n","      const buffers = [];\n","      let downloaded = 0;\n","\n","      const channel = await google.colab.kernel.comms.open(id);\n","      // Send a message to notify the kernel that we're ready.\n","      channel.send({})\n","\n","      for await (const message of channel.messages) {\n","        // Send a message to notify the kernel that we're ready.\n","        channel.send({})\n","        if (message.buffers) {\n","          for (const buffer of message.buffers) {\n","            buffers.push(buffer);\n","            downloaded += buffer.byteLength;\n","            progress.value = downloaded;\n","          }\n","        }\n","      }\n","      const blob = new Blob(buffers, {type: 'application/binary'});\n","      const a = document.createElement('a');\n","      a.href = window.URL.createObjectURL(blob);\n","      a.download = filename;\n","      div.appendChild(a);\n","      a.click();\n","      div.remove();\n","    }\n","  "]},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["<IPython.core.display.Javascript object>"],"application/javascript":["download(\"download_9321f61c-8b61-4d11-8e97-569d740bc8c7\", \"output.csv\", 1087050)"]},"metadata":{}}],"source":["submit_label=grid_search.predict(test_set)\n","download_predicted_label(submit_label, test_data)"]}],"metadata":{"colab":{"collapsed_sections":["bxkEXsjU5UC9","MaclL5IEFmMG","FkRFjD8RFudM","YH4z_7n7oPYy","zN3ctZyPhSSA","cWcizwHszHFU","-dhwevXeRqFP","RRXAAQUdR9-_","BEBbi1J_x0UZ","tpzH0QRLALOb","l0TQ9BZnhmvt","PDeXnkXjhvGf","M1Ari4WqSxEW","M7rN6iItdyr0","uR31tfIgYwTW","VmrbmuIAeUng","iqu9_KpnVtdO","wuOhYBHZdvOy"],"provenance":[]},"kernelspec":{"display_name":"Python 3","name":"python3"},"language_info":{"name":"python"}},"nbformat":4,"nbformat_minor":0}