13_Random Forests - Detección de Malware en Android.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a href=\"https://colab.research.google.com/drive/1O5sPD2ktmODXE3yyKU2VZz6kIN_-a1eM\">Abre este Jupyter en Google Colab</a>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Caso práctico: _Random Forest_"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "En este caso de uso práctico se pretende resolver un problema de detección de malware en dispositivos Android mediante el análisis del tráfico de red que genera el dispositivo mediante el uso de conjuntos de árboles de decisión."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Conjunto de datos: Detección de malware en Android"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Descripción\n",
    "The sophisticated and advanced Android malware is able to identify the presence of the emulator used by the malware analyst and in response, alter its behavior to evade detection. To overcome this issue, we installed the Android applications on the real device and captured its network traffic. See our publicly available Android Sandbox.\n",
    "\n",
    "CICAAGM dataset is captured by installing the Android apps on the real smartphones semi-automated. The dataset is generated from 1900 applications with the following three categories:\n",
    "\n",
    "**1. Adware (250 apps)**\n",
    "* Airpush: Designed to deliver unsolicited advertisements to the user’s systems for information stealing.\n",
    "* Dowgin: Designed as an advertisement library that can also steal the user’s information.\n",
    "* Kemoge: Designed to take over a user’s Android device. This adware is a hybrid of botnet and disguises itself as popular apps via repackaging.\n",
    "* Mobidash: Designed to display ads and to compromise user’s personal information.\n",
    "* Shuanet: Similar to Kemoge, Shuanet also is designed to take over a user’s device.\n",
    "\n",
    "**2. General Malware (150 apps)**\n",
    "* AVpass: Designed to be distributed in the guise of a Clock app.\n",
    "* FakeAV: Designed as a scam that tricks user to purchase a full version of the software in order to re-mediate non-existing infections.\n",
    "* FakeFlash/FakePlayer: Designed as a fake Flash app in order to direct users to a website (after successfully installed).\n",
    "* GGtracker: Designed for SMS fraud (sends SMS messages to a premium-rate number) and information stealing.\n",
    "* Penetho: Designed as a fake service (hacktool for Android devices that can be used to crack the WiFi password). The malware is also able to infect the user’s computer via infected email attachment, fake updates, external media and infected documents.\n",
    "\n",
    "**3. Benign (1500 apps)**\n",
    "* 2015 GooglePlay market (top free popular and top free new)\n",
    "* 2016 GooglePlay market (top free popular and top free new)\n",
    "\n",
    "### Ficheros de datos\n",
    "* pcap files – the network traffic of both the malware and benign (20% malware and 80% benign)\n",
    "* <span style=\"color:green\">.csv files - the list of extracted network traffic features generated by the CIC-flowmeter</span>\n",
    "\n",
    "### Descarga de los ficheros de datos\n",
    "https://www.unb.ca/cic/datasets/android-adware.html\n",
    "\n",
    "### Referencias adicionales sobre el conjunto de datos\n",
    "_Arash Habibi Lashkari, Andi Fitriah A. Kadir, Hugo Gonzalez, Kenneth Fon Mbah and Ali A. Ghorbani, “Towards a Network-Based Framework for Android Malware Detection and Characterization”, In the proceeding of the 15th International Conference on Privacy, Security and Trust, PST, Calgary, Canada, 2017._"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Imports"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import numpy as np\n",
    "from sklearn.model_selection import train_test_split\n",
    "from sklearn.preprocessing import RobustScaler\n",
    "from sklearn.metrics import f1_score"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "import warnings\n",
    "# Ignoramos algunos warnings que se producen por invocar el modelo sin el nombre de las características\n",
    "warnings.filterwarnings('ignore', category=UserWarning, message='.*X does not have valid feature names.*')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Funciones auxiliares"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Construcción de una función que realice el particionado completo\n",
    "def train_val_test_split(df, rstate=42, shuffle=True, stratify=None):\n",
    "    strat = df[stratify] if stratify else None\n",
    "    train_set, test_set = train_test_split(\n",
    "        df, test_size=0.4, random_state=rstate, shuffle=shuffle, stratify=strat)\n",
    "    strat = test_set[stratify] if stratify else None\n",
    "    val_set, test_set = train_test_split(\n",
    "        test_set, test_size=0.5, random_state=rstate, shuffle=shuffle, stratify=strat)\n",
    "    return (train_set, val_set, test_set)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "def remove_labels(df, label_name):\n",
    "    X = df.drop(label_name, axis=1)\n",
    "    y = df[label_name].copy()\n",
    "    return (X, y)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "def evaluate_result(y_pred, y, y_prep_pred, y_prep, metric):\n",
    "    print(metric.__name__, \"WITHOUT preparation:\", metric(y_pred, y, average='weighted'))\n",
    "    print(metric.__name__, \"WITH preparation:\", metric(y_prep_pred, y_prep, average='weighted'))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 1. Lectura del conjunto de datos"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "df = pd.read_csv('datasets/TotalFeatures-ISCXFlowMeter.csv')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 2. Visualización del conjunto de datos"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>duration</th>\n",
       "      <th>total_fpackets</th>\n",
       "      <th>total_bpackets</th>\n",
       "      <th>total_fpktl</th>\n",
       "      <th>total_bpktl</th>\n",
       "      <th>min_fpktl</th>\n",
       "      <th>min_bpktl</th>\n",
       "      <th>max_fpktl</th>\n",
       "      <th>max_bpktl</th>\n",
       "      <th>mean_fpktl</th>\n",
       "      <th>...</th>\n",
       "      <th>mean_idle</th>\n",
       "      <th>max_idle</th>\n",
       "      <th>std_idle</th>\n",
       "      <th>FFNEPD</th>\n",
       "      <th>Init_Win_bytes_forward</th>\n",
       "      <th>Init_Win_bytes_backward</th>\n",
       "      <th>RRT_samples_clnt</th>\n",
       "      <th>Act_data_pkt_forward</th>\n",
       "      <th>min_seg_size_forward</th>\n",
       "      <th>calss</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1020586</td>\n",
       "      <td>668</td>\n",
       "      <td>1641</td>\n",
       "      <td>35692</td>\n",
       "      <td>2276876</td>\n",
       "      <td>52</td>\n",
       "      <td>52</td>\n",
       "      <td>679</td>\n",
       "      <td>1390</td>\n",
       "      <td>53.431138</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2</td>\n",
       "      <td>4194240</td>\n",
       "      <td>1853440</td>\n",
       "      <td>1640</td>\n",
       "      <td>668</td>\n",
       "      <td>32</td>\n",
       "      <td>benign</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>80794</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>75</td>\n",
       "      <td>124</td>\n",
       "      <td>75</td>\n",
       "      <td>124</td>\n",
       "      <td>75</td>\n",
       "      <td>124</td>\n",
       "      <td>75.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>benign</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>998</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "      <td>187</td>\n",
       "      <td>0</td>\n",
       "      <td>52</td>\n",
       "      <td>-1</td>\n",
       "      <td>83</td>\n",
       "      <td>-1</td>\n",
       "      <td>62.333333</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>4</td>\n",
       "      <td>101888</td>\n",
       "      <td>-1</td>\n",
       "      <td>0</td>\n",
       "      <td>3</td>\n",
       "      <td>32</td>\n",
       "      <td>benign</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>189868</td>\n",
       "      <td>9</td>\n",
       "      <td>9</td>\n",
       "      <td>1448</td>\n",
       "      <td>6200</td>\n",
       "      <td>52</td>\n",
       "      <td>52</td>\n",
       "      <td>706</td>\n",
       "      <td>1390</td>\n",
       "      <td>160.888889</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2</td>\n",
       "      <td>4194240</td>\n",
       "      <td>2722560</td>\n",
       "      <td>8</td>\n",
       "      <td>9</td>\n",
       "      <td>32</td>\n",
       "      <td>benign</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>110577</td>\n",
       "      <td>4</td>\n",
       "      <td>6</td>\n",
       "      <td>528</td>\n",
       "      <td>1422</td>\n",
       "      <td>52</td>\n",
       "      <td>52</td>\n",
       "      <td>331</td>\n",
       "      <td>1005</td>\n",
       "      <td>132.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2</td>\n",
       "      <td>155136</td>\n",
       "      <td>31232</td>\n",
       "      <td>5</td>\n",
       "      <td>4</td>\n",
       "      <td>32</td>\n",
       "      <td>benign</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>261876</td>\n",
       "      <td>7</td>\n",
       "      <td>6</td>\n",
       "      <td>1618</td>\n",
       "      <td>882</td>\n",
       "      <td>52</td>\n",
       "      <td>52</td>\n",
       "      <td>730</td>\n",
       "      <td>477</td>\n",
       "      <td>231.142857</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2</td>\n",
       "      <td>4194240</td>\n",
       "      <td>926720</td>\n",
       "      <td>3</td>\n",
       "      <td>7</td>\n",
       "      <td>32</td>\n",
       "      <td>benign</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>14</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>104</td>\n",
       "      <td>0</td>\n",
       "      <td>52</td>\n",
       "      <td>-1</td>\n",
       "      <td>52</td>\n",
       "      <td>-1</td>\n",
       "      <td>52.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>3</td>\n",
       "      <td>5824</td>\n",
       "      <td>-1</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>32</td>\n",
       "      <td>benign</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>29675</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>71</td>\n",
       "      <td>213</td>\n",
       "      <td>71</td>\n",
       "      <td>213</td>\n",
       "      <td>71</td>\n",
       "      <td>213</td>\n",
       "      <td>71.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>benign</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>806635</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>239</td>\n",
       "      <td>0</td>\n",
       "      <td>52</td>\n",
       "      <td>-1</td>\n",
       "      <td>83</td>\n",
       "      <td>-1</td>\n",
       "      <td>59.750000</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>5</td>\n",
       "      <td>107008</td>\n",
       "      <td>-1</td>\n",
       "      <td>0</td>\n",
       "      <td>4</td>\n",
       "      <td>32</td>\n",
       "      <td>benign</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>56620</td>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>1074</td>\n",
       "      <td>719</td>\n",
       "      <td>52</td>\n",
       "      <td>52</td>\n",
       "      <td>592</td>\n",
       "      <td>667</td>\n",
       "      <td>358.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>3</td>\n",
       "      <td>128512</td>\n",
       "      <td>10816</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>32</td>\n",
       "      <td>benign</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>10 rows × 80 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "   duration  total_fpackets  total_bpackets  total_fpktl  total_bpktl  \\\n",
       "0   1020586             668            1641        35692      2276876   \n",
       "1     80794               1               1           75          124   \n",
       "2       998               3               0          187            0   \n",
       "3    189868               9               9         1448         6200   \n",
       "4    110577               4               6          528         1422   \n",
       "5    261876               7               6         1618          882   \n",
       "6        14               2               0          104            0   \n",
       "7     29675               1               1           71          213   \n",
       "8    806635               4               0          239            0   \n",
       "9     56620               3               2         1074          719   \n",
       "\n",
       "   min_fpktl  min_bpktl  max_fpktl  max_bpktl  mean_fpktl  ...  mean_idle  \\\n",
       "0         52         52        679       1390   53.431138  ...        0.0   \n",
       "1         75        124         75        124   75.000000  ...        0.0   \n",
       "2         52         -1         83         -1   62.333333  ...        0.0   \n",
       "3         52         52        706       1390  160.888889  ...        0.0   \n",
       "4         52         52        331       1005  132.000000  ...        0.0   \n",
       "5         52         52        730        477  231.142857  ...        0.0   \n",
       "6         52         -1         52         -1   52.000000  ...        0.0   \n",
       "7         71        213         71        213   71.000000  ...        0.0   \n",
       "8         52         -1         83         -1   59.750000  ...        0.0   \n",
       "9         52         52        592        667  358.000000  ...        0.0   \n",
       "\n",
       "   max_idle  std_idle  FFNEPD  Init_Win_bytes_forward  \\\n",
       "0        -1       0.0       2                 4194240   \n",
       "1        -1       0.0       2                       0   \n",
       "2        -1       0.0       4                  101888   \n",
       "3        -1       0.0       2                 4194240   \n",
       "4        -1       0.0       2                  155136   \n",
       "5        -1       0.0       2                 4194240   \n",
       "6        -1       0.0       3                    5824   \n",
       "7        -1       0.0       2                       0   \n",
       "8        -1       0.0       5                  107008   \n",
       "9        -1       0.0       3                  128512   \n",
       "\n",
       "   Init_Win_bytes_backward  RRT_samples_clnt  Act_data_pkt_forward  \\\n",
       "0                  1853440              1640                   668   \n",
       "1                        0                 0                     1   \n",
       "2                       -1                 0                     3   \n",
       "3                  2722560                 8                     9   \n",
       "4                    31232                 5                     4   \n",
       "5                   926720                 3                     7   \n",
       "6                       -1                 0                     2   \n",
       "7                        0                 0                     1   \n",
       "8                       -1                 0                     4   \n",
       "9                    10816                 1                     3   \n",
       "\n",
       "   min_seg_size_forward   calss  \n",
       "0                    32  benign  \n",
       "1                     0  benign  \n",
       "2                    32  benign  \n",
       "3                    32  benign  \n",
       "4                    32  benign  \n",
       "5                    32  benign  \n",
       "6                    32  benign  \n",
       "7                     0  benign  \n",
       "8                    32  benign  \n",
       "9                    32  benign  \n",
       "\n",
       "[10 rows x 80 columns]"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.head(10)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>duration</th>\n",
       "      <th>total_fpackets</th>\n",
       "      <th>total_bpackets</th>\n",
       "      <th>total_fpktl</th>\n",
       "      <th>total_bpktl</th>\n",
       "      <th>min_fpktl</th>\n",
       "      <th>min_bpktl</th>\n",
       "      <th>max_fpktl</th>\n",
       "      <th>max_bpktl</th>\n",
       "      <th>mean_fpktl</th>\n",
       "      <th>...</th>\n",
       "      <th>min_idle</th>\n",
       "      <th>mean_idle</th>\n",
       "      <th>max_idle</th>\n",
       "      <th>std_idle</th>\n",
       "      <th>FFNEPD</th>\n",
       "      <th>Init_Win_bytes_forward</th>\n",
       "      <th>Init_Win_bytes_backward</th>\n",
       "      <th>RRT_samples_clnt</th>\n",
       "      <th>Act_data_pkt_forward</th>\n",
       "      <th>min_seg_size_forward</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>count</th>\n",
       "      <td>6.319550e+05</td>\n",
       "      <td>631955.000000</td>\n",
       "      <td>631955.000000</td>\n",
       "      <td>6.319550e+05</td>\n",
       "      <td>6.319550e+05</td>\n",
       "      <td>631955.000000</td>\n",
       "      <td>631955.000000</td>\n",
       "      <td>631955.000000</td>\n",
       "      <td>631955.000000</td>\n",
       "      <td>631955.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>6.319550e+05</td>\n",
       "      <td>6.319550e+05</td>\n",
       "      <td>6.319550e+05</td>\n",
       "      <td>6.319550e+05</td>\n",
       "      <td>631955.000000</td>\n",
       "      <td>6.319550e+05</td>\n",
       "      <td>6.319550e+05</td>\n",
       "      <td>631955.000000</td>\n",
       "      <td>631955.00000</td>\n",
       "      <td>631955.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>mean</th>\n",
       "      <td>2.195245e+07</td>\n",
       "      <td>6.728514</td>\n",
       "      <td>10.431934</td>\n",
       "      <td>9.540172e+02</td>\n",
       "      <td>1.206042e+04</td>\n",
       "      <td>141.475727</td>\n",
       "      <td>44.357688</td>\n",
       "      <td>263.675901</td>\n",
       "      <td>183.248084</td>\n",
       "      <td>174.959706</td>\n",
       "      <td>...</td>\n",
       "      <td>1.997327e+07</td>\n",
       "      <td>2.031228e+07</td>\n",
       "      <td>2.075238e+07</td>\n",
       "      <td>4.663875e+05</td>\n",
       "      <td>2.360896</td>\n",
       "      <td>9.620796e+05</td>\n",
       "      <td>3.104519e+05</td>\n",
       "      <td>9.733144</td>\n",
       "      <td>6.72471</td>\n",
       "      <td>19.965713</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>std</th>\n",
       "      <td>1.900578e+08</td>\n",
       "      <td>174.161354</td>\n",
       "      <td>349.424019</td>\n",
       "      <td>8.235040e+04</td>\n",
       "      <td>4.824716e+05</td>\n",
       "      <td>157.680880</td>\n",
       "      <td>89.099554</td>\n",
       "      <td>289.644383</td>\n",
       "      <td>371.863224</td>\n",
       "      <td>162.024811</td>\n",
       "      <td>...</td>\n",
       "      <td>1.897986e+08</td>\n",
       "      <td>1.897902e+08</td>\n",
       "      <td>1.899721e+08</td>\n",
       "      <td>6.199704e+06</td>\n",
       "      <td>3.041810</td>\n",
       "      <td>1.705655e+06</td>\n",
       "      <td>6.647956e+05</td>\n",
       "      <td>347.877923</td>\n",
       "      <td>174.13813</td>\n",
       "      <td>14.914261</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>min</th>\n",
       "      <td>-1.800000e+01</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>-1.000000</td>\n",
       "      <td>-1.000000</td>\n",
       "      <td>-1.000000</td>\n",
       "      <td>-1.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>-1.000000e+00</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>-1.000000e+00</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>2.000000</td>\n",
       "      <td>-1.000000e+00</td>\n",
       "      <td>-1.000000e+00</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.00000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25%</th>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>6.900000e+01</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>52.000000</td>\n",
       "      <td>-1.000000</td>\n",
       "      <td>52.000000</td>\n",
       "      <td>-1.000000</td>\n",
       "      <td>52.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>-1.000000e+00</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>-1.000000e+00</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>2.000000</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>-1.000000e+00</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>50%</th>\n",
       "      <td>2.445000e+04</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.840000e+02</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>52.000000</td>\n",
       "      <td>-1.000000</td>\n",
       "      <td>83.000000</td>\n",
       "      <td>-1.000000</td>\n",
       "      <td>83.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>-1.000000e+00</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>-1.000000e+00</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>2.000000</td>\n",
       "      <td>8.761600e+04</td>\n",
       "      <td>-1.000000e+00</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.00000</td>\n",
       "      <td>32.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75%</th>\n",
       "      <td>1.759751e+06</td>\n",
       "      <td>3.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>4.270000e+02</td>\n",
       "      <td>1.670000e+02</td>\n",
       "      <td>108.000000</td>\n",
       "      <td>52.000000</td>\n",
       "      <td>421.000000</td>\n",
       "      <td>115.000000</td>\n",
       "      <td>356.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>1.013498e+06</td>\n",
       "      <td>1.291379e+06</td>\n",
       "      <td>1.306116e+06</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>2.000000</td>\n",
       "      <td>3.046400e+05</td>\n",
       "      <td>9.049600e+04</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>3.00000</td>\n",
       "      <td>32.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>max</th>\n",
       "      <td>4.431076e+10</td>\n",
       "      <td>48255.000000</td>\n",
       "      <td>74768.000000</td>\n",
       "      <td>4.049644e+07</td>\n",
       "      <td>1.039222e+08</td>\n",
       "      <td>1390.000000</td>\n",
       "      <td>1390.000000</td>\n",
       "      <td>1500.000000</td>\n",
       "      <td>1390.000000</td>\n",
       "      <td>1390.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>4.431072e+10</td>\n",
       "      <td>4.430000e+10</td>\n",
       "      <td>4.431072e+10</td>\n",
       "      <td>8.470000e+08</td>\n",
       "      <td>2269.000000</td>\n",
       "      <td>4.194240e+06</td>\n",
       "      <td>4.194240e+06</td>\n",
       "      <td>74524.000000</td>\n",
       "      <td>48255.00000</td>\n",
       "      <td>44.000000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>8 rows × 79 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "           duration  total_fpackets  total_bpackets   total_fpktl  \\\n",
       "count  6.319550e+05   631955.000000   631955.000000  6.319550e+05   \n",
       "mean   2.195245e+07        6.728514       10.431934  9.540172e+02   \n",
       "std    1.900578e+08      174.161354      349.424019  8.235040e+04   \n",
       "min   -1.800000e+01        0.000000        0.000000  0.000000e+00   \n",
       "25%    0.000000e+00        1.000000        0.000000  6.900000e+01   \n",
       "50%    2.445000e+04        1.000000        0.000000  1.840000e+02   \n",
       "75%    1.759751e+06        3.000000        1.000000  4.270000e+02   \n",
       "max    4.431076e+10    48255.000000    74768.000000  4.049644e+07   \n",
       "\n",
       "        total_bpktl      min_fpktl      min_bpktl      max_fpktl  \\\n",
       "count  6.319550e+05  631955.000000  631955.000000  631955.000000   \n",
       "mean   1.206042e+04     141.475727      44.357688     263.675901   \n",
       "std    4.824716e+05     157.680880      89.099554     289.644383   \n",
       "min    0.000000e+00      -1.000000      -1.000000      -1.000000   \n",
       "25%    0.000000e+00      52.000000      -1.000000      52.000000   \n",
       "50%    0.000000e+00      52.000000      -1.000000      83.000000   \n",
       "75%    1.670000e+02     108.000000      52.000000     421.000000   \n",
       "max    1.039222e+08    1390.000000    1390.000000    1500.000000   \n",
       "\n",
       "           max_bpktl     mean_fpktl  ...      min_idle     mean_idle  \\\n",
       "count  631955.000000  631955.000000  ...  6.319550e+05  6.319550e+05   \n",
       "mean      183.248084     174.959706  ...  1.997327e+07  2.031228e+07   \n",
       "std       371.863224     162.024811  ...  1.897986e+08  1.897902e+08   \n",
       "min        -1.000000       0.000000  ... -1.000000e+00  0.000000e+00   \n",
       "25%        -1.000000      52.000000  ... -1.000000e+00  0.000000e+00   \n",
       "50%        -1.000000      83.000000  ... -1.000000e+00  0.000000e+00   \n",
       "75%       115.000000     356.000000  ...  1.013498e+06  1.291379e+06   \n",
       "max      1390.000000    1390.000000  ...  4.431072e+10  4.430000e+10   \n",
       "\n",
       "           max_idle      std_idle         FFNEPD  Init_Win_bytes_forward  \\\n",
       "count  6.319550e+05  6.319550e+05  631955.000000            6.319550e+05   \n",
       "mean   2.075238e+07  4.663875e+05       2.360896            9.620796e+05   \n",
       "std    1.899721e+08  6.199704e+06       3.041810            1.705655e+06   \n",
       "min   -1.000000e+00  0.000000e+00       2.000000           -1.000000e+00   \n",
       "25%   -1.000000e+00  0.000000e+00       2.000000            0.000000e+00   \n",
       "50%   -1.000000e+00  0.000000e+00       2.000000            8.761600e+04   \n",
       "75%    1.306116e+06  0.000000e+00       2.000000            3.046400e+05   \n",
       "max    4.431072e+10  8.470000e+08    2269.000000            4.194240e+06   \n",
       "\n",
       "       Init_Win_bytes_backward  RRT_samples_clnt  Act_data_pkt_forward  \\\n",
       "count             6.319550e+05     631955.000000          631955.00000   \n",
       "mean              3.104519e+05          9.733144               6.72471   \n",
       "std               6.647956e+05        347.877923             174.13813   \n",
       "min              -1.000000e+00          0.000000               0.00000   \n",
       "25%              -1.000000e+00          0.000000               1.00000   \n",
       "50%              -1.000000e+00          0.000000               1.00000   \n",
       "75%               9.049600e+04          1.000000               3.00000   \n",
       "max               4.194240e+06      74524.000000           48255.00000   \n",
       "\n",
       "       min_seg_size_forward  \n",
       "count         631955.000000  \n",
       "mean              19.965713  \n",
       "std               14.914261  \n",
       "min                0.000000  \n",
       "25%                0.000000  \n",
       "50%               32.000000  \n",
       "75%               32.000000  \n",
       "max               44.000000  \n",
       "\n",
       "[8 rows x 79 columns]"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.describe()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 631955 entries, 0 to 631954\n",
      "Data columns (total 80 columns):\n",
      " #   Column                   Non-Null Count   Dtype  \n",
      "---  ------                   --------------   -----  \n",
      " 0   duration                 631955 non-null  int64  \n",
      " 1   total_fpackets           631955 non-null  int64  \n",
      " 2   total_bpackets           631955 non-null  int64  \n",
      " 3   total_fpktl              631955 non-null  int64  \n",
      " 4   total_bpktl              631955 non-null  int64  \n",
      " 5   min_fpktl                631955 non-null  int64  \n",
      " 6   min_bpktl                631955 non-null  int64  \n",
      " 7   max_fpktl                631955 non-null  int64  \n",
      " 8   max_bpktl                631955 non-null  int64  \n",
      " 9   mean_fpktl               631955 non-null  float64\n",
      " 10  mean_bpktl               631955 non-null  float64\n",
      " 11  std_fpktl                631955 non-null  float64\n",
      " 12  std_bpktl                631955 non-null  float64\n",
      " 13  total_fiat               631955 non-null  int64  \n",
      " 14  total_biat               631955 non-null  int64  \n",
      " 15  min_fiat                 631955 non-null  int64  \n",
      " 16  min_biat                 631955 non-null  int64  \n",
      " 17  max_fiat                 631955 non-null  int64  \n",
      " 18  max_biat                 631955 non-null  int64  \n",
      " 19  mean_fiat                631955 non-null  float64\n",
      " 20  mean_biat                631955 non-null  float64\n",
      " 21  std_fiat                 631955 non-null  float64\n",
      " 22  std_biat                 631955 non-null  float64\n",
      " 23  fpsh_cnt                 631955 non-null  int64  \n",
      " 24  bpsh_cnt                 631955 non-null  int64  \n",
      " 25  furg_cnt                 631955 non-null  int64  \n",
      " 26  burg_cnt                 631955 non-null  int64  \n",
      " 27  total_fhlen              631955 non-null  int64  \n",
      " 28  total_bhlen              631955 non-null  int64  \n",
      " 29  fPktsPerSecond           631955 non-null  float64\n",
      " 30  bPktsPerSecond           631955 non-null  float64\n",
      " 31  flowPktsPerSecond        631955 non-null  float64\n",
      " 32  flowBytesPerSecond       631955 non-null  float64\n",
      " 33  min_flowpktl             631955 non-null  int64  \n",
      " 34  max_flowpktl             631955 non-null  int64  \n",
      " 35  mean_flowpktl            631955 non-null  float64\n",
      " 36  std_flowpktl             631955 non-null  float64\n",
      " 37  min_flowiat              631955 non-null  int64  \n",
      " 38  max_flowiat              631955 non-null  int64  \n",
      " 39  mean_flowiat             631955 non-null  float64\n",
      " 40  std_flowiat              631955 non-null  float64\n",
      " 41  flow_fin                 631955 non-null  int64  \n",
      " 42  flow_syn                 631955 non-null  int64  \n",
      " 43  flow_rst                 631955 non-null  int64  \n",
      " 44  flow_psh                 631955 non-null  int64  \n",
      " 45  flow_ack                 631955 non-null  int64  \n",
      " 46  flow_urg                 631955 non-null  int64  \n",
      " 47  flow_cwr                 631955 non-null  int64  \n",
      " 48  flow_ece                 631955 non-null  int64  \n",
      " 49  downUpRatio              631955 non-null  float64\n",
      " 50  avgPacketSize            631955 non-null  float64\n",
      " 51  fAvgSegmentSize          631955 non-null  float64\n",
      " 52  fHeaderBytes             631955 non-null  int64  \n",
      " 53  fAvgBytesPerBulk         631955 non-null  int64  \n",
      " 54  fAvgPacketsPerBulk       631955 non-null  int64  \n",
      " 55  fAvgBulkRate             631955 non-null  int64  \n",
      " 56  bVarianceDataBytes       631955 non-null  float64\n",
      " 57  bAvgSegmentSize          631955 non-null  int64  \n",
      " 58  bAvgBytesPerBulk         631955 non-null  int64  \n",
      " 59  bAvgPacketsPerBulk       631955 non-null  int64  \n",
      " 60  bAvgBulkRate             631955 non-null  int64  \n",
      " 61  sflow_fpacket            631955 non-null  int64  \n",
      " 62  sflow_fbytes             631955 non-null  int64  \n",
      " 63  sflow_bpacket            631955 non-null  int64  \n",
      " 64  sflow_bbytes             631955 non-null  int64  \n",
      " 65  min_active               631955 non-null  int64  \n",
      " 66  mean_active              631955 non-null  float64\n",
      " 67  max_active               631955 non-null  int64  \n",
      " 68  std_active               631955 non-null  float64\n",
      " 69  min_idle                 631955 non-null  int64  \n",
      " 70  mean_idle                631955 non-null  float64\n",
      " 71  max_idle                 631955 non-null  int64  \n",
      " 72  std_idle                 631955 non-null  float64\n",
      " 73  FFNEPD                   631955 non-null  int64  \n",
      " 74  Init_Win_bytes_forward   631955 non-null  int64  \n",
      " 75  Init_Win_bytes_backward  631955 non-null  int64  \n",
      " 76  RRT_samples_clnt         631955 non-null  int64  \n",
      " 77  Act_data_pkt_forward     631955 non-null  int64  \n",
      " 78  min_seg_size_forward     631955 non-null  int64  \n",
      " 79  calss                    631955 non-null  object \n",
      "dtypes: float64(24), int64(55), object(1)\n",
      "memory usage: 385.7+ MB\n"
     ]
    }
   ],
   "source": [
    "df.info()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Longitud del conjunto de datos: 631955\n",
      "Número de características del conjunto de datos: 80\n"
     ]
    }
   ],
   "source": [
    "print(\"Longitud del conjunto de datos:\", len(df))\n",
    "print(\"Número de características del conjunto de datos:\", len(df.columns))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "calss\n",
       "benign            471597\n",
       "asware            155613\n",
       "GeneralMalware      4745\n",
       "Name: count, dtype: int64"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df[\"calss\"].value_counts()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Buscando correlaciones"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Transformamos la variable de salida a numérica para calcular correlaciones\n",
    "X = df.copy()\n",
    "X['calss'] = X['calss'].factorize()[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "calss                     1.000000\n",
       "flow_fin                  0.286175\n",
       "min_seg_size_forward      0.258352\n",
       "Init_Win_bytes_forward    0.129425\n",
       "std_fpktl                 0.123758\n",
       "                            ...   \n",
       "furg_cnt                       NaN\n",
       "burg_cnt                       NaN\n",
       "flow_urg                       NaN\n",
       "flow_cwr                       NaN\n",
       "flow_ece                       NaN\n",
       "Name: calss, Length: 80, dtype: float64"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Calculamos correlaciones\n",
    "corr_matrix = X.corr()\n",
    "corr_matrix[\"calss\"].sort_values(ascending=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>duration</th>\n",
       "      <th>total_fpackets</th>\n",
       "      <th>total_bpackets</th>\n",
       "      <th>total_fpktl</th>\n",
       "      <th>total_bpktl</th>\n",
       "      <th>min_fpktl</th>\n",
       "      <th>min_bpktl</th>\n",
       "      <th>max_fpktl</th>\n",
       "      <th>max_bpktl</th>\n",
       "      <th>mean_fpktl</th>\n",
       "      <th>...</th>\n",
       "      <th>mean_idle</th>\n",
       "      <th>max_idle</th>\n",
       "      <th>std_idle</th>\n",
       "      <th>FFNEPD</th>\n",
       "      <th>Init_Win_bytes_forward</th>\n",
       "      <th>Init_Win_bytes_backward</th>\n",
       "      <th>RRT_samples_clnt</th>\n",
       "      <th>Act_data_pkt_forward</th>\n",
       "      <th>min_seg_size_forward</th>\n",
       "      <th>calss</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>duration</th>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.004837</td>\n",
       "      <td>0.004011</td>\n",
       "      <td>0.001673</td>\n",
       "      <td>0.003518</td>\n",
       "      <td>-0.064100</td>\n",
       "      <td>-0.027231</td>\n",
       "      <td>0.008761</td>\n",
       "      <td>0.042925</td>\n",
       "      <td>-0.043746</td>\n",
       "      <td>...</td>\n",
       "      <td>0.998901</td>\n",
       "      <td>0.999458</td>\n",
       "      <td>0.047582</td>\n",
       "      <td>0.016532</td>\n",
       "      <td>0.027610</td>\n",
       "      <td>0.029712</td>\n",
       "      <td>0.003785</td>\n",
       "      <td>0.004838</td>\n",
       "      <td>0.082955</td>\n",
       "      <td>0.067066</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>total_fpackets</th>\n",
       "      <td>0.004837</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.924622</td>\n",
       "      <td>0.425756</td>\n",
       "      <td>0.904007</td>\n",
       "      <td>-0.018958</td>\n",
       "      <td>0.005252</td>\n",
       "      <td>0.024685</td>\n",
       "      <td>0.086255</td>\n",
       "      <td>-0.007910</td>\n",
       "      <td>...</td>\n",
       "      <td>0.001614</td>\n",
       "      <td>0.002267</td>\n",
       "      <td>0.017229</td>\n",
       "      <td>0.016089</td>\n",
       "      <td>0.050201</td>\n",
       "      <td>0.059224</td>\n",
       "      <td>0.902713</td>\n",
       "      <td>0.999866</td>\n",
       "      <td>0.018198</td>\n",
       "      <td>0.018377</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>total_bpackets</th>\n",
       "      <td>0.004011</td>\n",
       "      <td>0.924622</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.156780</td>\n",
       "      <td>0.997268</td>\n",
       "      <td>-0.017667</td>\n",
       "      <td>0.006912</td>\n",
       "      <td>0.018170</td>\n",
       "      <td>0.086886</td>\n",
       "      <td>-0.016104</td>\n",
       "      <td>...</td>\n",
       "      <td>0.000922</td>\n",
       "      <td>0.001617</td>\n",
       "      <td>0.016230</td>\n",
       "      <td>-0.000493</td>\n",
       "      <td>0.048190</td>\n",
       "      <td>0.058435</td>\n",
       "      <td>0.997580</td>\n",
       "      <td>0.924746</td>\n",
       "      <td>0.015124</td>\n",
       "      <td>0.019430</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>total_fpktl</th>\n",
       "      <td>0.001673</td>\n",
       "      <td>0.425756</td>\n",
       "      <td>0.156780</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.090082</td>\n",
       "      <td>-0.003099</td>\n",
       "      <td>0.000803</td>\n",
       "      <td>0.021278</td>\n",
       "      <td>0.022088</td>\n",
       "      <td>0.022409</td>\n",
       "      <td>...</td>\n",
       "      <td>0.000335</td>\n",
       "      <td>0.000609</td>\n",
       "      <td>0.009896</td>\n",
       "      <td>0.001657</td>\n",
       "      <td>0.013283</td>\n",
       "      <td>0.015991</td>\n",
       "      <td>0.088422</td>\n",
       "      <td>0.425789</td>\n",
       "      <td>0.005477</td>\n",
       "      <td>0.000679</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>total_bpktl</th>\n",
       "      <td>0.003518</td>\n",
       "      <td>0.904007</td>\n",
       "      <td>0.997268</td>\n",
       "      <td>0.090082</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.014926</td>\n",
       "      <td>0.005966</td>\n",
       "      <td>0.012560</td>\n",
       "      <td>0.079905</td>\n",
       "      <td>-0.017328</td>\n",
       "      <td>...</td>\n",
       "      <td>0.000812</td>\n",
       "      <td>0.001452</td>\n",
       "      <td>0.014336</td>\n",
       "      <td>-0.000293</td>\n",
       "      <td>0.043571</td>\n",
       "      <td>0.053134</td>\n",
       "      <td>0.999616</td>\n",
       "      <td>0.904129</td>\n",
       "      <td>0.012139</td>\n",
       "      <td>0.019838</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Init_Win_bytes_backward</th>\n",
       "      <td>0.029712</td>\n",
       "      <td>0.059224</td>\n",
       "      <td>0.058435</td>\n",
       "      <td>0.015991</td>\n",
       "      <td>0.053134</td>\n",
       "      <td>-0.268444</td>\n",
       "      <td>0.038319</td>\n",
       "      <td>0.429893</td>\n",
       "      <td>0.593143</td>\n",
       "      <td>-0.030004</td>\n",
       "      <td>...</td>\n",
       "      <td>0.026959</td>\n",
       "      <td>0.029512</td>\n",
       "      <td>0.097316</td>\n",
       "      <td>-0.052507</td>\n",
       "      <td>0.811204</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.056761</td>\n",
       "      <td>0.059242</td>\n",
       "      <td>0.333701</td>\n",
       "      <td>0.069405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>RRT_samples_clnt</th>\n",
       "      <td>0.003785</td>\n",
       "      <td>0.902713</td>\n",
       "      <td>0.997580</td>\n",
       "      <td>0.088422</td>\n",
       "      <td>0.999616</td>\n",
       "      <td>-0.016659</td>\n",
       "      <td>0.006156</td>\n",
       "      <td>0.015727</td>\n",
       "      <td>0.084280</td>\n",
       "      <td>-0.017595</td>\n",
       "      <td>...</td>\n",
       "      <td>0.000893</td>\n",
       "      <td>0.001560</td>\n",
       "      <td>0.015200</td>\n",
       "      <td>-0.000437</td>\n",
       "      <td>0.046784</td>\n",
       "      <td>0.056761</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.902834</td>\n",
       "      <td>0.014299</td>\n",
       "      <td>0.019679</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Act_data_pkt_forward</th>\n",
       "      <td>0.004838</td>\n",
       "      <td>0.999866</td>\n",
       "      <td>0.924746</td>\n",
       "      <td>0.425789</td>\n",
       "      <td>0.904129</td>\n",
       "      <td>-0.018947</td>\n",
       "      <td>0.005264</td>\n",
       "      <td>0.024705</td>\n",
       "      <td>0.086278</td>\n",
       "      <td>-0.007893</td>\n",
       "      <td>...</td>\n",
       "      <td>0.001617</td>\n",
       "      <td>0.002269</td>\n",
       "      <td>0.017233</td>\n",
       "      <td>0.000734</td>\n",
       "      <td>0.050220</td>\n",
       "      <td>0.059242</td>\n",
       "      <td>0.902834</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.018229</td>\n",
       "      <td>0.018391</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>min_seg_size_forward</th>\n",
       "      <td>0.082955</td>\n",
       "      <td>0.018198</td>\n",
       "      <td>0.015124</td>\n",
       "      <td>0.005477</td>\n",
       "      <td>0.012139</td>\n",
       "      <td>-0.686154</td>\n",
       "      <td>-0.189824</td>\n",
       "      <td>-0.074763</td>\n",
       "      <td>0.217989</td>\n",
       "      <td>-0.524024</td>\n",
       "      <td>...</td>\n",
       "      <td>0.077943</td>\n",
       "      <td>0.079324</td>\n",
       "      <td>0.048803</td>\n",
       "      <td>0.052177</td>\n",
       "      <td>0.394743</td>\n",
       "      <td>0.333701</td>\n",
       "      <td>0.014299</td>\n",
       "      <td>0.018229</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.258352</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>calss</th>\n",
       "      <td>0.067066</td>\n",
       "      <td>0.018377</td>\n",
       "      <td>0.019430</td>\n",
       "      <td>0.000679</td>\n",
       "      <td>0.019838</td>\n",
       "      <td>-0.271343</td>\n",
       "      <td>0.027032</td>\n",
       "      <td>-0.040019</td>\n",
       "      <td>0.073212</td>\n",
       "      <td>-0.211892</td>\n",
       "      <td>...</td>\n",
       "      <td>0.066348</td>\n",
       "      <td>0.066965</td>\n",
       "      <td>0.022790</td>\n",
       "      <td>0.018300</td>\n",
       "      <td>0.129425</td>\n",
       "      <td>0.069405</td>\n",
       "      <td>0.019679</td>\n",
       "      <td>0.018391</td>\n",
       "      <td>0.258352</td>\n",
       "      <td>1.000000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>80 rows × 80 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                         duration  total_fpackets  total_bpackets  \\\n",
       "duration                 1.000000        0.004837        0.004011   \n",
       "total_fpackets           0.004837        1.000000        0.924622   \n",
       "total_bpackets           0.004011        0.924622        1.000000   \n",
       "total_fpktl              0.001673        0.425756        0.156780   \n",
       "total_bpktl              0.003518        0.904007        0.997268   \n",
       "...                           ...             ...             ...   \n",
       "Init_Win_bytes_backward  0.029712        0.059224        0.058435   \n",
       "RRT_samples_clnt         0.003785        0.902713        0.997580   \n",
       "Act_data_pkt_forward     0.004838        0.999866        0.924746   \n",
       "min_seg_size_forward     0.082955        0.018198        0.015124   \n",
       "calss                    0.067066        0.018377        0.019430   \n",
       "\n",
       "                         total_fpktl  total_bpktl  min_fpktl  min_bpktl  \\\n",
       "duration                    0.001673     0.003518  -0.064100  -0.027231   \n",
       "total_fpackets              0.425756     0.904007  -0.018958   0.005252   \n",
       "total_bpackets              0.156780     0.997268  -0.017667   0.006912   \n",
       "total_fpktl                 1.000000     0.090082  -0.003099   0.000803   \n",
       "total_bpktl                 0.090082     1.000000  -0.014926   0.005966   \n",
       "...                              ...          ...        ...        ...   \n",
       "Init_Win_bytes_backward     0.015991     0.053134  -0.268444   0.038319   \n",
       "RRT_samples_clnt            0.088422     0.999616  -0.016659   0.006156   \n",
       "Act_data_pkt_forward        0.425789     0.904129  -0.018947   0.005264   \n",
       "min_seg_size_forward        0.005477     0.012139  -0.686154  -0.189824   \n",
       "calss                       0.000679     0.019838  -0.271343   0.027032   \n",
       "\n",
       "                         max_fpktl  max_bpktl  mean_fpktl  ...  mean_idle  \\\n",
       "duration                  0.008761   0.042925   -0.043746  ...   0.998901   \n",
       "total_fpackets            0.024685   0.086255   -0.007910  ...   0.001614   \n",
       "total_bpackets            0.018170   0.086886   -0.016104  ...   0.000922   \n",
       "total_fpktl               0.021278   0.022088    0.022409  ...   0.000335   \n",
       "total_bpktl               0.012560   0.079905   -0.017328  ...   0.000812   \n",
       "...                            ...        ...         ...  ...        ...   \n",
       "Init_Win_bytes_backward   0.429893   0.593143   -0.030004  ...   0.026959   \n",
       "RRT_samples_clnt          0.015727   0.084280   -0.017595  ...   0.000893   \n",
       "Act_data_pkt_forward      0.024705   0.086278   -0.007893  ...   0.001617   \n",
       "min_seg_size_forward     -0.074763   0.217989   -0.524024  ...   0.077943   \n",
       "calss                    -0.040019   0.073212   -0.211892  ...   0.066348   \n",
       "\n",
       "                         max_idle  std_idle    FFNEPD  Init_Win_bytes_forward  \\\n",
       "duration                 0.999458  0.047582  0.016532                0.027610   \n",
       "total_fpackets           0.002267  0.017229  0.016089                0.050201   \n",
       "total_bpackets           0.001617  0.016230 -0.000493                0.048190   \n",
       "total_fpktl              0.000609  0.009896  0.001657                0.013283   \n",
       "total_bpktl              0.001452  0.014336 -0.000293                0.043571   \n",
       "...                           ...       ...       ...                     ...   \n",
       "Init_Win_bytes_backward  0.029512  0.097316 -0.052507                0.811204   \n",
       "RRT_samples_clnt         0.001560  0.015200 -0.000437                0.046784   \n",
       "Act_data_pkt_forward     0.002269  0.017233  0.000734                0.050220   \n",
       "min_seg_size_forward     0.079324  0.048803  0.052177                0.394743   \n",
       "calss                    0.066965  0.022790  0.018300                0.129425   \n",
       "\n",
       "                         Init_Win_bytes_backward  RRT_samples_clnt  \\\n",
       "duration                                0.029712          0.003785   \n",
       "total_fpackets                          0.059224          0.902713   \n",
       "total_bpackets                          0.058435          0.997580   \n",
       "total_fpktl                             0.015991          0.088422   \n",
       "total_bpktl                             0.053134          0.999616   \n",
       "...                                          ...               ...   \n",
       "Init_Win_bytes_backward                 1.000000          0.056761   \n",
       "RRT_samples_clnt                        0.056761          1.000000   \n",
       "Act_data_pkt_forward                    0.059242          0.902834   \n",
       "min_seg_size_forward                    0.333701          0.014299   \n",
       "calss                                   0.069405          0.019679   \n",
       "\n",
       "                         Act_data_pkt_forward  min_seg_size_forward     calss  \n",
       "duration                             0.004838              0.082955  0.067066  \n",
       "total_fpackets                       0.999866              0.018198  0.018377  \n",
       "total_bpackets                       0.924746              0.015124  0.019430  \n",
       "total_fpktl                          0.425789              0.005477  0.000679  \n",
       "total_bpktl                          0.904129              0.012139  0.019838  \n",
       "...                                       ...                   ...       ...  \n",
       "Init_Win_bytes_backward              0.059242              0.333701  0.069405  \n",
       "RRT_samples_clnt                     0.902834              0.014299  0.019679  \n",
       "Act_data_pkt_forward                 1.000000              0.018229  0.018391  \n",
       "min_seg_size_forward                 0.018229              1.000000  0.258352  \n",
       "calss                                0.018391              0.258352  1.000000  \n",
       "\n",
       "[80 rows x 80 columns]"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "X.corr()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>duration</th>\n",
       "      <th>total_fpackets</th>\n",
       "      <th>total_bpackets</th>\n",
       "      <th>total_fpktl</th>\n",
       "      <th>total_bpktl</th>\n",
       "      <th>min_fpktl</th>\n",
       "      <th>min_bpktl</th>\n",
       "      <th>max_fpktl</th>\n",
       "      <th>max_bpktl</th>\n",
       "      <th>mean_fpktl</th>\n",
       "      <th>...</th>\n",
       "      <th>mean_idle</th>\n",
       "      <th>max_idle</th>\n",
       "      <th>std_idle</th>\n",
       "      <th>FFNEPD</th>\n",
       "      <th>Init_Win_bytes_forward</th>\n",
       "      <th>Init_Win_bytes_backward</th>\n",
       "      <th>RRT_samples_clnt</th>\n",
       "      <th>Act_data_pkt_forward</th>\n",
       "      <th>min_seg_size_forward</th>\n",
       "      <th>calss</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>duration</th>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.004837</td>\n",
       "      <td>0.004011</td>\n",
       "      <td>0.001673</td>\n",
       "      <td>0.003518</td>\n",
       "      <td>-0.064100</td>\n",
       "      <td>-0.027231</td>\n",
       "      <td>0.008761</td>\n",
       "      <td>0.042925</td>\n",
       "      <td>-0.043746</td>\n",
       "      <td>...</td>\n",
       "      <td>0.998901</td>\n",
       "      <td>0.999458</td>\n",
       "      <td>0.047582</td>\n",
       "      <td>0.016532</td>\n",
       "      <td>0.027610</td>\n",
       "      <td>0.029712</td>\n",
       "      <td>0.003785</td>\n",
       "      <td>0.004838</td>\n",
       "      <td>0.082955</td>\n",
       "      <td>0.067066</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>max_bpktl</th>\n",
       "      <td>0.042925</td>\n",
       "      <td>0.086255</td>\n",
       "      <td>0.086886</td>\n",
       "      <td>0.022088</td>\n",
       "      <td>0.079905</td>\n",
       "      <td>-0.277317</td>\n",
       "      <td>0.275923</td>\n",
       "      <td>0.492194</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.018358</td>\n",
       "      <td>...</td>\n",
       "      <td>0.035413</td>\n",
       "      <td>0.038732</td>\n",
       "      <td>0.127548</td>\n",
       "      <td>-0.044916</td>\n",
       "      <td>0.586742</td>\n",
       "      <td>0.593143</td>\n",
       "      <td>0.084280</td>\n",
       "      <td>0.086278</td>\n",
       "      <td>0.217989</td>\n",
       "      <td>0.073212</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>mean_bpktl</th>\n",
       "      <td>0.025117</td>\n",
       "      <td>0.139142</td>\n",
       "      <td>0.151761</td>\n",
       "      <td>0.018954</td>\n",
       "      <td>0.146437</td>\n",
       "      <td>-0.280648</td>\n",
       "      <td>0.465208</td>\n",
       "      <td>0.342392</td>\n",
       "      <td>0.895712</td>\n",
       "      <td>-0.096195</td>\n",
       "      <td>...</td>\n",
       "      <td>0.018533</td>\n",
       "      <td>0.021519</td>\n",
       "      <td>0.114949</td>\n",
       "      <td>-0.045442</td>\n",
       "      <td>0.452735</td>\n",
       "      <td>0.478823</td>\n",
       "      <td>0.150252</td>\n",
       "      <td>0.139172</td>\n",
       "      <td>0.122226</td>\n",
       "      <td>0.064753</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>std_fpktl</th>\n",
       "      <td>0.039350</td>\n",
       "      <td>0.010172</td>\n",
       "      <td>0.002331</td>\n",
       "      <td>0.011416</td>\n",
       "      <td>-0.003162</td>\n",
       "      <td>-0.245792</td>\n",
       "      <td>0.052877</td>\n",
       "      <td>0.817873</td>\n",
       "      <td>0.564243</td>\n",
       "      <td>0.259588</td>\n",
       "      <td>...</td>\n",
       "      <td>0.031418</td>\n",
       "      <td>0.033978</td>\n",
       "      <td>0.096844</td>\n",
       "      <td>-0.020885</td>\n",
       "      <td>0.558249</td>\n",
       "      <td>0.532900</td>\n",
       "      <td>0.000140</td>\n",
       "      <td>0.010182</td>\n",
       "      <td>0.301237</td>\n",
       "      <td>0.123758</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>std_bpktl</th>\n",
       "      <td>0.048743</td>\n",
       "      <td>0.020324</td>\n",
       "      <td>0.014005</td>\n",
       "      <td>0.007763</td>\n",
       "      <td>0.007768</td>\n",
       "      <td>-0.225143</td>\n",
       "      <td>0.035371</td>\n",
       "      <td>0.534532</td>\n",
       "      <td>0.941626</td>\n",
       "      <td>0.051756</td>\n",
       "      <td>...</td>\n",
       "      <td>0.042562</td>\n",
       "      <td>0.045450</td>\n",
       "      <td>0.113854</td>\n",
       "      <td>-0.033991</td>\n",
       "      <td>0.594790</td>\n",
       "      <td>0.577954</td>\n",
       "      <td>0.012050</td>\n",
       "      <td>0.020335</td>\n",
       "      <td>0.276055</td>\n",
       "      <td>0.072953</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>total_fiat</th>\n",
       "      <td>0.943898</td>\n",
       "      <td>0.002190</td>\n",
       "      <td>0.001718</td>\n",
       "      <td>0.000708</td>\n",
       "      <td>0.001546</td>\n",
       "      <td>-0.049879</td>\n",
       "      <td>-0.031218</td>\n",
       "      <td>-0.029233</td>\n",
       "      <td>-0.005961</td>\n",
       "      <td>-0.048869</td>\n",
       "      <td>...</td>\n",
       "      <td>0.943668</td>\n",
       "      <td>0.943339</td>\n",
       "      <td>0.015254</td>\n",
       "      <td>0.020302</td>\n",
       "      <td>-0.011637</td>\n",
       "      <td>-0.016421</td>\n",
       "      <td>0.001615</td>\n",
       "      <td>0.002190</td>\n",
       "      <td>0.065124</td>\n",
       "      <td>0.064770</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>min_fiat</th>\n",
       "      <td>0.841692</td>\n",
       "      <td>-0.001975</td>\n",
       "      <td>-0.002172</td>\n",
       "      <td>-0.000746</td>\n",
       "      <td>-0.001820</td>\n",
       "      <td>-0.040046</td>\n",
       "      <td>-0.036619</td>\n",
       "      <td>-0.052289</td>\n",
       "      <td>-0.035963</td>\n",
       "      <td>-0.053811</td>\n",
       "      <td>...</td>\n",
       "      <td>0.843330</td>\n",
       "      <td>0.842512</td>\n",
       "      <td>-0.005389</td>\n",
       "      <td>0.015316</td>\n",
       "      <td>-0.027350</td>\n",
       "      <td>-0.033944</td>\n",
       "      <td>-0.002037</td>\n",
       "      <td>-0.001974</td>\n",
       "      <td>0.051853</td>\n",
       "      <td>0.074491</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>max_fiat</th>\n",
       "      <td>0.943438</td>\n",
       "      <td>-0.000420</td>\n",
       "      <td>-0.000714</td>\n",
       "      <td>-0.000389</td>\n",
       "      <td>-0.000548</td>\n",
       "      <td>-0.046977</td>\n",
       "      <td>-0.032630</td>\n",
       "      <td>-0.032606</td>\n",
       "      <td>-0.009878</td>\n",
       "      <td>-0.049032</td>\n",
       "      <td>...</td>\n",
       "      <td>0.944412</td>\n",
       "      <td>0.943971</td>\n",
       "      <td>0.012557</td>\n",
       "      <td>0.017756</td>\n",
       "      <td>-0.012317</td>\n",
       "      <td>-0.016206</td>\n",
       "      <td>-0.000644</td>\n",
       "      <td>-0.000418</td>\n",
       "      <td>0.061285</td>\n",
       "      <td>0.064875</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>mean_fiat</th>\n",
       "      <td>0.918036</td>\n",
       "      <td>-0.001970</td>\n",
       "      <td>-0.002241</td>\n",
       "      <td>-0.000728</td>\n",
       "      <td>-0.001907</td>\n",
       "      <td>-0.042455</td>\n",
       "      <td>-0.036056</td>\n",
       "      <td>-0.048712</td>\n",
       "      <td>-0.032412</td>\n",
       "      <td>-0.052892</td>\n",
       "      <td>...</td>\n",
       "      <td>0.919653</td>\n",
       "      <td>0.918797</td>\n",
       "      <td>-0.003523</td>\n",
       "      <td>0.016958</td>\n",
       "      <td>-0.025823</td>\n",
       "      <td>-0.032466</td>\n",
       "      <td>-0.002113</td>\n",
       "      <td>-0.001968</td>\n",
       "      <td>0.055151</td>\n",
       "      <td>0.071397</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>std_flowpktl</th>\n",
       "      <td>0.036942</td>\n",
       "      <td>0.087741</td>\n",
       "      <td>0.087307</td>\n",
       "      <td>0.024298</td>\n",
       "      <td>0.080666</td>\n",
       "      <td>-0.262968</td>\n",
       "      <td>0.338513</td>\n",
       "      <td>0.631466</td>\n",
       "      <td>0.911584</td>\n",
       "      <td>0.095976</td>\n",
       "      <td>...</td>\n",
       "      <td>0.030013</td>\n",
       "      <td>0.033100</td>\n",
       "      <td>0.120257</td>\n",
       "      <td>-0.035737</td>\n",
       "      <td>0.580266</td>\n",
       "      <td>0.586355</td>\n",
       "      <td>0.084725</td>\n",
       "      <td>0.087764</td>\n",
       "      <td>0.219346</td>\n",
       "      <td>0.119375</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>min_flowiat</th>\n",
       "      <td>0.841666</td>\n",
       "      <td>-0.001972</td>\n",
       "      <td>-0.002169</td>\n",
       "      <td>-0.000744</td>\n",
       "      <td>-0.001816</td>\n",
       "      <td>-0.039980</td>\n",
       "      <td>-0.036623</td>\n",
       "      <td>-0.052221</td>\n",
       "      <td>-0.035917</td>\n",
       "      <td>-0.053744</td>\n",
       "      <td>...</td>\n",
       "      <td>0.843311</td>\n",
       "      <td>0.842493</td>\n",
       "      <td>-0.005388</td>\n",
       "      <td>0.015323</td>\n",
       "      <td>-0.027316</td>\n",
       "      <td>-0.033903</td>\n",
       "      <td>-0.002033</td>\n",
       "      <td>-0.001971</td>\n",
       "      <td>0.051763</td>\n",
       "      <td>0.074452</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>max_flowiat</th>\n",
       "      <td>0.999457</td>\n",
       "      <td>0.002273</td>\n",
       "      <td>0.001623</td>\n",
       "      <td>0.000611</td>\n",
       "      <td>0.001458</td>\n",
       "      <td>-0.061004</td>\n",
       "      <td>-0.028758</td>\n",
       "      <td>0.005240</td>\n",
       "      <td>0.038796</td>\n",
       "      <td>-0.043865</td>\n",
       "      <td>...</td>\n",
       "      <td>0.999602</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.043309</td>\n",
       "      <td>0.013884</td>\n",
       "      <td>0.026609</td>\n",
       "      <td>0.029591</td>\n",
       "      <td>0.001566</td>\n",
       "      <td>0.002276</td>\n",
       "      <td>0.079417</td>\n",
       "      <td>0.066992</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>mean_flowiat</th>\n",
       "      <td>0.949299</td>\n",
       "      <td>-0.002050</td>\n",
       "      <td>-0.002292</td>\n",
       "      <td>-0.000748</td>\n",
       "      <td>-0.001972</td>\n",
       "      <td>-0.044032</td>\n",
       "      <td>-0.035728</td>\n",
       "      <td>-0.048943</td>\n",
       "      <td>-0.031180</td>\n",
       "      <td>-0.054610</td>\n",
       "      <td>...</td>\n",
       "      <td>0.950940</td>\n",
       "      <td>0.950117</td>\n",
       "      <td>-0.002380</td>\n",
       "      <td>0.016349</td>\n",
       "      <td>-0.024163</td>\n",
       "      <td>-0.030175</td>\n",
       "      <td>-0.002169</td>\n",
       "      <td>-0.002048</td>\n",
       "      <td>0.056882</td>\n",
       "      <td>0.072549</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>flow_fin</th>\n",
       "      <td>0.068154</td>\n",
       "      <td>0.005461</td>\n",
       "      <td>0.004894</td>\n",
       "      <td>-0.001464</td>\n",
       "      <td>0.005112</td>\n",
       "      <td>-0.408271</td>\n",
       "      <td>-0.155843</td>\n",
       "      <td>-0.126824</td>\n",
       "      <td>0.035163</td>\n",
       "      <td>-0.356749</td>\n",
       "      <td>...</td>\n",
       "      <td>0.071426</td>\n",
       "      <td>0.071654</td>\n",
       "      <td>0.017388</td>\n",
       "      <td>0.048678</td>\n",
       "      <td>0.238759</td>\n",
       "      <td>0.204597</td>\n",
       "      <td>0.005338</td>\n",
       "      <td>0.005479</td>\n",
       "      <td>0.551140</td>\n",
       "      <td>0.286175</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>flow_syn</th>\n",
       "      <td>0.020298</td>\n",
       "      <td>0.045730</td>\n",
       "      <td>0.043305</td>\n",
       "      <td>0.012057</td>\n",
       "      <td>0.039253</td>\n",
       "      <td>-0.268203</td>\n",
       "      <td>0.010317</td>\n",
       "      <td>0.388110</td>\n",
       "      <td>0.537187</td>\n",
       "      <td>-0.043379</td>\n",
       "      <td>...</td>\n",
       "      <td>0.014644</td>\n",
       "      <td>0.018113</td>\n",
       "      <td>0.112752</td>\n",
       "      <td>0.012415</td>\n",
       "      <td>0.890695</td>\n",
       "      <td>0.729790</td>\n",
       "      <td>0.042069</td>\n",
       "      <td>0.045747</td>\n",
       "      <td>0.370962</td>\n",
       "      <td>0.115044</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>flow_rst</th>\n",
       "      <td>-0.003951</td>\n",
       "      <td>-0.004097</td>\n",
       "      <td>-0.004343</td>\n",
       "      <td>-0.001550</td>\n",
       "      <td>-0.003732</td>\n",
       "      <td>-0.098533</td>\n",
       "      <td>-0.063549</td>\n",
       "      <td>-0.106686</td>\n",
       "      <td>-0.040593</td>\n",
       "      <td>-0.121735</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.002382</td>\n",
       "      <td>-0.002685</td>\n",
       "      <td>-0.009004</td>\n",
       "      <td>0.028905</td>\n",
       "      <td>-0.067341</td>\n",
       "      <td>-0.064202</td>\n",
       "      <td>-0.004112</td>\n",
       "      <td>-0.004092</td>\n",
       "      <td>0.064160</td>\n",
       "      <td>0.058715</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>bVarianceDataBytes</th>\n",
       "      <td>0.042755</td>\n",
       "      <td>0.012731</td>\n",
       "      <td>0.006942</td>\n",
       "      <td>0.004947</td>\n",
       "      <td>0.002038</td>\n",
       "      <td>-0.184458</td>\n",
       "      <td>0.027897</td>\n",
       "      <td>0.428040</td>\n",
       "      <td>0.900543</td>\n",
       "      <td>0.019958</td>\n",
       "      <td>...</td>\n",
       "      <td>0.039000</td>\n",
       "      <td>0.041333</td>\n",
       "      <td>0.094613</td>\n",
       "      <td>-0.030463</td>\n",
       "      <td>0.516196</td>\n",
       "      <td>0.507734</td>\n",
       "      <td>0.005591</td>\n",
       "      <td>0.012739</td>\n",
       "      <td>0.231281</td>\n",
       "      <td>0.056086</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>bAvgSegmentSize</th>\n",
       "      <td>0.025105</td>\n",
       "      <td>0.139151</td>\n",
       "      <td>0.151778</td>\n",
       "      <td>0.018949</td>\n",
       "      <td>0.146457</td>\n",
       "      <td>-0.280510</td>\n",
       "      <td>0.465396</td>\n",
       "      <td>0.342137</td>\n",
       "      <td>0.895560</td>\n",
       "      <td>-0.096229</td>\n",
       "      <td>...</td>\n",
       "      <td>0.018527</td>\n",
       "      <td>0.021512</td>\n",
       "      <td>0.114916</td>\n",
       "      <td>-0.045430</td>\n",
       "      <td>0.452305</td>\n",
       "      <td>0.478400</td>\n",
       "      <td>0.150270</td>\n",
       "      <td>0.139180</td>\n",
       "      <td>0.121997</td>\n",
       "      <td>0.064755</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>min_active</th>\n",
       "      <td>0.997972</td>\n",
       "      <td>0.002195</td>\n",
       "      <td>0.001495</td>\n",
       "      <td>0.000434</td>\n",
       "      <td>0.001410</td>\n",
       "      <td>-0.058989</td>\n",
       "      <td>-0.028861</td>\n",
       "      <td>0.001318</td>\n",
       "      <td>0.033057</td>\n",
       "      <td>-0.044135</td>\n",
       "      <td>...</td>\n",
       "      <td>0.999746</td>\n",
       "      <td>0.998771</td>\n",
       "      <td>-0.005581</td>\n",
       "      <td>0.012340</td>\n",
       "      <td>0.022190</td>\n",
       "      <td>0.025199</td>\n",
       "      <td>0.001474</td>\n",
       "      <td>0.002198</td>\n",
       "      <td>0.077047</td>\n",
       "      <td>0.066001</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>mean_active</th>\n",
       "      <td>0.998911</td>\n",
       "      <td>0.002580</td>\n",
       "      <td>0.001852</td>\n",
       "      <td>0.000650</td>\n",
       "      <td>0.001724</td>\n",
       "      <td>-0.059924</td>\n",
       "      <td>-0.028800</td>\n",
       "      <td>0.003287</td>\n",
       "      <td>0.035932</td>\n",
       "      <td>-0.043954</td>\n",
       "      <td>...</td>\n",
       "      <td>0.999998</td>\n",
       "      <td>0.999603</td>\n",
       "      <td>0.016879</td>\n",
       "      <td>0.012854</td>\n",
       "      <td>0.024362</td>\n",
       "      <td>0.027367</td>\n",
       "      <td>0.001808</td>\n",
       "      <td>0.002582</td>\n",
       "      <td>0.078161</td>\n",
       "      <td>0.066552</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>max_active</th>\n",
       "      <td>0.999465</td>\n",
       "      <td>0.003261</td>\n",
       "      <td>0.002592</td>\n",
       "      <td>0.000919</td>\n",
       "      <td>0.002409</td>\n",
       "      <td>-0.061083</td>\n",
       "      <td>-0.028773</td>\n",
       "      <td>0.005583</td>\n",
       "      <td>0.039286</td>\n",
       "      <td>-0.043762</td>\n",
       "      <td>...</td>\n",
       "      <td>0.999596</td>\n",
       "      <td>0.999998</td>\n",
       "      <td>0.043430</td>\n",
       "      <td>0.013858</td>\n",
       "      <td>0.027031</td>\n",
       "      <td>0.029961</td>\n",
       "      <td>0.002520</td>\n",
       "      <td>0.003264</td>\n",
       "      <td>0.079542</td>\n",
       "      <td>0.067178</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>min_idle</th>\n",
       "      <td>0.997952</td>\n",
       "      <td>0.001258</td>\n",
       "      <td>0.000610</td>\n",
       "      <td>0.000113</td>\n",
       "      <td>0.000544</td>\n",
       "      <td>-0.058793</td>\n",
       "      <td>-0.028867</td>\n",
       "      <td>0.001028</td>\n",
       "      <td>0.032544</td>\n",
       "      <td>-0.044117</td>\n",
       "      <td>...</td>\n",
       "      <td>0.999743</td>\n",
       "      <td>0.998762</td>\n",
       "      <td>-0.005776</td>\n",
       "      <td>0.012279</td>\n",
       "      <td>0.021657</td>\n",
       "      <td>0.024794</td>\n",
       "      <td>0.000605</td>\n",
       "      <td>0.001261</td>\n",
       "      <td>0.076794</td>\n",
       "      <td>0.065804</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>mean_idle</th>\n",
       "      <td>0.998901</td>\n",
       "      <td>0.001614</td>\n",
       "      <td>0.000922</td>\n",
       "      <td>0.000335</td>\n",
       "      <td>0.000812</td>\n",
       "      <td>-0.059748</td>\n",
       "      <td>-0.028819</td>\n",
       "      <td>0.002983</td>\n",
       "      <td>0.035413</td>\n",
       "      <td>-0.043962</td>\n",
       "      <td>...</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.999601</td>\n",
       "      <td>0.016744</td>\n",
       "      <td>0.012852</td>\n",
       "      <td>0.023865</td>\n",
       "      <td>0.026959</td>\n",
       "      <td>0.000893</td>\n",
       "      <td>0.001617</td>\n",
       "      <td>0.077943</td>\n",
       "      <td>0.066348</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>max_idle</th>\n",
       "      <td>0.999458</td>\n",
       "      <td>0.002267</td>\n",
       "      <td>0.001617</td>\n",
       "      <td>0.000609</td>\n",
       "      <td>0.001452</td>\n",
       "      <td>-0.060904</td>\n",
       "      <td>-0.028800</td>\n",
       "      <td>0.005244</td>\n",
       "      <td>0.038732</td>\n",
       "      <td>-0.043786</td>\n",
       "      <td>...</td>\n",
       "      <td>0.999601</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.043323</td>\n",
       "      <td>0.013880</td>\n",
       "      <td>0.026525</td>\n",
       "      <td>0.029512</td>\n",
       "      <td>0.001560</td>\n",
       "      <td>0.002269</td>\n",
       "      <td>0.079324</td>\n",
       "      <td>0.066965</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Init_Win_bytes_forward</th>\n",
       "      <td>0.027610</td>\n",
       "      <td>0.050201</td>\n",
       "      <td>0.048190</td>\n",
       "      <td>0.013283</td>\n",
       "      <td>0.043571</td>\n",
       "      <td>-0.323350</td>\n",
       "      <td>0.007284</td>\n",
       "      <td>0.409109</td>\n",
       "      <td>0.586742</td>\n",
       "      <td>-0.075007</td>\n",
       "      <td>...</td>\n",
       "      <td>0.023865</td>\n",
       "      <td>0.026525</td>\n",
       "      <td>0.095880</td>\n",
       "      <td>-0.021448</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.811204</td>\n",
       "      <td>0.046784</td>\n",
       "      <td>0.050220</td>\n",
       "      <td>0.394743</td>\n",
       "      <td>0.129425</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Init_Win_bytes_backward</th>\n",
       "      <td>0.029712</td>\n",
       "      <td>0.059224</td>\n",
       "      <td>0.058435</td>\n",
       "      <td>0.015991</td>\n",
       "      <td>0.053134</td>\n",
       "      <td>-0.268444</td>\n",
       "      <td>0.038319</td>\n",
       "      <td>0.429893</td>\n",
       "      <td>0.593143</td>\n",
       "      <td>-0.030004</td>\n",
       "      <td>...</td>\n",
       "      <td>0.026959</td>\n",
       "      <td>0.029512</td>\n",
       "      <td>0.097316</td>\n",
       "      <td>-0.052507</td>\n",
       "      <td>0.811204</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.056761</td>\n",
       "      <td>0.059242</td>\n",
       "      <td>0.333701</td>\n",
       "      <td>0.069405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>min_seg_size_forward</th>\n",
       "      <td>0.082955</td>\n",
       "      <td>0.018198</td>\n",
       "      <td>0.015124</td>\n",
       "      <td>0.005477</td>\n",
       "      <td>0.012139</td>\n",
       "      <td>-0.686154</td>\n",
       "      <td>-0.189824</td>\n",
       "      <td>-0.074763</td>\n",
       "      <td>0.217989</td>\n",
       "      <td>-0.524024</td>\n",
       "      <td>...</td>\n",
       "      <td>0.077943</td>\n",
       "      <td>0.079324</td>\n",
       "      <td>0.048803</td>\n",
       "      <td>0.052177</td>\n",
       "      <td>0.394743</td>\n",
       "      <td>0.333701</td>\n",
       "      <td>0.014299</td>\n",
       "      <td>0.018229</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.258352</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>calss</th>\n",
       "      <td>0.067066</td>\n",
       "      <td>0.018377</td>\n",
       "      <td>0.019430</td>\n",
       "      <td>0.000679</td>\n",
       "      <td>0.019838</td>\n",
       "      <td>-0.271343</td>\n",
       "      <td>0.027032</td>\n",
       "      <td>-0.040019</td>\n",
       "      <td>0.073212</td>\n",
       "      <td>-0.211892</td>\n",
       "      <td>...</td>\n",
       "      <td>0.066348</td>\n",
       "      <td>0.066965</td>\n",
       "      <td>0.022790</td>\n",
       "      <td>0.018300</td>\n",
       "      <td>0.129425</td>\n",
       "      <td>0.069405</td>\n",
       "      <td>0.019679</td>\n",
       "      <td>0.018391</td>\n",
       "      <td>0.258352</td>\n",
       "      <td>1.000000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>28 rows × 80 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                         duration  total_fpackets  total_bpackets  \\\n",
       "duration                 1.000000        0.004837        0.004011   \n",
       "max_bpktl                0.042925        0.086255        0.086886   \n",
       "mean_bpktl               0.025117        0.139142        0.151761   \n",
       "std_fpktl                0.039350        0.010172        0.002331   \n",
       "std_bpktl                0.048743        0.020324        0.014005   \n",
       "total_fiat               0.943898        0.002190        0.001718   \n",
       "min_fiat                 0.841692       -0.001975       -0.002172   \n",
       "max_fiat                 0.943438       -0.000420       -0.000714   \n",
       "mean_fiat                0.918036       -0.001970       -0.002241   \n",
       "std_flowpktl             0.036942        0.087741        0.087307   \n",
       "min_flowiat              0.841666       -0.001972       -0.002169   \n",
       "max_flowiat              0.999457        0.002273        0.001623   \n",
       "mean_flowiat             0.949299       -0.002050       -0.002292   \n",
       "flow_fin                 0.068154        0.005461        0.004894   \n",
       "flow_syn                 0.020298        0.045730        0.043305   \n",
       "flow_rst                -0.003951       -0.004097       -0.004343   \n",
       "bVarianceDataBytes       0.042755        0.012731        0.006942   \n",
       "bAvgSegmentSize          0.025105        0.139151        0.151778   \n",
       "min_active               0.997972        0.002195        0.001495   \n",
       "mean_active              0.998911        0.002580        0.001852   \n",
       "max_active               0.999465        0.003261        0.002592   \n",
       "min_idle                 0.997952        0.001258        0.000610   \n",
       "mean_idle                0.998901        0.001614        0.000922   \n",
       "max_idle                 0.999458        0.002267        0.001617   \n",
       "Init_Win_bytes_forward   0.027610        0.050201        0.048190   \n",
       "Init_Win_bytes_backward  0.029712        0.059224        0.058435   \n",
       "min_seg_size_forward     0.082955        0.018198        0.015124   \n",
       "calss                    0.067066        0.018377        0.019430   \n",
       "\n",
       "                         total_fpktl  total_bpktl  min_fpktl  min_bpktl  \\\n",
       "duration                    0.001673     0.003518  -0.064100  -0.027231   \n",
       "max_bpktl                   0.022088     0.079905  -0.277317   0.275923   \n",
       "mean_bpktl                  0.018954     0.146437  -0.280648   0.465208   \n",
       "std_fpktl                   0.011416    -0.003162  -0.245792   0.052877   \n",
       "std_bpktl                   0.007763     0.007768  -0.225143   0.035371   \n",
       "total_fiat                  0.000708     0.001546  -0.049879  -0.031218   \n",
       "min_fiat                   -0.000746    -0.001820  -0.040046  -0.036619   \n",
       "max_fiat                   -0.000389    -0.000548  -0.046977  -0.032630   \n",
       "mean_fiat                  -0.000728    -0.001907  -0.042455  -0.036056   \n",
       "std_flowpktl                0.024298     0.080666  -0.262968   0.338513   \n",
       "min_flowiat                -0.000744    -0.001816  -0.039980  -0.036623   \n",
       "max_flowiat                 0.000611     0.001458  -0.061004  -0.028758   \n",
       "mean_flowiat               -0.000748    -0.001972  -0.044032  -0.035728   \n",
       "flow_fin                   -0.001464     0.005112  -0.408271  -0.155843   \n",
       "flow_syn                    0.012057     0.039253  -0.268203   0.010317   \n",
       "flow_rst                   -0.001550    -0.003732  -0.098533  -0.063549   \n",
       "bVarianceDataBytes          0.004947     0.002038  -0.184458   0.027897   \n",
       "bAvgSegmentSize             0.018949     0.146457  -0.280510   0.465396   \n",
       "min_active                  0.000434     0.001410  -0.058989  -0.028861   \n",
       "mean_active                 0.000650     0.001724  -0.059924  -0.028800   \n",
       "max_active                  0.000919     0.002409  -0.061083  -0.028773   \n",
       "min_idle                    0.000113     0.000544  -0.058793  -0.028867   \n",
       "mean_idle                   0.000335     0.000812  -0.059748  -0.028819   \n",
       "max_idle                    0.000609     0.001452  -0.060904  -0.028800   \n",
       "Init_Win_bytes_forward      0.013283     0.043571  -0.323350   0.007284   \n",
       "Init_Win_bytes_backward     0.015991     0.053134  -0.268444   0.038319   \n",
       "min_seg_size_forward        0.005477     0.012139  -0.686154  -0.189824   \n",
       "calss                       0.000679     0.019838  -0.271343   0.027032   \n",
       "\n",
       "                         max_fpktl  max_bpktl  mean_fpktl  ...  mean_idle  \\\n",
       "duration                  0.008761   0.042925   -0.043746  ...   0.998901   \n",
       "max_bpktl                 0.492194   1.000000   -0.018358  ...   0.035413   \n",
       "mean_bpktl                0.342392   0.895712   -0.096195  ...   0.018533   \n",
       "std_fpktl                 0.817873   0.564243    0.259588  ...   0.031418   \n",
       "std_bpktl                 0.534532   0.941626    0.051756  ...   0.042562   \n",
       "total_fiat               -0.029233  -0.005961   -0.048869  ...   0.943668   \n",
       "min_fiat                 -0.052289  -0.035963   -0.053811  ...   0.843330   \n",
       "max_fiat                 -0.032606  -0.009878   -0.049032  ...   0.944412   \n",
       "mean_fiat                -0.048712  -0.032412   -0.052892  ...   0.919653   \n",
       "std_flowpktl              0.631466   0.911584    0.095976  ...   0.030013   \n",
       "min_flowiat              -0.052221  -0.035917   -0.053744  ...   0.843311   \n",
       "max_flowiat               0.005240   0.038796   -0.043865  ...   0.999602   \n",
       "mean_flowiat             -0.048943  -0.031180   -0.054610  ...   0.950940   \n",
       "flow_fin                 -0.126824   0.035163   -0.356749  ...   0.071426   \n",
       "flow_syn                  0.388110   0.537187   -0.043379  ...   0.014644   \n",
       "flow_rst                 -0.106686  -0.040593   -0.121735  ...  -0.002382   \n",
       "bVarianceDataBytes        0.428040   0.900543    0.019958  ...   0.039000   \n",
       "bAvgSegmentSize           0.342137   0.895560   -0.096229  ...   0.018527   \n",
       "min_active                0.001318   0.033057   -0.044135  ...   0.999746   \n",
       "mean_active               0.003287   0.035932   -0.043954  ...   0.999998   \n",
       "max_active                0.005583   0.039286   -0.043762  ...   0.999596   \n",
       "min_idle                  0.001028   0.032544   -0.044117  ...   0.999743   \n",
       "mean_idle                 0.002983   0.035413   -0.043962  ...   1.000000   \n",
       "max_idle                  0.005244   0.038732   -0.043786  ...   0.999601   \n",
       "Init_Win_bytes_forward    0.409109   0.586742   -0.075007  ...   0.023865   \n",
       "Init_Win_bytes_backward   0.429893   0.593143   -0.030004  ...   0.026959   \n",
       "min_seg_size_forward     -0.074763   0.217989   -0.524024  ...   0.077943   \n",
       "calss                    -0.040019   0.073212   -0.211892  ...   0.066348   \n",
       "\n",
       "                         max_idle  std_idle    FFNEPD  Init_Win_bytes_forward  \\\n",
       "duration                 0.999458  0.047582  0.016532                0.027610   \n",
       "max_bpktl                0.038732  0.127548 -0.044916                0.586742   \n",
       "mean_bpktl               0.021519  0.114949 -0.045442                0.452735   \n",
       "std_fpktl                0.033978  0.096844 -0.020885                0.558249   \n",
       "std_bpktl                0.045450  0.113854 -0.033991                0.594790   \n",
       "total_fiat               0.943339  0.015254  0.020302               -0.011637   \n",
       "min_fiat                 0.842512 -0.005389  0.015316               -0.027350   \n",
       "max_fiat                 0.943971  0.012557  0.017756               -0.012317   \n",
       "mean_fiat                0.918797 -0.003523  0.016958               -0.025823   \n",
       "std_flowpktl             0.033100  0.120257 -0.035737                0.580266   \n",
       "min_flowiat              0.842493 -0.005388  0.015323               -0.027316   \n",
       "max_flowiat              1.000000  0.043309  0.013884                0.026609   \n",
       "mean_flowiat             0.950117 -0.002380  0.016349               -0.024163   \n",
       "flow_fin                 0.071654  0.017388  0.048678                0.238759   \n",
       "flow_syn                 0.018113  0.112752  0.012415                0.890695   \n",
       "flow_rst                -0.002685 -0.009004  0.028905               -0.067341   \n",
       "bVarianceDataBytes       0.041333  0.094613 -0.030463                0.516196   \n",
       "bAvgSegmentSize          0.021512  0.114916 -0.045430                0.452305   \n",
       "min_active               0.998771 -0.005581  0.012340                0.022190   \n",
       "mean_active              0.999603  0.016879  0.012854                0.024362   \n",
       "max_active               0.999998  0.043430  0.013858                0.027031   \n",
       "min_idle                 0.998762 -0.005776  0.012279                0.021657   \n",
       "mean_idle                0.999601  0.016744  0.012852                0.023865   \n",
       "max_idle                 1.000000  0.043323  0.013880                0.026525   \n",
       "Init_Win_bytes_forward   0.026525  0.095880 -0.021448                1.000000   \n",
       "Init_Win_bytes_backward  0.029512  0.097316 -0.052507                0.811204   \n",
       "min_seg_size_forward     0.079324  0.048803  0.052177                0.394743   \n",
       "calss                    0.066965  0.022790  0.018300                0.129425   \n",
       "\n",
       "                         Init_Win_bytes_backward  RRT_samples_clnt  \\\n",
       "duration                                0.029712          0.003785   \n",
       "max_bpktl                               0.593143          0.084280   \n",
       "mean_bpktl                              0.478823          0.150252   \n",
       "std_fpktl                               0.532900          0.000140   \n",
       "std_bpktl                               0.577954          0.012050   \n",
       "total_fiat                             -0.016421          0.001615   \n",
       "min_fiat                               -0.033944         -0.002037   \n",
       "max_fiat                               -0.016206         -0.000644   \n",
       "mean_fiat                              -0.032466         -0.002113   \n",
       "std_flowpktl                            0.586355          0.084725   \n",
       "min_flowiat                            -0.033903         -0.002033   \n",
       "max_flowiat                             0.029591          0.001566   \n",
       "mean_flowiat                           -0.030175         -0.002169   \n",
       "flow_fin                                0.204597          0.005338   \n",
       "flow_syn                                0.729790          0.042069   \n",
       "flow_rst                               -0.064202         -0.004112   \n",
       "bVarianceDataBytes                      0.507734          0.005591   \n",
       "bAvgSegmentSize                         0.478400          0.150270   \n",
       "min_active                              0.025199          0.001474   \n",
       "mean_active                             0.027367          0.001808   \n",
       "max_active                              0.029961          0.002520   \n",
       "min_idle                                0.024794          0.000605   \n",
       "mean_idle                               0.026959          0.000893   \n",
       "max_idle                                0.029512          0.001560   \n",
       "Init_Win_bytes_forward                  0.811204          0.046784   \n",
       "Init_Win_bytes_backward                 1.000000          0.056761   \n",
       "min_seg_size_forward                    0.333701          0.014299   \n",
       "calss                                   0.069405          0.019679   \n",
       "\n",
       "                         Act_data_pkt_forward  min_seg_size_forward     calss  \n",
       "duration                             0.004838              0.082955  0.067066  \n",
       "max_bpktl                            0.086278              0.217989  0.073212  \n",
       "mean_bpktl                           0.139172              0.122226  0.064753  \n",
       "std_fpktl                            0.010182              0.301237  0.123758  \n",
       "std_bpktl                            0.020335              0.276055  0.072953  \n",
       "total_fiat                           0.002190              0.065124  0.064770  \n",
       "min_fiat                            -0.001974              0.051853  0.074491  \n",
       "max_fiat                            -0.000418              0.061285  0.064875  \n",
       "mean_fiat                           -0.001968              0.055151  0.071397  \n",
       "std_flowpktl                         0.087764              0.219346  0.119375  \n",
       "min_flowiat                         -0.001971              0.051763  0.074452  \n",
       "max_flowiat                          0.002276              0.079417  0.066992  \n",
       "mean_flowiat                        -0.002048              0.056882  0.072549  \n",
       "flow_fin                             0.005479              0.551140  0.286175  \n",
       "flow_syn                             0.045747              0.370962  0.115044  \n",
       "flow_rst                            -0.004092              0.064160  0.058715  \n",
       "bVarianceDataBytes                   0.012739              0.231281  0.056086  \n",
       "bAvgSegmentSize                      0.139180              0.121997  0.064755  \n",
       "min_active                           0.002198              0.077047  0.066001  \n",
       "mean_active                          0.002582              0.078161  0.066552  \n",
       "max_active                           0.003264              0.079542  0.067178  \n",
       "min_idle                             0.001261              0.076794  0.065804  \n",
       "mean_idle                            0.001617              0.077943  0.066348  \n",
       "max_idle                             0.002269              0.079324  0.066965  \n",
       "Init_Win_bytes_forward               0.050220              0.394743  0.129425  \n",
       "Init_Win_bytes_backward              0.059242              0.333701  0.069405  \n",
       "min_seg_size_forward                 0.018229              1.000000  0.258352  \n",
       "calss                                0.018391              0.258352  1.000000  \n",
       "\n",
       "[28 rows x 80 columns]"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Se puede llegar a valorar quedarnos con aquellas que tienen mayor correlación\n",
    "corr_matrix[corr_matrix[\"calss\"] > 0.05]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 3. División del conjunto de datos"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Dividimos el conjunto de datos\n",
    "train_set, val_set, test_set = train_val_test_split(df)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [],
   "source": [
    "X_train, y_train = remove_labels(train_set, 'calss')\n",
    "X_val, y_val = remove_labels(val_set, 'calss')\n",
    "X_test, y_test = remove_labels(test_set, 'calss')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 4. Escalando el conjunto de datos"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Es importante comprender que los árboles de decisión son algoritmos que **no requieren demasiada preparación de los datos** concretamente, no requieren la realización de escalado o normalización. En este ejercicio se va a realizar escalado al conjunto de datos y se van a comparar los resultados con el conjunto de datos sin escalar. De esta forma se demuestra como aplicar preprocesamientos como el escalado puede incluso llegar a afectar al rendimiento del modelo."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [],
   "source": [
    "scaler = RobustScaler()\n",
    "X_train_scaled = scaler.fit_transform(X_train)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [],
   "source": [
    "X_test_scaled = scaler.transform(X_test)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [],
   "source": [
    "X_val_scaled = scaler.transform(X_val)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>duration</th>\n",
       "      <th>total_fpackets</th>\n",
       "      <th>total_bpackets</th>\n",
       "      <th>total_fpktl</th>\n",
       "      <th>total_bpktl</th>\n",
       "      <th>min_fpktl</th>\n",
       "      <th>min_bpktl</th>\n",
       "      <th>max_fpktl</th>\n",
       "      <th>max_bpktl</th>\n",
       "      <th>mean_fpktl</th>\n",
       "      <th>...</th>\n",
       "      <th>min_idle</th>\n",
       "      <th>mean_idle</th>\n",
       "      <th>max_idle</th>\n",
       "      <th>std_idle</th>\n",
       "      <th>FFNEPD</th>\n",
       "      <th>Init_Win_bytes_forward</th>\n",
       "      <th>Init_Win_bytes_backward</th>\n",
       "      <th>RRT_samples_clnt</th>\n",
       "      <th>Act_data_pkt_forward</th>\n",
       "      <th>min_seg_size_forward</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>508881</th>\n",
       "      <td>-0.013646</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>-0.310056</td>\n",
       "      <td>1.556886</td>\n",
       "      <td>0.375000</td>\n",
       "      <td>4.924528</td>\n",
       "      <td>-0.027100</td>\n",
       "      <td>2.250000</td>\n",
       "      <td>-0.032895</td>\n",
       "      <td>...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-0.286342</td>\n",
       "      <td>0.000011</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>208326</th>\n",
       "      <td>-0.013926</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.664804</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>6.607143</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.918699</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.115132</td>\n",
       "      <td>...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-0.286342</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>107213</th>\n",
       "      <td>-0.013926</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.703911</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>6.857143</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.956640</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.161184</td>\n",
       "      <td>...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-0.286342</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>466726</th>\n",
       "      <td>-0.000273</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>-0.363128</td>\n",
       "      <td>2.724551</td>\n",
       "      <td>0.035714</td>\n",
       "      <td>8.603774</td>\n",
       "      <td>-0.078591</td>\n",
       "      <td>3.931034</td>\n",
       "      <td>-0.095395</td>\n",
       "      <td>...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-0.286342</td>\n",
       "      <td>0.000011</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>230085</th>\n",
       "      <td>-0.013926</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.664804</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>6.607143</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.918699</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.115132</td>\n",
       "      <td>...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-0.286342</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>472961</th>\n",
       "      <td>34.421927</td>\n",
       "      <td>1.5</td>\n",
       "      <td>4.0</td>\n",
       "      <td>1.558659</td>\n",
       "      <td>3.868263</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>1.341463</td>\n",
       "      <td>4.163793</td>\n",
       "      <td>0.337171</td>\n",
       "      <td>...</td>\n",
       "      <td>59.657102</td>\n",
       "      <td>48.116772</td>\n",
       "      <td>47.580946</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>13.421042</td>\n",
       "      <td>12.657580</td>\n",
       "      <td>3.0</td>\n",
       "      <td>1.5</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>482372</th>\n",
       "      <td>-0.013805</td>\n",
       "      <td>0.5</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-0.136872</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>-0.050987</td>\n",
       "      <td>...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>-0.080736</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.5</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>619993</th>\n",
       "      <td>17.578734</td>\n",
       "      <td>0.5</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-0.050279</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.553571</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>30.549478</td>\n",
       "      <td>24.617883</td>\n",
       "      <td>24.365465</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.063376</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.5</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>65344</th>\n",
       "      <td>-0.013926</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.703911</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>6.857143</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.956640</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.161184</td>\n",
       "      <td>...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-0.286342</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46666</th>\n",
       "      <td>-0.013926</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.505587</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>5.589286</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.764228</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.927632</td>\n",
       "      <td>...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-0.286342</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>10 rows × 79 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "         duration  total_fpackets  total_bpackets  total_fpktl  total_bpktl  \\\n",
       "508881  -0.013646             0.0             1.0    -0.310056     1.556886   \n",
       "208326  -0.013926             0.0             0.0     0.664804     0.000000   \n",
       "107213  -0.013926             0.0             0.0     0.703911     0.000000   \n",
       "466726  -0.000273             0.0             1.0    -0.363128     2.724551   \n",
       "230085  -0.013926             0.0             0.0     0.664804     0.000000   \n",
       "472961  34.421927             1.5             4.0     1.558659     3.868263   \n",
       "482372  -0.013805             0.5             0.0    -0.136872     0.000000   \n",
       "619993  17.578734             0.5             0.0    -0.050279     0.000000   \n",
       "65344   -0.013926             0.0             0.0     0.703911     0.000000   \n",
       "46666   -0.013926             0.0             0.0     0.505587     0.000000   \n",
       "\n",
       "        min_fpktl  min_bpktl  max_fpktl  max_bpktl  mean_fpktl  ...  \\\n",
       "508881   0.375000   4.924528  -0.027100   2.250000   -0.032895  ...   \n",
       "208326   6.607143   0.000000   0.918699   0.000000    1.115132  ...   \n",
       "107213   6.857143   0.000000   0.956640   0.000000    1.161184  ...   \n",
       "466726   0.035714   8.603774  -0.078591   3.931034   -0.095395  ...   \n",
       "230085   6.607143   0.000000   0.918699   0.000000    1.115132  ...   \n",
       "472961   0.000000   1.000000   1.341463   4.163793    0.337171  ...   \n",
       "482372   0.000000   0.000000   0.000000   0.000000   -0.050987  ...   \n",
       "619993   0.553571   0.000000   0.000000   0.000000    0.000000  ...   \n",
       "65344    6.857143   0.000000   0.956640   0.000000    1.161184  ...   \n",
       "46666    5.589286   0.000000   0.764228   0.000000    0.927632  ...   \n",
       "\n",
       "         min_idle  mean_idle   max_idle  std_idle  FFNEPD  \\\n",
       "508881   0.000000   0.000000   0.000000       0.0     0.0   \n",
       "208326   0.000000   0.000000   0.000000       0.0     0.0   \n",
       "107213   0.000000   0.000000   0.000000       0.0     0.0   \n",
       "466726   0.000000   0.000000   0.000000       0.0     0.0   \n",
       "230085   0.000000   0.000000   0.000000       0.0     0.0   \n",
       "472961  59.657102  48.116772  47.580946       0.0     0.0   \n",
       "482372   0.000000   0.000000   0.000000       0.0     1.0   \n",
       "619993  30.549478  24.617883  24.365465       0.0     1.0   \n",
       "65344    0.000000   0.000000   0.000000       0.0     0.0   \n",
       "46666    0.000000   0.000000   0.000000       0.0     0.0   \n",
       "\n",
       "        Init_Win_bytes_forward  Init_Win_bytes_backward  RRT_samples_clnt  \\\n",
       "508881               -0.286342                 0.000011               0.0   \n",
       "208326               -0.286342                 0.000000               0.0   \n",
       "107213               -0.286342                 0.000000               0.0   \n",
       "466726               -0.286342                 0.000011               0.0   \n",
       "230085               -0.286342                 0.000000               0.0   \n",
       "472961               13.421042                12.657580               3.0   \n",
       "482372               -0.080736                 0.000000               0.0   \n",
       "619993                0.063376                 0.000000               0.0   \n",
       "65344                -0.286342                 0.000000               0.0   \n",
       "46666                -0.286342                 0.000000               0.0   \n",
       "\n",
       "        Act_data_pkt_forward  min_seg_size_forward  \n",
       "508881                   0.0                  -1.0  \n",
       "208326                   0.0                  -1.0  \n",
       "107213                   0.0                  -1.0  \n",
       "466726                   0.0                  -1.0  \n",
       "230085                   0.0                  -1.0  \n",
       "472961                   1.5                   0.0  \n",
       "482372                   0.5                   0.0  \n",
       "619993                   0.5                   0.0  \n",
       "65344                    0.0                  -1.0  \n",
       "46666                    0.0                  -1.0  \n",
       "\n",
       "[10 rows x 79 columns]"
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from pandas import DataFrame\n",
    "\n",
    "X_train_scaled = DataFrame(X_train_scaled, columns=X_train.columns, index=X_train.index)\n",
    "X_train_scaled.head(10)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>duration</th>\n",
       "      <th>total_fpackets</th>\n",
       "      <th>total_bpackets</th>\n",
       "      <th>total_fpktl</th>\n",
       "      <th>total_bpktl</th>\n",
       "      <th>min_fpktl</th>\n",
       "      <th>min_bpktl</th>\n",
       "      <th>max_fpktl</th>\n",
       "      <th>max_bpktl</th>\n",
       "      <th>mean_fpktl</th>\n",
       "      <th>...</th>\n",
       "      <th>min_idle</th>\n",
       "      <th>mean_idle</th>\n",
       "      <th>max_idle</th>\n",
       "      <th>std_idle</th>\n",
       "      <th>FFNEPD</th>\n",
       "      <th>Init_Win_bytes_forward</th>\n",
       "      <th>Init_Win_bytes_backward</th>\n",
       "      <th>RRT_samples_clnt</th>\n",
       "      <th>Act_data_pkt_forward</th>\n",
       "      <th>min_seg_size_forward</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>count</th>\n",
       "      <td>379173.000000</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>3.791730e+05</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>379173.000000</td>\n",
       "      <td>379173.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>mean</th>\n",
       "      <td>12.543409</td>\n",
       "      <td>2.927643</td>\n",
       "      <td>10.762678</td>\n",
       "      <td>1.947184</td>\n",
       "      <td>75.104138</td>\n",
       "      <td>1.600682</td>\n",
       "      <td>0.855241</td>\n",
       "      <td>0.491724</td>\n",
       "      <td>1.591823</td>\n",
       "      <td>0.303639</td>\n",
       "      <td>...</td>\n",
       "      <td>19.838596</td>\n",
       "      <td>16.279309</td>\n",
       "      <td>16.441899</td>\n",
       "      <td>4.686618e+05</td>\n",
       "      <td>0.362658</td>\n",
       "      <td>2.861506</td>\n",
       "      <td>3.435883</td>\n",
       "      <td>10.087709</td>\n",
       "      <td>2.924548</td>\n",
       "      <td>-0.376798</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>std</th>\n",
       "      <td>116.165117</td>\n",
       "      <td>92.319402</td>\n",
       "      <td>370.875546</td>\n",
       "      <td>185.549801</td>\n",
       "      <td>3071.968461</td>\n",
       "      <td>2.817301</td>\n",
       "      <td>1.676098</td>\n",
       "      <td>0.786500</td>\n",
       "      <td>3.210186</td>\n",
       "      <td>0.533388</td>\n",
       "      <td>...</td>\n",
       "      <td>201.477623</td>\n",
       "      <td>162.562856</td>\n",
       "      <td>160.822696</td>\n",
       "      <td>6.188642e+06</td>\n",
       "      <td>3.836035</td>\n",
       "      <td>5.577212</td>\n",
       "      <td>7.354164</td>\n",
       "      <td>369.660712</td>\n",
       "      <td>92.301146</td>\n",
       "      <td>0.466297</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>min</th>\n",
       "      <td>-0.013936</td>\n",
       "      <td>-0.500000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>-0.513966</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>-0.946429</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>-0.227642</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>-0.273026</td>\n",
       "      <td>...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>-0.286345</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>-0.500000</td>\n",
       "      <td>-1.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25%</th>\n",
       "      <td>-0.013926</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>-0.321229</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>-0.084011</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>-0.101974</td>\n",
       "      <td>...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>-0.286342</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>-1.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>50%</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75%</th>\n",
       "      <td>0.986074</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.678771</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.915989</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.898026</td>\n",
       "      <td>...</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.713658</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>max</th>\n",
       "      <td>25277.128872</td>\n",
       "      <td>24127.000000</td>\n",
       "      <td>74768.000000</td>\n",
       "      <td>113118.041899</td>\n",
       "      <td>622288.473054</td>\n",
       "      <td>23.892857</td>\n",
       "      <td>26.245283</td>\n",
       "      <td>3.840108</td>\n",
       "      <td>11.991379</td>\n",
       "      <td>4.299342</td>\n",
       "      <td>...</td>\n",
       "      <td>43893.471528</td>\n",
       "      <td>35408.189283</td>\n",
       "      <td>35008.286082</td>\n",
       "      <td>5.670000e+08</td>\n",
       "      <td>2267.000000</td>\n",
       "      <td>13.421042</td>\n",
       "      <td>46.346741</td>\n",
       "      <td>74524.000000</td>\n",
       "      <td>24127.000000</td>\n",
       "      <td>0.375000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>8 rows × 79 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "            duration  total_fpackets  total_bpackets    total_fpktl  \\\n",
       "count  379173.000000   379173.000000   379173.000000  379173.000000   \n",
       "mean       12.543409        2.927643       10.762678       1.947184   \n",
       "std       116.165117       92.319402      370.875546     185.549801   \n",
       "min        -0.013936       -0.500000        0.000000      -0.513966   \n",
       "25%        -0.013926        0.000000        0.000000      -0.321229   \n",
       "50%         0.000000        0.000000        0.000000       0.000000   \n",
       "75%         0.986074        1.000000        1.000000       0.678771   \n",
       "max     25277.128872    24127.000000    74768.000000  113118.041899   \n",
       "\n",
       "         total_bpktl      min_fpktl      min_bpktl      max_fpktl  \\\n",
       "count  379173.000000  379173.000000  379173.000000  379173.000000   \n",
       "mean       75.104138       1.600682       0.855241       0.491724   \n",
       "std      3071.968461       2.817301       1.676098       0.786500   \n",
       "min         0.000000      -0.946429       0.000000      -0.227642   \n",
       "25%         0.000000       0.000000       0.000000      -0.084011   \n",
       "50%         0.000000       0.000000       0.000000       0.000000   \n",
       "75%         1.000000       1.000000       1.000000       0.915989   \n",
       "max    622288.473054      23.892857      26.245283       3.840108   \n",
       "\n",
       "           max_bpktl     mean_fpktl  ...       min_idle      mean_idle  \\\n",
       "count  379173.000000  379173.000000  ...  379173.000000  379173.000000   \n",
       "mean        1.591823       0.303639  ...      19.838596      16.279309   \n",
       "std         3.210186       0.533388  ...     201.477623     162.562856   \n",
       "min         0.000000      -0.273026  ...       0.000000       0.000000   \n",
       "25%         0.000000      -0.101974  ...       0.000000       0.000000   \n",
       "50%         0.000000       0.000000  ...       0.000000       0.000000   \n",
       "75%         1.000000       0.898026  ...       1.000000       1.000000   \n",
       "max        11.991379       4.299342  ...   43893.471528   35408.189283   \n",
       "\n",
       "            max_idle      std_idle         FFNEPD  Init_Win_bytes_forward  \\\n",
       "count  379173.000000  3.791730e+05  379173.000000           379173.000000   \n",
       "mean       16.441899  4.686618e+05       0.362658                2.861506   \n",
       "std       160.822696  6.188642e+06       3.836035                5.577212   \n",
       "min         0.000000  0.000000e+00       0.000000               -0.286345   \n",
       "25%         0.000000  0.000000e+00       0.000000               -0.286342   \n",
       "50%         0.000000  0.000000e+00       0.000000                0.000000   \n",
       "75%         1.000000  0.000000e+00       0.000000                0.713658   \n",
       "max     35008.286082  5.670000e+08    2267.000000               13.421042   \n",
       "\n",
       "       Init_Win_bytes_backward  RRT_samples_clnt  Act_data_pkt_forward  \\\n",
       "count            379173.000000     379173.000000         379173.000000   \n",
       "mean                  3.435883         10.087709              2.924548   \n",
       "std                   7.354164        369.660712             92.301146   \n",
       "min                   0.000000          0.000000             -0.500000   \n",
       "25%                   0.000000          0.000000              0.000000   \n",
       "50%                   0.000000          0.000000              0.000000   \n",
       "75%                   1.000000          1.000000              1.000000   \n",
       "max                  46.346741      74524.000000          24127.000000   \n",
       "\n",
       "       min_seg_size_forward  \n",
       "count         379173.000000  \n",
       "mean              -0.376798  \n",
       "std                0.466297  \n",
       "min               -1.000000  \n",
       "25%               -1.000000  \n",
       "50%                0.000000  \n",
       "75%                0.000000  \n",
       "max                0.375000  \n",
       "\n",
       "[8 rows x 79 columns]"
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "X_train_scaled.describe()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 5. Decision Forest"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style>#sk-container-id-1 {\n",
       "  /* Definition of color scheme common for light and dark mode */\n",
       "  --sklearn-color-text: black;\n",
       "  --sklearn-color-line: gray;\n",
       "  /* Definition of color scheme for unfitted estimators */\n",
       "  --sklearn-color-unfitted-level-0: #fff5e6;\n",
       "  --sklearn-color-unfitted-level-1: #f6e4d2;\n",
       "  --sklearn-color-unfitted-level-2: #ffe0b3;\n",
       "  --sklearn-color-unfitted-level-3: chocolate;\n",
       "  /* Definition of color scheme for fitted estimators */\n",
       "  --sklearn-color-fitted-level-0: #f0f8ff;\n",
       "  --sklearn-color-fitted-level-1: #d4ebff;\n",
       "  --sklearn-color-fitted-level-2: #b3dbfd;\n",
       "  --sklearn-color-fitted-level-3: cornflowerblue;\n",
       "\n",
       "  /* Specific color for light theme */\n",
       "  --sklearn-color-text-on-default-background: var(--sg-text-color, var(--theme-code-foreground, var(--jp-content-font-color1, black)));\n",
       "  --sklearn-color-background: var(--sg-background-color, var(--theme-background, var(--jp-layout-color0, white)));\n",
       "  --sklearn-color-border-box: var(--sg-text-color, var(--theme-code-foreground, var(--jp-content-font-color1, black)));\n",
       "  --sklearn-color-icon: #696969;\n",
       "\n",
       "  @media (prefers-color-scheme: dark) {\n",
       "    /* Redefinition of color scheme for dark theme */\n",
       "    --sklearn-color-text-on-default-background: var(--sg-text-color, var(--theme-code-foreground, var(--jp-content-font-color1, white)));\n",
       "    --sklearn-color-background: var(--sg-background-color, var(--theme-background, var(--jp-layout-color0, #111)));\n",
       "    --sklearn-color-border-box: var(--sg-text-color, var(--theme-code-foreground, var(--jp-content-font-color1, white)));\n",
       "    --sklearn-color-icon: #878787;\n",
       "  }\n",
       "}\n",
       "\n",
       "#sk-container-id-1 {\n",
       "  color: var(--sklearn-color-text);\n",
       "}\n",
       "\n",
       "#sk-container-id-1 pre {\n",
       "  padding: 0;\n",
       "}\n",
       "\n",
       "#sk-container-id-1 input.sk-hidden--visually {\n",
       "  border: 0;\n",
       "  clip: rect(1px 1px 1px 1px);\n",
       "  clip: rect(1px, 1px, 1px, 1px);\n",
       "  height: 1px;\n",
       "  margin: -1px;\n",
       "  overflow: hidden;\n",
       "  padding: 0;\n",
       "  position: absolute;\n",
       "  width: 1px;\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-dashed-wrapped {\n",
       "  border: 1px dashed var(--sklearn-color-line);\n",
       "  margin: 0 0.4em 0.5em 0.4em;\n",
       "  box-sizing: border-box;\n",
       "  padding-bottom: 0.4em;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-container {\n",
       "  /* jupyter's `normalize.less` sets `[hidden] { display: none; }`\n",
       "     but bootstrap.min.css set `[hidden] { display: none !important; }`\n",
       "     so we also need the `!important` here to be able to override the\n",
       "     default hidden behavior on the sphinx rendered scikit-learn.org.\n",
       "     See: https://github.com/scikit-learn/scikit-learn/issues/21755 */\n",
       "  display: inline-block !important;\n",
       "  position: relative;\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-text-repr-fallback {\n",
       "  display: none;\n",
       "}\n",
       "\n",
       "div.sk-parallel-item,\n",
       "div.sk-serial,\n",
       "div.sk-item {\n",
       "  /* draw centered vertical line to link estimators */\n",
       "  background-image: linear-gradient(var(--sklearn-color-text-on-default-background), var(--sklearn-color-text-on-default-background));\n",
       "  background-size: 2px 100%;\n",
       "  background-repeat: no-repeat;\n",
       "  background-position: center center;\n",
       "}\n",
       "\n",
       "/* Parallel-specific style estimator block */\n",
       "\n",
       "#sk-container-id-1 div.sk-parallel-item::after {\n",
       "  content: \"\";\n",
       "  width: 100%;\n",
       "  border-bottom: 2px solid var(--sklearn-color-text-on-default-background);\n",
       "  flex-grow: 1;\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-parallel {\n",
       "  display: flex;\n",
       "  align-items: stretch;\n",
       "  justify-content: center;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "  position: relative;\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-parallel-item {\n",
       "  display: flex;\n",
       "  flex-direction: column;\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-parallel-item:first-child::after {\n",
       "  align-self: flex-end;\n",
       "  width: 50%;\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-parallel-item:last-child::after {\n",
       "  align-self: flex-start;\n",
       "  width: 50%;\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-parallel-item:only-child::after {\n",
       "  width: 0;\n",
       "}\n",
       "\n",
       "/* Serial-specific style estimator block */\n",
       "\n",
       "#sk-container-id-1 div.sk-serial {\n",
       "  display: flex;\n",
       "  flex-direction: column;\n",
       "  align-items: center;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "  padding-right: 1em;\n",
       "  padding-left: 1em;\n",
       "}\n",
       "\n",
       "\n",
       "/* Toggleable style: style used for estimator/Pipeline/ColumnTransformer box that is\n",
       "clickable and can be expanded/collapsed.\n",
       "- Pipeline and ColumnTransformer use this feature and define the default style\n",
       "- Estimators will overwrite some part of the style using the `sk-estimator` class\n",
       "*/\n",
       "\n",
       "/* Pipeline and ColumnTransformer style (default) */\n",
       "\n",
       "#sk-container-id-1 div.sk-toggleable {\n",
       "  /* Default theme specific background. It is overwritten whether we have a\n",
       "  specific estimator or a Pipeline/ColumnTransformer */\n",
       "  background-color: var(--sklearn-color-background);\n",
       "}\n",
       "\n",
       "/* Toggleable label */\n",
       "#sk-container-id-1 label.sk-toggleable__label {\n",
       "  cursor: pointer;\n",
       "  display: block;\n",
       "  width: 100%;\n",
       "  margin-bottom: 0;\n",
       "  padding: 0.5em;\n",
       "  box-sizing: border-box;\n",
       "  text-align: center;\n",
       "}\n",
       "\n",
       "#sk-container-id-1 label.sk-toggleable__label-arrow:before {\n",
       "  /* Arrow on the left of the label */\n",
       "  content: \"▸\";\n",
       "  float: left;\n",
       "  margin-right: 0.25em;\n",
       "  color: var(--sklearn-color-icon);\n",
       "}\n",
       "\n",
       "#sk-container-id-1 label.sk-toggleable__label-arrow:hover:before {\n",
       "  color: var(--sklearn-color-text);\n",
       "}\n",
       "\n",
       "/* Toggleable content - dropdown */\n",
       "\n",
       "#sk-container-id-1 div.sk-toggleable__content {\n",
       "  max-height: 0;\n",
       "  max-width: 0;\n",
       "  overflow: hidden;\n",
       "  text-align: left;\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-toggleable__content.fitted {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-toggleable__content pre {\n",
       "  margin: 0.2em;\n",
       "  border-radius: 0.25em;\n",
       "  color: var(--sklearn-color-text);\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-toggleable__content.fitted pre {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-1 input.sk-toggleable__control:checked~div.sk-toggleable__content {\n",
       "  /* Expand drop-down */\n",
       "  max-height: 200px;\n",
       "  max-width: 100%;\n",
       "  overflow: auto;\n",
       "}\n",
       "\n",
       "#sk-container-id-1 input.sk-toggleable__control:checked~label.sk-toggleable__label-arrow:before {\n",
       "  content: \"▾\";\n",
       "}\n",
       "\n",
       "/* Pipeline/ColumnTransformer-specific style */\n",
       "\n",
       "#sk-container-id-1 div.sk-label input.sk-toggleable__control:checked~label.sk-toggleable__label {\n",
       "  color: var(--sklearn-color-text);\n",
       "  background-color: var(--sklearn-color-unfitted-level-2);\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-label.fitted input.sk-toggleable__control:checked~label.sk-toggleable__label {\n",
       "  background-color: var(--sklearn-color-fitted-level-2);\n",
       "}\n",
       "\n",
       "/* Estimator-specific style */\n",
       "\n",
       "/* Colorize estimator box */\n",
       "#sk-container-id-1 div.sk-estimator input.sk-toggleable__control:checked~label.sk-toggleable__label {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-2);\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-estimator.fitted input.sk-toggleable__control:checked~label.sk-toggleable__label {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-2);\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-label label.sk-toggleable__label,\n",
       "#sk-container-id-1 div.sk-label label {\n",
       "  /* The background is the default theme color */\n",
       "  color: var(--sklearn-color-text-on-default-background);\n",
       "}\n",
       "\n",
       "/* On hover, darken the color of the background */\n",
       "#sk-container-id-1 div.sk-label:hover label.sk-toggleable__label {\n",
       "  color: var(--sklearn-color-text);\n",
       "  background-color: var(--sklearn-color-unfitted-level-2);\n",
       "}\n",
       "\n",
       "/* Label box, darken color on hover, fitted */\n",
       "#sk-container-id-1 div.sk-label.fitted:hover label.sk-toggleable__label.fitted {\n",
       "  color: var(--sklearn-color-text);\n",
       "  background-color: var(--sklearn-color-fitted-level-2);\n",
       "}\n",
       "\n",
       "/* Estimator label */\n",
       "\n",
       "#sk-container-id-1 div.sk-label label {\n",
       "  font-family: monospace;\n",
       "  font-weight: bold;\n",
       "  display: inline-block;\n",
       "  line-height: 1.2em;\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-label-container {\n",
       "  text-align: center;\n",
       "}\n",
       "\n",
       "/* Estimator-specific */\n",
       "#sk-container-id-1 div.sk-estimator {\n",
       "  font-family: monospace;\n",
       "  border: 1px dotted var(--sklearn-color-border-box);\n",
       "  border-radius: 0.25em;\n",
       "  box-sizing: border-box;\n",
       "  margin-bottom: 0.5em;\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-estimator.fitted {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-0);\n",
       "}\n",
       "\n",
       "/* on hover */\n",
       "#sk-container-id-1 div.sk-estimator:hover {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-2);\n",
       "}\n",
       "\n",
       "#sk-container-id-1 div.sk-estimator.fitted:hover {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-2);\n",
       "}\n",
       "\n",
       "/* Specification for estimator info (e.g. \"i\" and \"?\") */\n",
       "\n",
       "/* Common style for \"i\" and \"?\" */\n",
       "\n",
       ".sk-estimator-doc-link,\n",
       "a:link.sk-estimator-doc-link,\n",
       "a:visited.sk-estimator-doc-link {\n",
       "  float: right;\n",
       "  font-size: smaller;\n",
       "  line-height: 1em;\n",
       "  font-family: monospace;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "  border-radius: 1em;\n",
       "  height: 1em;\n",
       "  width: 1em;\n",
       "  text-decoration: none !important;\n",
       "  margin-left: 1ex;\n",
       "  /* unfitted */\n",
       "  border: var(--sklearn-color-unfitted-level-1) 1pt solid;\n",
       "  color: var(--sklearn-color-unfitted-level-1);\n",
       "}\n",
       "\n",
       ".sk-estimator-doc-link.fitted,\n",
       "a:link.sk-estimator-doc-link.fitted,\n",
       "a:visited.sk-estimator-doc-link.fitted {\n",
       "  /* fitted */\n",
       "  border: var(--sklearn-color-fitted-level-1) 1pt solid;\n",
       "  color: var(--sklearn-color-fitted-level-1);\n",
       "}\n",
       "\n",
       "/* On hover */\n",
       "div.sk-estimator:hover .sk-estimator-doc-link:hover,\n",
       ".sk-estimator-doc-link:hover,\n",
       "div.sk-label-container:hover .sk-estimator-doc-link:hover,\n",
       ".sk-estimator-doc-link:hover {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-3);\n",
       "  color: var(--sklearn-color-background);\n",
       "  text-decoration: none;\n",
       "}\n",
       "\n",
       "div.sk-estimator.fitted:hover .sk-estimator-doc-link.fitted:hover,\n",
       ".sk-estimator-doc-link.fitted:hover,\n",
       "div.sk-label-container:hover .sk-estimator-doc-link.fitted:hover,\n",
       ".sk-estimator-doc-link.fitted:hover {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-3);\n",
       "  color: var(--sklearn-color-background);\n",
       "  text-decoration: none;\n",
       "}\n",
       "\n",
       "/* Span, style for the box shown on hovering the info icon */\n",
       ".sk-estimator-doc-link span {\n",
       "  display: none;\n",
       "  z-index: 9999;\n",
       "  position: relative;\n",
       "  font-weight: normal;\n",
       "  right: .2ex;\n",
       "  padding: .5ex;\n",
       "  margin: .5ex;\n",
       "  width: min-content;\n",
       "  min-width: 20ex;\n",
       "  max-width: 50ex;\n",
       "  color: var(--sklearn-color-text);\n",
       "  box-shadow: 2pt 2pt 4pt #999;\n",
       "  /* unfitted */\n",
       "  background: var(--sklearn-color-unfitted-level-0);\n",
       "  border: .5pt solid var(--sklearn-color-unfitted-level-3);\n",
       "}\n",
       "\n",
       ".sk-estimator-doc-link.fitted span {\n",
       "  /* fitted */\n",
       "  background: var(--sklearn-color-fitted-level-0);\n",
       "  border: var(--sklearn-color-fitted-level-3);\n",
       "}\n",
       "\n",
       ".sk-estimator-doc-link:hover span {\n",
       "  display: block;\n",
       "}\n",
       "\n",
       "/* \"?\"-specific style due to the `<a>` HTML tag */\n",
       "\n",
       "#sk-container-id-1 a.estimator_doc_link {\n",
       "  float: right;\n",
       "  font-size: 1rem;\n",
       "  line-height: 1em;\n",
       "  font-family: monospace;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "  border-radius: 1rem;\n",
       "  height: 1rem;\n",
       "  width: 1rem;\n",
       "  text-decoration: none;\n",
       "  /* unfitted */\n",
       "  color: var(--sklearn-color-unfitted-level-1);\n",
       "  border: var(--sklearn-color-unfitted-level-1) 1pt solid;\n",
       "}\n",
       "\n",
       "#sk-container-id-1 a.estimator_doc_link.fitted {\n",
       "  /* fitted */\n",
       "  border: var(--sklearn-color-fitted-level-1) 1pt solid;\n",
       "  color: var(--sklearn-color-fitted-level-1);\n",
       "}\n",
       "\n",
       "/* On hover */\n",
       "#sk-container-id-1 a.estimator_doc_link:hover {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-3);\n",
       "  color: var(--sklearn-color-background);\n",
       "  text-decoration: none;\n",
       "}\n",
       "\n",
       "#sk-container-id-1 a.estimator_doc_link.fitted:hover {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-3);\n",
       "}\n",
       "</style><div id=\"sk-container-id-1\" class=\"sk-top-container\"><div class=\"sk-text-repr-fallback\"><pre>DecisionTreeClassifier(random_state=42)</pre><b>In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook. <br />On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.</b></div><div class=\"sk-container\" hidden><div class=\"sk-item\"><div class=\"sk-estimator fitted sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-1\" type=\"checkbox\" checked><label for=\"sk-estimator-id-1\" class=\"sk-toggleable__label fitted sk-toggleable__label-arrow fitted\">&nbsp;&nbsp;DecisionTreeClassifier<a class=\"sk-estimator-doc-link fitted\" rel=\"noreferrer\" target=\"_blank\" href=\"https://scikit-learn.org/1.4/modules/generated/sklearn.tree.DecisionTreeClassifier.html\">?<span>Documentation for DecisionTreeClassifier</span></a><span class=\"sk-estimator-doc-link fitted\">i<span>Fitted</span></span></label><div class=\"sk-toggleable__content fitted\"><pre>DecisionTreeClassifier(random_state=42)</pre></div> </div></div></div></div>"
      ],
      "text/plain": [
       "DecisionTreeClassifier(random_state=42)"
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Modelo entrenado con el conjunto de datos sin escalar\n",
    "from sklearn.tree import DecisionTreeClassifier\n",
    "\n",
    "clf_tree = DecisionTreeClassifier(random_state=42)\n",
    "clf_tree.fit(X_train, y_train)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Predecimos con el conjunto de datos de entrenamiento\n",
    "y_train_pred = clf_tree.predict(X_train)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "F1 Score Train Set: 0.9812432382517775\n"
     ]
    }
   ],
   "source": [
    "print(\"F1 Score Train Set:\", f1_score(y_train_pred, y_train, average='weighted'))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Predecimos con el conjunto de datos de validación\n",
    "y_val_pred = clf_tree.predict(X_val)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "F1 Score Validation Set: 0.9304198818652374\n"
     ]
    }
   ],
   "source": [
    "print(\"F1 Score Validation Set:\", f1_score(y_val_pred, y_val, average='weighted'))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 6. Random Forests"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style>#sk-container-id-2 {\n",
       "  /* Definition of color scheme common for light and dark mode */\n",
       "  --sklearn-color-text: black;\n",
       "  --sklearn-color-line: gray;\n",
       "  /* Definition of color scheme for unfitted estimators */\n",
       "  --sklearn-color-unfitted-level-0: #fff5e6;\n",
       "  --sklearn-color-unfitted-level-1: #f6e4d2;\n",
       "  --sklearn-color-unfitted-level-2: #ffe0b3;\n",
       "  --sklearn-color-unfitted-level-3: chocolate;\n",
       "  /* Definition of color scheme for fitted estimators */\n",
       "  --sklearn-color-fitted-level-0: #f0f8ff;\n",
       "  --sklearn-color-fitted-level-1: #d4ebff;\n",
       "  --sklearn-color-fitted-level-2: #b3dbfd;\n",
       "  --sklearn-color-fitted-level-3: cornflowerblue;\n",
       "\n",
       "  /* Specific color for light theme */\n",
       "  --sklearn-color-text-on-default-background: var(--sg-text-color, var(--theme-code-foreground, var(--jp-content-font-color1, black)));\n",
       "  --sklearn-color-background: var(--sg-background-color, var(--theme-background, var(--jp-layout-color0, white)));\n",
       "  --sklearn-color-border-box: var(--sg-text-color, var(--theme-code-foreground, var(--jp-content-font-color1, black)));\n",
       "  --sklearn-color-icon: #696969;\n",
       "\n",
       "  @media (prefers-color-scheme: dark) {\n",
       "    /* Redefinition of color scheme for dark theme */\n",
       "    --sklearn-color-text-on-default-background: var(--sg-text-color, var(--theme-code-foreground, var(--jp-content-font-color1, white)));\n",
       "    --sklearn-color-background: var(--sg-background-color, var(--theme-background, var(--jp-layout-color0, #111)));\n",
       "    --sklearn-color-border-box: var(--sg-text-color, var(--theme-code-foreground, var(--jp-content-font-color1, white)));\n",
       "    --sklearn-color-icon: #878787;\n",
       "  }\n",
       "}\n",
       "\n",
       "#sk-container-id-2 {\n",
       "  color: var(--sklearn-color-text);\n",
       "}\n",
       "\n",
       "#sk-container-id-2 pre {\n",
       "  padding: 0;\n",
       "}\n",
       "\n",
       "#sk-container-id-2 input.sk-hidden--visually {\n",
       "  border: 0;\n",
       "  clip: rect(1px 1px 1px 1px);\n",
       "  clip: rect(1px, 1px, 1px, 1px);\n",
       "  height: 1px;\n",
       "  margin: -1px;\n",
       "  overflow: hidden;\n",
       "  padding: 0;\n",
       "  position: absolute;\n",
       "  width: 1px;\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-dashed-wrapped {\n",
       "  border: 1px dashed var(--sklearn-color-line);\n",
       "  margin: 0 0.4em 0.5em 0.4em;\n",
       "  box-sizing: border-box;\n",
       "  padding-bottom: 0.4em;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-container {\n",
       "  /* jupyter's `normalize.less` sets `[hidden] { display: none; }`\n",
       "     but bootstrap.min.css set `[hidden] { display: none !important; }`\n",
       "     so we also need the `!important` here to be able to override the\n",
       "     default hidden behavior on the sphinx rendered scikit-learn.org.\n",
       "     See: https://github.com/scikit-learn/scikit-learn/issues/21755 */\n",
       "  display: inline-block !important;\n",
       "  position: relative;\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-text-repr-fallback {\n",
       "  display: none;\n",
       "}\n",
       "\n",
       "div.sk-parallel-item,\n",
       "div.sk-serial,\n",
       "div.sk-item {\n",
       "  /* draw centered vertical line to link estimators */\n",
       "  background-image: linear-gradient(var(--sklearn-color-text-on-default-background), var(--sklearn-color-text-on-default-background));\n",
       "  background-size: 2px 100%;\n",
       "  background-repeat: no-repeat;\n",
       "  background-position: center center;\n",
       "}\n",
       "\n",
       "/* Parallel-specific style estimator block */\n",
       "\n",
       "#sk-container-id-2 div.sk-parallel-item::after {\n",
       "  content: \"\";\n",
       "  width: 100%;\n",
       "  border-bottom: 2px solid var(--sklearn-color-text-on-default-background);\n",
       "  flex-grow: 1;\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-parallel {\n",
       "  display: flex;\n",
       "  align-items: stretch;\n",
       "  justify-content: center;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "  position: relative;\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-parallel-item {\n",
       "  display: flex;\n",
       "  flex-direction: column;\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-parallel-item:first-child::after {\n",
       "  align-self: flex-end;\n",
       "  width: 50%;\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-parallel-item:last-child::after {\n",
       "  align-self: flex-start;\n",
       "  width: 50%;\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-parallel-item:only-child::after {\n",
       "  width: 0;\n",
       "}\n",
       "\n",
       "/* Serial-specific style estimator block */\n",
       "\n",
       "#sk-container-id-2 div.sk-serial {\n",
       "  display: flex;\n",
       "  flex-direction: column;\n",
       "  align-items: center;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "  padding-right: 1em;\n",
       "  padding-left: 1em;\n",
       "}\n",
       "\n",
       "\n",
       "/* Toggleable style: style used for estimator/Pipeline/ColumnTransformer box that is\n",
       "clickable and can be expanded/collapsed.\n",
       "- Pipeline and ColumnTransformer use this feature and define the default style\n",
       "- Estimators will overwrite some part of the style using the `sk-estimator` class\n",
       "*/\n",
       "\n",
       "/* Pipeline and ColumnTransformer style (default) */\n",
       "\n",
       "#sk-container-id-2 div.sk-toggleable {\n",
       "  /* Default theme specific background. It is overwritten whether we have a\n",
       "  specific estimator or a Pipeline/ColumnTransformer */\n",
       "  background-color: var(--sklearn-color-background);\n",
       "}\n",
       "\n",
       "/* Toggleable label */\n",
       "#sk-container-id-2 label.sk-toggleable__label {\n",
       "  cursor: pointer;\n",
       "  display: block;\n",
       "  width: 100%;\n",
       "  margin-bottom: 0;\n",
       "  padding: 0.5em;\n",
       "  box-sizing: border-box;\n",
       "  text-align: center;\n",
       "}\n",
       "\n",
       "#sk-container-id-2 label.sk-toggleable__label-arrow:before {\n",
       "  /* Arrow on the left of the label */\n",
       "  content: \"▸\";\n",
       "  float: left;\n",
       "  margin-right: 0.25em;\n",
       "  color: var(--sklearn-color-icon);\n",
       "}\n",
       "\n",
       "#sk-container-id-2 label.sk-toggleable__label-arrow:hover:before {\n",
       "  color: var(--sklearn-color-text);\n",
       "}\n",
       "\n",
       "/* Toggleable content - dropdown */\n",
       "\n",
       "#sk-container-id-2 div.sk-toggleable__content {\n",
       "  max-height: 0;\n",
       "  max-width: 0;\n",
       "  overflow: hidden;\n",
       "  text-align: left;\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-toggleable__content.fitted {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-toggleable__content pre {\n",
       "  margin: 0.2em;\n",
       "  border-radius: 0.25em;\n",
       "  color: var(--sklearn-color-text);\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-toggleable__content.fitted pre {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-2 input.sk-toggleable__control:checked~div.sk-toggleable__content {\n",
       "  /* Expand drop-down */\n",
       "  max-height: 200px;\n",
       "  max-width: 100%;\n",
       "  overflow: auto;\n",
       "}\n",
       "\n",
       "#sk-container-id-2 input.sk-toggleable__control:checked~label.sk-toggleable__label-arrow:before {\n",
       "  content: \"▾\";\n",
       "}\n",
       "\n",
       "/* Pipeline/ColumnTransformer-specific style */\n",
       "\n",
       "#sk-container-id-2 div.sk-label input.sk-toggleable__control:checked~label.sk-toggleable__label {\n",
       "  color: var(--sklearn-color-text);\n",
       "  background-color: var(--sklearn-color-unfitted-level-2);\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-label.fitted input.sk-toggleable__control:checked~label.sk-toggleable__label {\n",
       "  background-color: var(--sklearn-color-fitted-level-2);\n",
       "}\n",
       "\n",
       "/* Estimator-specific style */\n",
       "\n",
       "/* Colorize estimator box */\n",
       "#sk-container-id-2 div.sk-estimator input.sk-toggleable__control:checked~label.sk-toggleable__label {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-2);\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-estimator.fitted input.sk-toggleable__control:checked~label.sk-toggleable__label {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-2);\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-label label.sk-toggleable__label,\n",
       "#sk-container-id-2 div.sk-label label {\n",
       "  /* The background is the default theme color */\n",
       "  color: var(--sklearn-color-text-on-default-background);\n",
       "}\n",
       "\n",
       "/* On hover, darken the color of the background */\n",
       "#sk-container-id-2 div.sk-label:hover label.sk-toggleable__label {\n",
       "  color: var(--sklearn-color-text);\n",
       "  background-color: var(--sklearn-color-unfitted-level-2);\n",
       "}\n",
       "\n",
       "/* Label box, darken color on hover, fitted */\n",
       "#sk-container-id-2 div.sk-label.fitted:hover label.sk-toggleable__label.fitted {\n",
       "  color: var(--sklearn-color-text);\n",
       "  background-color: var(--sklearn-color-fitted-level-2);\n",
       "}\n",
       "\n",
       "/* Estimator label */\n",
       "\n",
       "#sk-container-id-2 div.sk-label label {\n",
       "  font-family: monospace;\n",
       "  font-weight: bold;\n",
       "  display: inline-block;\n",
       "  line-height: 1.2em;\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-label-container {\n",
       "  text-align: center;\n",
       "}\n",
       "\n",
       "/* Estimator-specific */\n",
       "#sk-container-id-2 div.sk-estimator {\n",
       "  font-family: monospace;\n",
       "  border: 1px dotted var(--sklearn-color-border-box);\n",
       "  border-radius: 0.25em;\n",
       "  box-sizing: border-box;\n",
       "  margin-bottom: 0.5em;\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-estimator.fitted {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-0);\n",
       "}\n",
       "\n",
       "/* on hover */\n",
       "#sk-container-id-2 div.sk-estimator:hover {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-2);\n",
       "}\n",
       "\n",
       "#sk-container-id-2 div.sk-estimator.fitted:hover {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-2);\n",
       "}\n",
       "\n",
       "/* Specification for estimator info (e.g. \"i\" and \"?\") */\n",
       "\n",
       "/* Common style for \"i\" and \"?\" */\n",
       "\n",
       ".sk-estimator-doc-link,\n",
       "a:link.sk-estimator-doc-link,\n",
       "a:visited.sk-estimator-doc-link {\n",
       "  float: right;\n",
       "  font-size: smaller;\n",
       "  line-height: 1em;\n",
       "  font-family: monospace;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "  border-radius: 1em;\n",
       "  height: 1em;\n",
       "  width: 1em;\n",
       "  text-decoration: none !important;\n",
       "  margin-left: 1ex;\n",
       "  /* unfitted */\n",
       "  border: var(--sklearn-color-unfitted-level-1) 1pt solid;\n",
       "  color: var(--sklearn-color-unfitted-level-1);\n",
       "}\n",
       "\n",
       ".sk-estimator-doc-link.fitted,\n",
       "a:link.sk-estimator-doc-link.fitted,\n",
       "a:visited.sk-estimator-doc-link.fitted {\n",
       "  /* fitted */\n",
       "  border: var(--sklearn-color-fitted-level-1) 1pt solid;\n",
       "  color: var(--sklearn-color-fitted-level-1);\n",
       "}\n",
       "\n",
       "/* On hover */\n",
       "div.sk-estimator:hover .sk-estimator-doc-link:hover,\n",
       ".sk-estimator-doc-link:hover,\n",
       "div.sk-label-container:hover .sk-estimator-doc-link:hover,\n",
       ".sk-estimator-doc-link:hover {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-3);\n",
       "  color: var(--sklearn-color-background);\n",
       "  text-decoration: none;\n",
       "}\n",
       "\n",
       "div.sk-estimator.fitted:hover .sk-estimator-doc-link.fitted:hover,\n",
       ".sk-estimator-doc-link.fitted:hover,\n",
       "div.sk-label-container:hover .sk-estimator-doc-link.fitted:hover,\n",
       ".sk-estimator-doc-link.fitted:hover {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-3);\n",
       "  color: var(--sklearn-color-background);\n",
       "  text-decoration: none;\n",
       "}\n",
       "\n",
       "/* Span, style for the box shown on hovering the info icon */\n",
       ".sk-estimator-doc-link span {\n",
       "  display: none;\n",
       "  z-index: 9999;\n",
       "  position: relative;\n",
       "  font-weight: normal;\n",
       "  right: .2ex;\n",
       "  padding: .5ex;\n",
       "  margin: .5ex;\n",
       "  width: min-content;\n",
       "  min-width: 20ex;\n",
       "  max-width: 50ex;\n",
       "  color: var(--sklearn-color-text);\n",
       "  box-shadow: 2pt 2pt 4pt #999;\n",
       "  /* unfitted */\n",
       "  background: var(--sklearn-color-unfitted-level-0);\n",
       "  border: .5pt solid var(--sklearn-color-unfitted-level-3);\n",
       "}\n",
       "\n",
       ".sk-estimator-doc-link.fitted span {\n",
       "  /* fitted */\n",
       "  background: var(--sklearn-color-fitted-level-0);\n",
       "  border: var(--sklearn-color-fitted-level-3);\n",
       "}\n",
       "\n",
       ".sk-estimator-doc-link:hover span {\n",
       "  display: block;\n",
       "}\n",
       "\n",
       "/* \"?\"-specific style due to the `<a>` HTML tag */\n",
       "\n",
       "#sk-container-id-2 a.estimator_doc_link {\n",
       "  float: right;\n",
       "  font-size: 1rem;\n",
       "  line-height: 1em;\n",
       "  font-family: monospace;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "  border-radius: 1rem;\n",
       "  height: 1rem;\n",
       "  width: 1rem;\n",
       "  text-decoration: none;\n",
       "  /* unfitted */\n",
       "  color: var(--sklearn-color-unfitted-level-1);\n",
       "  border: var(--sklearn-color-unfitted-level-1) 1pt solid;\n",
       "}\n",
       "\n",
       "#sk-container-id-2 a.estimator_doc_link.fitted {\n",
       "  /* fitted */\n",
       "  border: var(--sklearn-color-fitted-level-1) 1pt solid;\n",
       "  color: var(--sklearn-color-fitted-level-1);\n",
       "}\n",
       "\n",
       "/* On hover */\n",
       "#sk-container-id-2 a.estimator_doc_link:hover {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-3);\n",
       "  color: var(--sklearn-color-background);\n",
       "  text-decoration: none;\n",
       "}\n",
       "\n",
       "#sk-container-id-2 a.estimator_doc_link.fitted:hover {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-3);\n",
       "}\n",
       "</style><div id=\"sk-container-id-2\" class=\"sk-top-container\"><div class=\"sk-text-repr-fallback\"><pre>RandomForestClassifier(n_jobs=-1, random_state=42)</pre><b>In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook. <br />On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.</b></div><div class=\"sk-container\" hidden><div class=\"sk-item\"><div class=\"sk-estimator fitted sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-2\" type=\"checkbox\" checked><label for=\"sk-estimator-id-2\" class=\"sk-toggleable__label fitted sk-toggleable__label-arrow fitted\">&nbsp;&nbsp;RandomForestClassifier<a class=\"sk-estimator-doc-link fitted\" rel=\"noreferrer\" target=\"_blank\" href=\"https://scikit-learn.org/1.4/modules/generated/sklearn.ensemble.RandomForestClassifier.html\">?<span>Documentation for RandomForestClassifier</span></a><span class=\"sk-estimator-doc-link fitted\">i<span>Fitted</span></span></label><div class=\"sk-toggleable__content fitted\"><pre>RandomForestClassifier(n_jobs=-1, random_state=42)</pre></div> </div></div></div></div>"
      ],
      "text/plain": [
       "RandomForestClassifier(n_jobs=-1, random_state=42)"
      ]
     },
     "execution_count": 28,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from sklearn.ensemble import RandomForestClassifier\n",
    "\n",
    "# Modelo entrenado con el conjunto de datos sin escalar\n",
    "clf_rnd = RandomForestClassifier(n_estimators=100, random_state=42, n_jobs=-1)\n",
    "clf_rnd.fit(X_train, y_train)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style>#sk-container-id-3 {\n",
       "  /* Definition of color scheme common for light and dark mode */\n",
       "  --sklearn-color-text: black;\n",
       "  --sklearn-color-line: gray;\n",
       "  /* Definition of color scheme for unfitted estimators */\n",
       "  --sklearn-color-unfitted-level-0: #fff5e6;\n",
       "  --sklearn-color-unfitted-level-1: #f6e4d2;\n",
       "  --sklearn-color-unfitted-level-2: #ffe0b3;\n",
       "  --sklearn-color-unfitted-level-3: chocolate;\n",
       "  /* Definition of color scheme for fitted estimators */\n",
       "  --sklearn-color-fitted-level-0: #f0f8ff;\n",
       "  --sklearn-color-fitted-level-1: #d4ebff;\n",
       "  --sklearn-color-fitted-level-2: #b3dbfd;\n",
       "  --sklearn-color-fitted-level-3: cornflowerblue;\n",
       "\n",
       "  /* Specific color for light theme */\n",
       "  --sklearn-color-text-on-default-background: var(--sg-text-color, var(--theme-code-foreground, var(--jp-content-font-color1, black)));\n",
       "  --sklearn-color-background: var(--sg-background-color, var(--theme-background, var(--jp-layout-color0, white)));\n",
       "  --sklearn-color-border-box: var(--sg-text-color, var(--theme-code-foreground, var(--jp-content-font-color1, black)));\n",
       "  --sklearn-color-icon: #696969;\n",
       "\n",
       "  @media (prefers-color-scheme: dark) {\n",
       "    /* Redefinition of color scheme for dark theme */\n",
       "    --sklearn-color-text-on-default-background: var(--sg-text-color, var(--theme-code-foreground, var(--jp-content-font-color1, white)));\n",
       "    --sklearn-color-background: var(--sg-background-color, var(--theme-background, var(--jp-layout-color0, #111)));\n",
       "    --sklearn-color-border-box: var(--sg-text-color, var(--theme-code-foreground, var(--jp-content-font-color1, white)));\n",
       "    --sklearn-color-icon: #878787;\n",
       "  }\n",
       "}\n",
       "\n",
       "#sk-container-id-3 {\n",
       "  color: var(--sklearn-color-text);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 pre {\n",
       "  padding: 0;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 input.sk-hidden--visually {\n",
       "  border: 0;\n",
       "  clip: rect(1px 1px 1px 1px);\n",
       "  clip: rect(1px, 1px, 1px, 1px);\n",
       "  height: 1px;\n",
       "  margin: -1px;\n",
       "  overflow: hidden;\n",
       "  padding: 0;\n",
       "  position: absolute;\n",
       "  width: 1px;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-dashed-wrapped {\n",
       "  border: 1px dashed var(--sklearn-color-line);\n",
       "  margin: 0 0.4em 0.5em 0.4em;\n",
       "  box-sizing: border-box;\n",
       "  padding-bottom: 0.4em;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-container {\n",
       "  /* jupyter's `normalize.less` sets `[hidden] { display: none; }`\n",
       "     but bootstrap.min.css set `[hidden] { display: none !important; }`\n",
       "     so we also need the `!important` here to be able to override the\n",
       "     default hidden behavior on the sphinx rendered scikit-learn.org.\n",
       "     See: https://github.com/scikit-learn/scikit-learn/issues/21755 */\n",
       "  display: inline-block !important;\n",
       "  position: relative;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-text-repr-fallback {\n",
       "  display: none;\n",
       "}\n",
       "\n",
       "div.sk-parallel-item,\n",
       "div.sk-serial,\n",
       "div.sk-item {\n",
       "  /* draw centered vertical line to link estimators */\n",
       "  background-image: linear-gradient(var(--sklearn-color-text-on-default-background), var(--sklearn-color-text-on-default-background));\n",
       "  background-size: 2px 100%;\n",
       "  background-repeat: no-repeat;\n",
       "  background-position: center center;\n",
       "}\n",
       "\n",
       "/* Parallel-specific style estimator block */\n",
       "\n",
       "#sk-container-id-3 div.sk-parallel-item::after {\n",
       "  content: \"\";\n",
       "  width: 100%;\n",
       "  border-bottom: 2px solid var(--sklearn-color-text-on-default-background);\n",
       "  flex-grow: 1;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-parallel {\n",
       "  display: flex;\n",
       "  align-items: stretch;\n",
       "  justify-content: center;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "  position: relative;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-parallel-item {\n",
       "  display: flex;\n",
       "  flex-direction: column;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-parallel-item:first-child::after {\n",
       "  align-self: flex-end;\n",
       "  width: 50%;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-parallel-item:last-child::after {\n",
       "  align-self: flex-start;\n",
       "  width: 50%;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-parallel-item:only-child::after {\n",
       "  width: 0;\n",
       "}\n",
       "\n",
       "/* Serial-specific style estimator block */\n",
       "\n",
       "#sk-container-id-3 div.sk-serial {\n",
       "  display: flex;\n",
       "  flex-direction: column;\n",
       "  align-items: center;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "  padding-right: 1em;\n",
       "  padding-left: 1em;\n",
       "}\n",
       "\n",
       "\n",
       "/* Toggleable style: style used for estimator/Pipeline/ColumnTransformer box that is\n",
       "clickable and can be expanded/collapsed.\n",
       "- Pipeline and ColumnTransformer use this feature and define the default style\n",
       "- Estimators will overwrite some part of the style using the `sk-estimator` class\n",
       "*/\n",
       "\n",
       "/* Pipeline and ColumnTransformer style (default) */\n",
       "\n",
       "#sk-container-id-3 div.sk-toggleable {\n",
       "  /* Default theme specific background. It is overwritten whether we have a\n",
       "  specific estimator or a Pipeline/ColumnTransformer */\n",
       "  background-color: var(--sklearn-color-background);\n",
       "}\n",
       "\n",
       "/* Toggleable label */\n",
       "#sk-container-id-3 label.sk-toggleable__label {\n",
       "  cursor: pointer;\n",
       "  display: block;\n",
       "  width: 100%;\n",
       "  margin-bottom: 0;\n",
       "  padding: 0.5em;\n",
       "  box-sizing: border-box;\n",
       "  text-align: center;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 label.sk-toggleable__label-arrow:before {\n",
       "  /* Arrow on the left of the label */\n",
       "  content: \"▸\";\n",
       "  float: left;\n",
       "  margin-right: 0.25em;\n",
       "  color: var(--sklearn-color-icon);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 label.sk-toggleable__label-arrow:hover:before {\n",
       "  color: var(--sklearn-color-text);\n",
       "}\n",
       "\n",
       "/* Toggleable content - dropdown */\n",
       "\n",
       "#sk-container-id-3 div.sk-toggleable__content {\n",
       "  max-height: 0;\n",
       "  max-width: 0;\n",
       "  overflow: hidden;\n",
       "  text-align: left;\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-toggleable__content.fitted {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-toggleable__content pre {\n",
       "  margin: 0.2em;\n",
       "  border-radius: 0.25em;\n",
       "  color: var(--sklearn-color-text);\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-toggleable__content.fitted pre {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 input.sk-toggleable__control:checked~div.sk-toggleable__content {\n",
       "  /* Expand drop-down */\n",
       "  max-height: 200px;\n",
       "  max-width: 100%;\n",
       "  overflow: auto;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 input.sk-toggleable__control:checked~label.sk-toggleable__label-arrow:before {\n",
       "  content: \"▾\";\n",
       "}\n",
       "\n",
       "/* Pipeline/ColumnTransformer-specific style */\n",
       "\n",
       "#sk-container-id-3 div.sk-label input.sk-toggleable__control:checked~label.sk-toggleable__label {\n",
       "  color: var(--sklearn-color-text);\n",
       "  background-color: var(--sklearn-color-unfitted-level-2);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-label.fitted input.sk-toggleable__control:checked~label.sk-toggleable__label {\n",
       "  background-color: var(--sklearn-color-fitted-level-2);\n",
       "}\n",
       "\n",
       "/* Estimator-specific style */\n",
       "\n",
       "/* Colorize estimator box */\n",
       "#sk-container-id-3 div.sk-estimator input.sk-toggleable__control:checked~label.sk-toggleable__label {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-2);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-estimator.fitted input.sk-toggleable__control:checked~label.sk-toggleable__label {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-2);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-label label.sk-toggleable__label,\n",
       "#sk-container-id-3 div.sk-label label {\n",
       "  /* The background is the default theme color */\n",
       "  color: var(--sklearn-color-text-on-default-background);\n",
       "}\n",
       "\n",
       "/* On hover, darken the color of the background */\n",
       "#sk-container-id-3 div.sk-label:hover label.sk-toggleable__label {\n",
       "  color: var(--sklearn-color-text);\n",
       "  background-color: var(--sklearn-color-unfitted-level-2);\n",
       "}\n",
       "\n",
       "/* Label box, darken color on hover, fitted */\n",
       "#sk-container-id-3 div.sk-label.fitted:hover label.sk-toggleable__label.fitted {\n",
       "  color: var(--sklearn-color-text);\n",
       "  background-color: var(--sklearn-color-fitted-level-2);\n",
       "}\n",
       "\n",
       "/* Estimator label */\n",
       "\n",
       "#sk-container-id-3 div.sk-label label {\n",
       "  font-family: monospace;\n",
       "  font-weight: bold;\n",
       "  display: inline-block;\n",
       "  line-height: 1.2em;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-label-container {\n",
       "  text-align: center;\n",
       "}\n",
       "\n",
       "/* Estimator-specific */\n",
       "#sk-container-id-3 div.sk-estimator {\n",
       "  font-family: monospace;\n",
       "  border: 1px dotted var(--sklearn-color-border-box);\n",
       "  border-radius: 0.25em;\n",
       "  box-sizing: border-box;\n",
       "  margin-bottom: 0.5em;\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-estimator.fitted {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-0);\n",
       "}\n",
       "\n",
       "/* on hover */\n",
       "#sk-container-id-3 div.sk-estimator:hover {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-2);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-estimator.fitted:hover {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-2);\n",
       "}\n",
       "\n",
       "/* Specification for estimator info (e.g. \"i\" and \"?\") */\n",
       "\n",
       "/* Common style for \"i\" and \"?\" */\n",
       "\n",
       ".sk-estimator-doc-link,\n",
       "a:link.sk-estimator-doc-link,\n",
       "a:visited.sk-estimator-doc-link {\n",
       "  float: right;\n",
       "  font-size: smaller;\n",
       "  line-height: 1em;\n",
       "  font-family: monospace;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "  border-radius: 1em;\n",
       "  height: 1em;\n",
       "  width: 1em;\n",
       "  text-decoration: none !important;\n",
       "  margin-left: 1ex;\n",
       "  /* unfitted */\n",
       "  border: var(--sklearn-color-unfitted-level-1) 1pt solid;\n",
       "  color: var(--sklearn-color-unfitted-level-1);\n",
       "}\n",
       "\n",
       ".sk-estimator-doc-link.fitted,\n",
       "a:link.sk-estimator-doc-link.fitted,\n",
       "a:visited.sk-estimator-doc-link.fitted {\n",
       "  /* fitted */\n",
       "  border: var(--sklearn-color-fitted-level-1) 1pt solid;\n",
       "  color: var(--sklearn-color-fitted-level-1);\n",
       "}\n",
       "\n",
       "/* On hover */\n",
       "div.sk-estimator:hover .sk-estimator-doc-link:hover,\n",
       ".sk-estimator-doc-link:hover,\n",
       "div.sk-label-container:hover .sk-estimator-doc-link:hover,\n",
       ".sk-estimator-doc-link:hover {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-3);\n",
       "  color: var(--sklearn-color-background);\n",
       "  text-decoration: none;\n",
       "}\n",
       "\n",
       "div.sk-estimator.fitted:hover .sk-estimator-doc-link.fitted:hover,\n",
       ".sk-estimator-doc-link.fitted:hover,\n",
       "div.sk-label-container:hover .sk-estimator-doc-link.fitted:hover,\n",
       ".sk-estimator-doc-link.fitted:hover {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-3);\n",
       "  color: var(--sklearn-color-background);\n",
       "  text-decoration: none;\n",
       "}\n",
       "\n",
       "/* Span, style for the box shown on hovering the info icon */\n",
       ".sk-estimator-doc-link span {\n",
       "  display: none;\n",
       "  z-index: 9999;\n",
       "  position: relative;\n",
       "  font-weight: normal;\n",
       "  right: .2ex;\n",
       "  padding: .5ex;\n",
       "  margin: .5ex;\n",
       "  width: min-content;\n",
       "  min-width: 20ex;\n",
       "  max-width: 50ex;\n",
       "  color: var(--sklearn-color-text);\n",
       "  box-shadow: 2pt 2pt 4pt #999;\n",
       "  /* unfitted */\n",
       "  background: var(--sklearn-color-unfitted-level-0);\n",
       "  border: .5pt solid var(--sklearn-color-unfitted-level-3);\n",
       "}\n",
       "\n",
       ".sk-estimator-doc-link.fitted span {\n",
       "  /* fitted */\n",
       "  background: var(--sklearn-color-fitted-level-0);\n",
       "  border: var(--sklearn-color-fitted-level-3);\n",
       "}\n",
       "\n",
       ".sk-estimator-doc-link:hover span {\n",
       "  display: block;\n",
       "}\n",
       "\n",
       "/* \"?\"-specific style due to the `<a>` HTML tag */\n",
       "\n",
       "#sk-container-id-3 a.estimator_doc_link {\n",
       "  float: right;\n",
       "  font-size: 1rem;\n",
       "  line-height: 1em;\n",
       "  font-family: monospace;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "  border-radius: 1rem;\n",
       "  height: 1rem;\n",
       "  width: 1rem;\n",
       "  text-decoration: none;\n",
       "  /* unfitted */\n",
       "  color: var(--sklearn-color-unfitted-level-1);\n",
       "  border: var(--sklearn-color-unfitted-level-1) 1pt solid;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 a.estimator_doc_link.fitted {\n",
       "  /* fitted */\n",
       "  border: var(--sklearn-color-fitted-level-1) 1pt solid;\n",
       "  color: var(--sklearn-color-fitted-level-1);\n",
       "}\n",
       "\n",
       "/* On hover */\n",
       "#sk-container-id-3 a.estimator_doc_link:hover {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-3);\n",
       "  color: var(--sklearn-color-background);\n",
       "  text-decoration: none;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 a.estimator_doc_link.fitted:hover {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-3);\n",
       "}\n",
       "</style><div id=\"sk-container-id-3\" class=\"sk-top-container\"><div class=\"sk-text-repr-fallback\"><pre>RandomForestClassifier(n_jobs=-1, random_state=42)</pre><b>In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook. <br />On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.</b></div><div class=\"sk-container\" hidden><div class=\"sk-item\"><div class=\"sk-estimator fitted sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-3\" type=\"checkbox\" checked><label for=\"sk-estimator-id-3\" class=\"sk-toggleable__label fitted sk-toggleable__label-arrow fitted\">&nbsp;&nbsp;RandomForestClassifier<a class=\"sk-estimator-doc-link fitted\" rel=\"noreferrer\" target=\"_blank\" href=\"https://scikit-learn.org/1.4/modules/generated/sklearn.ensemble.RandomForestClassifier.html\">?<span>Documentation for RandomForestClassifier</span></a><span class=\"sk-estimator-doc-link fitted\">i<span>Fitted</span></span></label><div class=\"sk-toggleable__content fitted\"><pre>RandomForestClassifier(n_jobs=-1, random_state=42)</pre></div> </div></div></div></div>"
      ],
      "text/plain": [
       "RandomForestClassifier(n_jobs=-1, random_state=42)"
      ]
     },
     "execution_count": 29,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Modelo entrenado con el conjunto de datos escalado\n",
    "clf_rnd_scaled = RandomForestClassifier(n_estimators=100, random_state=42, n_jobs=-1)\n",
    "clf_rnd_scaled.fit(X_train_scaled, y_train)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Predecimos con el conjunto de datos de entrenamiento\n",
    "y_train_pred = clf_rnd.predict(X_train)\n",
    "y_train_prep_pred = clf_rnd_scaled.predict(X_train_scaled)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "f1_score WITHOUT preparation: 0.9812539406589775\n",
      "f1_score WITH preparation: 0.9811864245262409\n"
     ]
    }
   ],
   "source": [
    "# Comparamos resultados entre escalado y sin escalar\n",
    "evaluate_result(y_train_pred, y_train, y_train_prep_pred, y_train, f1_score)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Predecimos con el conjunto de datos de validación\n",
    "y_pred = clf_rnd.predict(X_val)\n",
    "y_prep_pred = clf_rnd_scaled.predict(X_val_scaled)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "f1_score WITHOUT preparation: 0.9329474731171657\n",
      "f1_score WITH preparation: 0.9324559680173685\n"
     ]
    }
   ],
   "source": [
    "# Comparamos resultados entre escalado y sin escalar\n",
    "evaluate_result(y_pred, y_val, y_prep_pred, y_val, f1_score)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 7. Regression Forest"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Los árboles y conjuntos de árboles de decisión también pueden aplicarse a problemas de regresión."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sklearn.ensemble import RandomForestRegressor"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.11.7"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}