Pandas_Assignment.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "Pandas_Assignment.ipynb",
      "provenance": [],
      "collapsed_sections": [],
      "toc_visible": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "language_info": {
      "name": "python"
    }
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "isrvZyPYYtP6"
      },
      "source": [
        "# **Pandas Assignment**"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "KAoK3R_6YxlG"
      },
      "source": [
        "datsets: top songs of the year specified\n",
        "\n",
        "spotify_data_2011-2020.csv\n",
        "spotify_data_2021-1.csv"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "SXwhj5810mes"
      },
      "source": [
        "**Import** **Pandas**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "P39bimBA0V4Z"
      },
      "source": [
        "import pandas as pd"
      ],
      "execution_count": 1,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "PltpbY4W06hV"
      },
      "source": [
        "**Read** **spotify_2011-2020.cs**v **file** "
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "TkxEBVWm3XV1"
      },
      "source": [
        "df2 = pd.read_csv(\"/content/spotify_data_2011-2020.csv\")"
      ],
      "execution_count": 2,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "1IebcVee3iOs",
        "outputId": "afa7f934-e117-4988-bd0c-49b3badf943d"
      },
      "source": [
        "print(df2)"
      ],
      "execution_count": 3,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "                                              name  ...  year\n",
            "0                            Old Town Road - Remix  ...  2019\n",
            "1                                          bad guy  ...  2019\n",
            "2                                         Señorita  ...  2019\n",
            "3                                          7 rings  ...  2019\n",
            "4    Sunflower - Spider-Man: Into the Spider-Verse  ...  2019\n",
            "..                                             ...  ...   ...\n",
            "879                                    Springsteen  ...  2011\n",
            "880                                      Honey Bee  ...  2011\n",
            "881                       Stereo Love - Radio Edit  ...  2010\n",
            "882                               Black and Yellow  ...  2011\n",
            "883                Earthquake (feat. Tinie Tempah)  ...  2012\n",
            "\n",
            "[884 rows x 19 columns]\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "_UeZdgKo4XAU"
      },
      "source": [
        "**Display first 10 rows of the dataset**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 643
        },
        "id": "K7WNEmu14Yx0",
        "outputId": "c27833e8-9c4b-4a15-8ee9-dd1482f9956f"
      },
      "source": [
        "df2.head(10)"
      ],
      "execution_count": 4,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>name</th>\n",
              "      <th>artists</th>\n",
              "      <th>id</th>\n",
              "      <th>release_date</th>\n",
              "      <th>explicit</th>\n",
              "      <th>valence</th>\n",
              "      <th>acousticness</th>\n",
              "      <th>danceability</th>\n",
              "      <th>duration_ms</th>\n",
              "      <th>energy</th>\n",
              "      <th>instrumentalness</th>\n",
              "      <th>loudness</th>\n",
              "      <th>key</th>\n",
              "      <th>liveness</th>\n",
              "      <th>mode</th>\n",
              "      <th>popularity</th>\n",
              "      <th>speechiness</th>\n",
              "      <th>tempo</th>\n",
              "      <th>year</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>Old Town Road - Remix</td>\n",
              "      <td>Lil Nas X</td>\n",
              "      <td>2YpeDb67231RjR0MgVLzsG</td>\n",
              "      <td>21-06-2019</td>\n",
              "      <td>False</td>\n",
              "      <td>0.639</td>\n",
              "      <td>0.0533</td>\n",
              "      <td>0.878</td>\n",
              "      <td>157066</td>\n",
              "      <td>0.619</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-5.560</td>\n",
              "      <td>6</td>\n",
              "      <td>0.1130</td>\n",
              "      <td>1</td>\n",
              "      <td>80</td>\n",
              "      <td>0.1020</td>\n",
              "      <td>136.041</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>bad guy</td>\n",
              "      <td>Billie Eilish</td>\n",
              "      <td>2Fxmhks0bxGSBdJ92vM42m</td>\n",
              "      <td>29-03-2019</td>\n",
              "      <td>False</td>\n",
              "      <td>0.562</td>\n",
              "      <td>0.3280</td>\n",
              "      <td>0.701</td>\n",
              "      <td>194087</td>\n",
              "      <td>0.425</td>\n",
              "      <td>0.130000</td>\n",
              "      <td>-10.965</td>\n",
              "      <td>7</td>\n",
              "      <td>0.1000</td>\n",
              "      <td>1</td>\n",
              "      <td>85</td>\n",
              "      <td>0.3750</td>\n",
              "      <td>135.128</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>Señorita</td>\n",
              "      <td>Shawn Mendes</td>\n",
              "      <td>6v3KW9xbzN5yKLt9YKDYA2</td>\n",
              "      <td>19-06-2019</td>\n",
              "      <td>False</td>\n",
              "      <td>0.749</td>\n",
              "      <td>0.0392</td>\n",
              "      <td>0.759</td>\n",
              "      <td>190799</td>\n",
              "      <td>0.548</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-6.049</td>\n",
              "      <td>9</td>\n",
              "      <td>0.0828</td>\n",
              "      <td>0</td>\n",
              "      <td>79</td>\n",
              "      <td>0.0290</td>\n",
              "      <td>116.967</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>7 rings</td>\n",
              "      <td>Ariana Grande</td>\n",
              "      <td>6ocbgoVGwYJhOv1GgI9NsF</td>\n",
              "      <td>08-02-2019</td>\n",
              "      <td>True</td>\n",
              "      <td>0.327</td>\n",
              "      <td>0.5920</td>\n",
              "      <td>0.778</td>\n",
              "      <td>178626</td>\n",
              "      <td>0.317</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-10.732</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0881</td>\n",
              "      <td>0</td>\n",
              "      <td>85</td>\n",
              "      <td>0.3340</td>\n",
              "      <td>140.048</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>Sunflower - Spider-Man: Into the Spider-Verse</td>\n",
              "      <td>Post Malone</td>\n",
              "      <td>0RiRZpuVRbi7oqRdSMwhQY</td>\n",
              "      <td>06-09-2019</td>\n",
              "      <td>False</td>\n",
              "      <td>0.925</td>\n",
              "      <td>0.5330</td>\n",
              "      <td>0.755</td>\n",
              "      <td>157560</td>\n",
              "      <td>0.522</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-4.368</td>\n",
              "      <td>2</td>\n",
              "      <td>0.0685</td>\n",
              "      <td>1</td>\n",
              "      <td>80</td>\n",
              "      <td>0.0575</td>\n",
              "      <td>89.960</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>5</th>\n",
              "      <td>i'm so tired...</td>\n",
              "      <td>Lauv</td>\n",
              "      <td>7COXchtUOMd6uIT6HvmRaI</td>\n",
              "      <td>24-01-2019</td>\n",
              "      <td>False</td>\n",
              "      <td>0.534</td>\n",
              "      <td>0.1760</td>\n",
              "      <td>0.599</td>\n",
              "      <td>162582</td>\n",
              "      <td>0.733</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-7.058</td>\n",
              "      <td>11</td>\n",
              "      <td>0.2420</td>\n",
              "      <td>1</td>\n",
              "      <td>5</td>\n",
              "      <td>0.2030</td>\n",
              "      <td>102.211</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>6</th>\n",
              "      <td>Without Me</td>\n",
              "      <td>Halsey</td>\n",
              "      <td>5p7ujcrUXASCNwRaWNHR1C</td>\n",
              "      <td>04-10-2018</td>\n",
              "      <td>True</td>\n",
              "      <td>0.533</td>\n",
              "      <td>0.2970</td>\n",
              "      <td>0.752</td>\n",
              "      <td>201660</td>\n",
              "      <td>0.488</td>\n",
              "      <td>0.000009</td>\n",
              "      <td>-7.050</td>\n",
              "      <td>6</td>\n",
              "      <td>0.0936</td>\n",
              "      <td>1</td>\n",
              "      <td>79</td>\n",
              "      <td>0.0705</td>\n",
              "      <td>136.041</td>\n",
              "      <td>2018</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>7</th>\n",
              "      <td>Don't Start Now</td>\n",
              "      <td>Dua Lipa</td>\n",
              "      <td>6WrI0LAC5M1Rw2MnX2ZvEg</td>\n",
              "      <td>31-10-2019</td>\n",
              "      <td>False</td>\n",
              "      <td>0.677</td>\n",
              "      <td>0.0125</td>\n",
              "      <td>0.794</td>\n",
              "      <td>183290</td>\n",
              "      <td>0.793</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-4.521</td>\n",
              "      <td>11</td>\n",
              "      <td>0.0952</td>\n",
              "      <td>0</td>\n",
              "      <td>82</td>\n",
              "      <td>0.0842</td>\n",
              "      <td>123.941</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>8</th>\n",
              "      <td>Shallow</td>\n",
              "      <td>Lady Gaga</td>\n",
              "      <td>2VxeLyX666F8uXCJ0dZF8B</td>\n",
              "      <td>05-10-2018</td>\n",
              "      <td>False</td>\n",
              "      <td>0.323</td>\n",
              "      <td>0.3710</td>\n",
              "      <td>0.572</td>\n",
              "      <td>215733</td>\n",
              "      <td>0.385</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-6.362</td>\n",
              "      <td>7</td>\n",
              "      <td>0.2310</td>\n",
              "      <td>1</td>\n",
              "      <td>84</td>\n",
              "      <td>0.0308</td>\n",
              "      <td>95.799</td>\n",
              "      <td>2018</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>9</th>\n",
              "      <td>Sucker</td>\n",
              "      <td>Jonas Brothers</td>\n",
              "      <td>22vgEDb5hykfaTwLuskFGD</td>\n",
              "      <td>07-06-2019</td>\n",
              "      <td>False</td>\n",
              "      <td>0.952</td>\n",
              "      <td>0.0427</td>\n",
              "      <td>0.842</td>\n",
              "      <td>181026</td>\n",
              "      <td>0.734</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-5.065</td>\n",
              "      <td>1</td>\n",
              "      <td>0.1060</td>\n",
              "      <td>0</td>\n",
              "      <td>81</td>\n",
              "      <td>0.0588</td>\n",
              "      <td>137.958</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "                                            name         artists  ...    tempo  year\n",
              "0                          Old Town Road - Remix       Lil Nas X  ...  136.041  2019\n",
              "1                                        bad guy   Billie Eilish  ...  135.128  2019\n",
              "2                                       Señorita    Shawn Mendes  ...  116.967  2019\n",
              "3                                        7 rings   Ariana Grande  ...  140.048  2019\n",
              "4  Sunflower - Spider-Man: Into the Spider-Verse     Post Malone  ...   89.960  2019\n",
              "5                                i'm so tired...            Lauv  ...  102.211  2019\n",
              "6                                     Without Me          Halsey  ...  136.041  2018\n",
              "7                                Don't Start Now        Dua Lipa  ...  123.941  2019\n",
              "8                                        Shallow       Lady Gaga  ...   95.799  2018\n",
              "9                                         Sucker  Jonas Brothers  ...  137.958  2019\n",
              "\n",
              "[10 rows x 19 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 4
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "FQmpSkBI4zV1"
      },
      "source": [
        "**Display 4 rows from the last**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 299
        },
        "id": "EdCMAHjo409U",
        "outputId": "761fc9de-c6c7-4cb7-cdf1-880432d2b2bb"
      },
      "source": [
        "df2.tail(4)"
      ],
      "execution_count": 5,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>name</th>\n",
              "      <th>artists</th>\n",
              "      <th>id</th>\n",
              "      <th>release_date</th>\n",
              "      <th>explicit</th>\n",
              "      <th>valence</th>\n",
              "      <th>acousticness</th>\n",
              "      <th>danceability</th>\n",
              "      <th>duration_ms</th>\n",
              "      <th>energy</th>\n",
              "      <th>instrumentalness</th>\n",
              "      <th>loudness</th>\n",
              "      <th>key</th>\n",
              "      <th>liveness</th>\n",
              "      <th>mode</th>\n",
              "      <th>popularity</th>\n",
              "      <th>speechiness</th>\n",
              "      <th>tempo</th>\n",
              "      <th>year</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>880</th>\n",
              "      <td>Honey Bee</td>\n",
              "      <td>Blake Shelton</td>\n",
              "      <td>0U3xEfWLX4slslHJaAorSw</td>\n",
              "      <td>12-07-2011</td>\n",
              "      <td>False</td>\n",
              "      <td>0.723</td>\n",
              "      <td>0.00167</td>\n",
              "      <td>0.481</td>\n",
              "      <td>210720</td>\n",
              "      <td>0.849</td>\n",
              "      <td>0.000001</td>\n",
              "      <td>-5.131</td>\n",
              "      <td>4</td>\n",
              "      <td>0.1210</td>\n",
              "      <td>1</td>\n",
              "      <td>50</td>\n",
              "      <td>0.0385</td>\n",
              "      <td>205.570</td>\n",
              "      <td>2011</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>881</th>\n",
              "      <td>Stereo Love - Radio Edit</td>\n",
              "      <td>Edward Maya</td>\n",
              "      <td>1AguHaKOuggrVTebp7cZEI</td>\n",
              "      <td>02-02-2010</td>\n",
              "      <td>False</td>\n",
              "      <td>0.586</td>\n",
              "      <td>0.03460</td>\n",
              "      <td>0.799</td>\n",
              "      <td>184573</td>\n",
              "      <td>0.783</td>\n",
              "      <td>0.018600</td>\n",
              "      <td>-3.896</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0757</td>\n",
              "      <td>0</td>\n",
              "      <td>64</td>\n",
              "      <td>0.0322</td>\n",
              "      <td>127.041</td>\n",
              "      <td>2010</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>882</th>\n",
              "      <td>Black and Yellow</td>\n",
              "      <td>Wiz Khalifa</td>\n",
              "      <td>5A6OHHy73AR5tLxgTc98zz</td>\n",
              "      <td>29-03-2011</td>\n",
              "      <td>True</td>\n",
              "      <td>0.538</td>\n",
              "      <td>0.06460</td>\n",
              "      <td>0.684</td>\n",
              "      <td>217666</td>\n",
              "      <td>0.834</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-4.524</td>\n",
              "      <td>2</td>\n",
              "      <td>0.2710</td>\n",
              "      <td>0</td>\n",
              "      <td>75</td>\n",
              "      <td>0.0675</td>\n",
              "      <td>164.020</td>\n",
              "      <td>2011</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>883</th>\n",
              "      <td>Earthquake (feat. Tinie Tempah)</td>\n",
              "      <td>Labrinth</td>\n",
              "      <td>3SxiAdI8dP9AaaEz1Z24mn</td>\n",
              "      <td>02-04-2012</td>\n",
              "      <td>True</td>\n",
              "      <td>0.258</td>\n",
              "      <td>0.10900</td>\n",
              "      <td>0.540</td>\n",
              "      <td>274600</td>\n",
              "      <td>0.856</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-3.966</td>\n",
              "      <td>0</td>\n",
              "      <td>0.2760</td>\n",
              "      <td>0</td>\n",
              "      <td>61</td>\n",
              "      <td>0.1000</td>\n",
              "      <td>153.071</td>\n",
              "      <td>2012</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "                                name        artists  ...    tempo  year\n",
              "880                        Honey Bee  Blake Shelton  ...  205.570  2011\n",
              "881         Stereo Love - Radio Edit    Edward Maya  ...  127.041  2010\n",
              "882                 Black and Yellow    Wiz Khalifa  ...  164.020  2011\n",
              "883  Earthquake (feat. Tinie Tempah)       Labrinth  ...  153.071  2012\n",
              "\n",
              "[4 rows x 19 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 5
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "2IC_8Eps5CFn"
      },
      "source": [
        "**Display the information of each column in the dataset using .info function**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "5SROjUaJ5HgG",
        "outputId": "19368c84-e3a5-48f1-83d0-8a3753bfc471"
      },
      "source": [
        "df2.info()"
      ],
      "execution_count": 8,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "<class 'pandas.core.frame.DataFrame'>\n",
            "RangeIndex: 884 entries, 0 to 883\n",
            "Data columns (total 19 columns):\n",
            " #   Column            Non-Null Count  Dtype  \n",
            "---  ------            --------------  -----  \n",
            " 0   name              884 non-null    object \n",
            " 1   artists           884 non-null    object \n",
            " 2   id                884 non-null    object \n",
            " 3   release_date      884 non-null    object \n",
            " 4   explicit          884 non-null    bool   \n",
            " 5   valence           884 non-null    float64\n",
            " 6   acousticness      884 non-null    float64\n",
            " 7   danceability      884 non-null    float64\n",
            " 8   duration_ms       884 non-null    int64  \n",
            " 9   energy            884 non-null    float64\n",
            " 10  instrumentalness  884 non-null    float64\n",
            " 11  loudness          884 non-null    float64\n",
            " 12  key               884 non-null    int64  \n",
            " 13  liveness          884 non-null    float64\n",
            " 14  mode              884 non-null    int64  \n",
            " 15  popularity        884 non-null    int64  \n",
            " 16  speechiness       884 non-null    float64\n",
            " 17  tempo             884 non-null    float64\n",
            " 18  year              884 non-null    int64  \n",
            "dtypes: bool(1), float64(9), int64(5), object(4)\n",
            "memory usage: 125.3+ KB\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "lLwdfMzQ-DS1"
      },
      "source": [
        "**Check for null values**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "YQzeySBlUSB0",
        "outputId": "f745733d-4533-4893-f8dc-f4bf7ac9bfdd"
      },
      "source": [
        "df2.isnull().sum()"
      ],
      "execution_count": 62,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "name                                         0\n",
              "artists                                      0\n",
              "id                                           0\n",
              "release_date                                 0\n",
              "explicit                                     0\n",
              "valence                                      0\n",
              "acousticness                                 0\n",
              "danceability                                 0\n",
              "duration_ms                                  0\n",
              "energy                                       0\n",
              "instrumentalness                             0\n",
              "loudness                                     0\n",
              "key                                          0\n",
              "liveness                                     0\n",
              "mode                                         0\n",
              "popularity                                   0\n",
              "speechiness                                  0\n",
              "tempo                                        0\n",
              "year                                         0\n",
              "(popularity, name, artists, release_date)    0\n",
              "dtype: int64"
            ]
          },
          "metadata": {},
          "execution_count": 62
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Skd0r_ol-kH0"
      },
      "source": [
        "**Display the number of unique values in each column using .nunique function**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "VirHXcLvUXvj",
        "outputId": "f07f32d8-06c3-4a8e-cb47-54b135e0a927"
      },
      "source": [
        "df2.nunique()"
      ],
      "execution_count": 63,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "name                                         843\n",
              "artists                                      371\n",
              "id                                           883\n",
              "release_date                                 458\n",
              "explicit                                       2\n",
              "valence                                      543\n",
              "acousticness                                 691\n",
              "danceability                                 407\n",
              "duration_ms                                  848\n",
              "energy                                       449\n",
              "instrumentalness                             327\n",
              "loudness                                     806\n",
              "key                                           12\n",
              "liveness                                     458\n",
              "mode                                           2\n",
              "popularity                                     1\n",
              "speechiness                                  566\n",
              "tempo                                        838\n",
              "year                                          12\n",
              "(popularity, name, artists, release_date)      1\n",
              "dtype: int64"
            ]
          },
          "metadata": {},
          "execution_count": 63
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "67QK-0YE-1VD"
      },
      "source": [
        "**Identify the columns with numeric values and display those**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 424
        },
        "id": "NOj-ScRZ-5Ak",
        "outputId": "14e1ae30-c902-4976-cad0-0bd845217471"
      },
      "source": [
        " df2.select_dtypes('number')"
      ],
      "execution_count": 11,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>valence</th>\n",
              "      <th>acousticness</th>\n",
              "      <th>danceability</th>\n",
              "      <th>duration_ms</th>\n",
              "      <th>energy</th>\n",
              "      <th>instrumentalness</th>\n",
              "      <th>loudness</th>\n",
              "      <th>key</th>\n",
              "      <th>liveness</th>\n",
              "      <th>mode</th>\n",
              "      <th>popularity</th>\n",
              "      <th>speechiness</th>\n",
              "      <th>tempo</th>\n",
              "      <th>year</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>0.639</td>\n",
              "      <td>0.05330</td>\n",
              "      <td>0.878</td>\n",
              "      <td>157066</td>\n",
              "      <td>0.619</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-5.560</td>\n",
              "      <td>6</td>\n",
              "      <td>0.1130</td>\n",
              "      <td>1</td>\n",
              "      <td>80</td>\n",
              "      <td>0.1020</td>\n",
              "      <td>136.041</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>0.562</td>\n",
              "      <td>0.32800</td>\n",
              "      <td>0.701</td>\n",
              "      <td>194087</td>\n",
              "      <td>0.425</td>\n",
              "      <td>0.130000</td>\n",
              "      <td>-10.965</td>\n",
              "      <td>7</td>\n",
              "      <td>0.1000</td>\n",
              "      <td>1</td>\n",
              "      <td>85</td>\n",
              "      <td>0.3750</td>\n",
              "      <td>135.128</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>0.749</td>\n",
              "      <td>0.03920</td>\n",
              "      <td>0.759</td>\n",
              "      <td>190799</td>\n",
              "      <td>0.548</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-6.049</td>\n",
              "      <td>9</td>\n",
              "      <td>0.0828</td>\n",
              "      <td>0</td>\n",
              "      <td>79</td>\n",
              "      <td>0.0290</td>\n",
              "      <td>116.967</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>0.327</td>\n",
              "      <td>0.59200</td>\n",
              "      <td>0.778</td>\n",
              "      <td>178626</td>\n",
              "      <td>0.317</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-10.732</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0881</td>\n",
              "      <td>0</td>\n",
              "      <td>85</td>\n",
              "      <td>0.3340</td>\n",
              "      <td>140.048</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>0.925</td>\n",
              "      <td>0.53300</td>\n",
              "      <td>0.755</td>\n",
              "      <td>157560</td>\n",
              "      <td>0.522</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-4.368</td>\n",
              "      <td>2</td>\n",
              "      <td>0.0685</td>\n",
              "      <td>1</td>\n",
              "      <td>80</td>\n",
              "      <td>0.0575</td>\n",
              "      <td>89.960</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>879</th>\n",
              "      <td>0.927</td>\n",
              "      <td>0.10000</td>\n",
              "      <td>0.692</td>\n",
              "      <td>263386</td>\n",
              "      <td>0.809</td>\n",
              "      <td>0.000098</td>\n",
              "      <td>-5.935</td>\n",
              "      <td>2</td>\n",
              "      <td>0.1850</td>\n",
              "      <td>1</td>\n",
              "      <td>72</td>\n",
              "      <td>0.0255</td>\n",
              "      <td>104.023</td>\n",
              "      <td>2011</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>880</th>\n",
              "      <td>0.723</td>\n",
              "      <td>0.00167</td>\n",
              "      <td>0.481</td>\n",
              "      <td>210720</td>\n",
              "      <td>0.849</td>\n",
              "      <td>0.000001</td>\n",
              "      <td>-5.131</td>\n",
              "      <td>4</td>\n",
              "      <td>0.1210</td>\n",
              "      <td>1</td>\n",
              "      <td>50</td>\n",
              "      <td>0.0385</td>\n",
              "      <td>205.570</td>\n",
              "      <td>2011</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>881</th>\n",
              "      <td>0.586</td>\n",
              "      <td>0.03460</td>\n",
              "      <td>0.799</td>\n",
              "      <td>184573</td>\n",
              "      <td>0.783</td>\n",
              "      <td>0.018600</td>\n",
              "      <td>-3.896</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0757</td>\n",
              "      <td>0</td>\n",
              "      <td>64</td>\n",
              "      <td>0.0322</td>\n",
              "      <td>127.041</td>\n",
              "      <td>2010</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>882</th>\n",
              "      <td>0.538</td>\n",
              "      <td>0.06460</td>\n",
              "      <td>0.684</td>\n",
              "      <td>217666</td>\n",
              "      <td>0.834</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-4.524</td>\n",
              "      <td>2</td>\n",
              "      <td>0.2710</td>\n",
              "      <td>0</td>\n",
              "      <td>75</td>\n",
              "      <td>0.0675</td>\n",
              "      <td>164.020</td>\n",
              "      <td>2011</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>883</th>\n",
              "      <td>0.258</td>\n",
              "      <td>0.10900</td>\n",
              "      <td>0.540</td>\n",
              "      <td>274600</td>\n",
              "      <td>0.856</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-3.966</td>\n",
              "      <td>0</td>\n",
              "      <td>0.2760</td>\n",
              "      <td>0</td>\n",
              "      <td>61</td>\n",
              "      <td>0.1000</td>\n",
              "      <td>153.071</td>\n",
              "      <td>2012</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>884 rows × 14 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "     valence  acousticness  danceability  ...  speechiness    tempo  year\n",
              "0      0.639       0.05330         0.878  ...       0.1020  136.041  2019\n",
              "1      0.562       0.32800         0.701  ...       0.3750  135.128  2019\n",
              "2      0.749       0.03920         0.759  ...       0.0290  116.967  2019\n",
              "3      0.327       0.59200         0.778  ...       0.3340  140.048  2019\n",
              "4      0.925       0.53300         0.755  ...       0.0575   89.960  2019\n",
              "..       ...           ...           ...  ...          ...      ...   ...\n",
              "879    0.927       0.10000         0.692  ...       0.0255  104.023  2011\n",
              "880    0.723       0.00167         0.481  ...       0.0385  205.570  2011\n",
              "881    0.586       0.03460         0.799  ...       0.0322  127.041  2010\n",
              "882    0.538       0.06460         0.684  ...       0.0675  164.020  2011\n",
              "883    0.258       0.10900         0.540  ...       0.1000  153.071  2012\n",
              "\n",
              "[884 rows x 14 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 11
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "X1NtlVt2AbT0"
      },
      "source": [
        "**Display the statistical information of the numerical columns**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "fDiX-807Zedr"
      },
      "source": [
        ""
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "uR2gd4B8AfRk"
      },
      "source": [
        "**Display the columns with categorical values**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "FpQoE9GnAjSN"
      },
      "source": [
        ""
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "dapSEg-iAk7j"
      },
      "source": [
        "**Display all the colunns with continuous value**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "NavUxn67BoN7"
      },
      "source": [
        ""
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "gxbctlFXBonO"
      },
      "source": [
        "**Display the first 3 columns using iloc function (all the rows )**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 424
        },
        "id": "bViv_6HeBwSE",
        "outputId": "bdc4e89d-fe67-4840-fd48-400ace8a2374"
      },
      "source": [
        "df2.iloc[0:884, 0:3]"
      ],
      "execution_count": 20,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>name</th>\n",
              "      <th>artists</th>\n",
              "      <th>id</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>Old Town Road - Remix</td>\n",
              "      <td>Lil Nas X</td>\n",
              "      <td>2YpeDb67231RjR0MgVLzsG</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>bad guy</td>\n",
              "      <td>Billie Eilish</td>\n",
              "      <td>2Fxmhks0bxGSBdJ92vM42m</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>Señorita</td>\n",
              "      <td>Shawn Mendes</td>\n",
              "      <td>6v3KW9xbzN5yKLt9YKDYA2</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>7 rings</td>\n",
              "      <td>Ariana Grande</td>\n",
              "      <td>6ocbgoVGwYJhOv1GgI9NsF</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>Sunflower - Spider-Man: Into the Spider-Verse</td>\n",
              "      <td>Post Malone</td>\n",
              "      <td>0RiRZpuVRbi7oqRdSMwhQY</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>879</th>\n",
              "      <td>Springsteen</td>\n",
              "      <td>Eric Church</td>\n",
              "      <td>05ZACkzW8YbRq3eFgIfSNB</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>880</th>\n",
              "      <td>Honey Bee</td>\n",
              "      <td>Blake Shelton</td>\n",
              "      <td>0U3xEfWLX4slslHJaAorSw</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>881</th>\n",
              "      <td>Stereo Love - Radio Edit</td>\n",
              "      <td>Edward Maya</td>\n",
              "      <td>1AguHaKOuggrVTebp7cZEI</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>882</th>\n",
              "      <td>Black and Yellow</td>\n",
              "      <td>Wiz Khalifa</td>\n",
              "      <td>5A6OHHy73AR5tLxgTc98zz</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>883</th>\n",
              "      <td>Earthquake (feat. Tinie Tempah)</td>\n",
              "      <td>Labrinth</td>\n",
              "      <td>3SxiAdI8dP9AaaEz1Z24mn</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>884 rows × 3 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "                                              name  ...                      id\n",
              "0                            Old Town Road - Remix  ...  2YpeDb67231RjR0MgVLzsG\n",
              "1                                          bad guy  ...  2Fxmhks0bxGSBdJ92vM42m\n",
              "2                                         Señorita  ...  6v3KW9xbzN5yKLt9YKDYA2\n",
              "3                                          7 rings  ...  6ocbgoVGwYJhOv1GgI9NsF\n",
              "4    Sunflower - Spider-Man: Into the Spider-Verse  ...  0RiRZpuVRbi7oqRdSMwhQY\n",
              "..                                             ...  ...                     ...\n",
              "879                                    Springsteen  ...  05ZACkzW8YbRq3eFgIfSNB\n",
              "880                                      Honey Bee  ...  0U3xEfWLX4slslHJaAorSw\n",
              "881                       Stereo Love - Radio Edit  ...  1AguHaKOuggrVTebp7cZEI\n",
              "882                               Black and Yellow  ...  5A6OHHy73AR5tLxgTc98zz\n",
              "883                Earthquake (feat. Tinie Tempah)  ...  3SxiAdI8dP9AaaEz1Z24mn\n",
              "\n",
              "[884 rows x 3 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 20
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "-LHMYFnzFiZX"
      },
      "source": [
        "**Display name of the song, the artist ,the release date and popularity columns using loc function**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 424
        },
        "id": "I2reYotTFuTM",
        "outputId": "10438830-c9a2-47a8-d08c-a009cd3846fd"
      },
      "source": [
        "df2.loc[0:884,['name','artists','release_date','popularity']]"
      ],
      "execution_count": 35,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>name</th>\n",
              "      <th>artists</th>\n",
              "      <th>release_date</th>\n",
              "      <th>popularity</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>Old Town Road - Remix</td>\n",
              "      <td>Lil Nas X</td>\n",
              "      <td>21-06-2019</td>\n",
              "      <td>80</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>bad guy</td>\n",
              "      <td>Billie Eilish</td>\n",
              "      <td>29-03-2019</td>\n",
              "      <td>85</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>Señorita</td>\n",
              "      <td>Shawn Mendes</td>\n",
              "      <td>19-06-2019</td>\n",
              "      <td>79</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>7 rings</td>\n",
              "      <td>Ariana Grande</td>\n",
              "      <td>08-02-2019</td>\n",
              "      <td>85</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>Sunflower - Spider-Man: Into the Spider-Verse</td>\n",
              "      <td>Post Malone</td>\n",
              "      <td>06-09-2019</td>\n",
              "      <td>80</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>879</th>\n",
              "      <td>Springsteen</td>\n",
              "      <td>Eric Church</td>\n",
              "      <td>01-01-2011</td>\n",
              "      <td>72</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>880</th>\n",
              "      <td>Honey Bee</td>\n",
              "      <td>Blake Shelton</td>\n",
              "      <td>12-07-2011</td>\n",
              "      <td>50</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>881</th>\n",
              "      <td>Stereo Love - Radio Edit</td>\n",
              "      <td>Edward Maya</td>\n",
              "      <td>02-02-2010</td>\n",
              "      <td>64</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>882</th>\n",
              "      <td>Black and Yellow</td>\n",
              "      <td>Wiz Khalifa</td>\n",
              "      <td>29-03-2011</td>\n",
              "      <td>75</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>883</th>\n",
              "      <td>Earthquake (feat. Tinie Tempah)</td>\n",
              "      <td>Labrinth</td>\n",
              "      <td>02-04-2012</td>\n",
              "      <td>61</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>884 rows × 4 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "                                              name  ... popularity\n",
              "0                            Old Town Road - Remix  ...         80\n",
              "1                                          bad guy  ...         85\n",
              "2                                         Señorita  ...         79\n",
              "3                                          7 rings  ...         85\n",
              "4    Sunflower - Spider-Man: Into the Spider-Verse  ...         80\n",
              "..                                             ...  ...        ...\n",
              "879                                    Springsteen  ...         72\n",
              "880                                      Honey Bee  ...         50\n",
              "881                       Stereo Love - Radio Edit  ...         64\n",
              "882                               Black and Yellow  ...         75\n",
              "883                Earthquake (feat. Tinie Tempah)  ...         61\n",
              "\n",
              "[884 rows x 4 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 35
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "6ObdAE0lG5ao"
      },
      "source": [
        "**Find duplicate rows in the dataset**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 202
        },
        "id": "nZbEvq4pHBuW",
        "outputId": "2fbfd03e-bc30-4337-c2f1-b41fd4be272b"
      },
      "source": [
        "df2[df2.duplicated(keep=False)]"
      ],
      "execution_count": 28,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>name</th>\n",
              "      <th>artists</th>\n",
              "      <th>id</th>\n",
              "      <th>release_date</th>\n",
              "      <th>explicit</th>\n",
              "      <th>valence</th>\n",
              "      <th>acousticness</th>\n",
              "      <th>danceability</th>\n",
              "      <th>duration_ms</th>\n",
              "      <th>energy</th>\n",
              "      <th>instrumentalness</th>\n",
              "      <th>loudness</th>\n",
              "      <th>key</th>\n",
              "      <th>liveness</th>\n",
              "      <th>mode</th>\n",
              "      <th>popularity</th>\n",
              "      <th>speechiness</th>\n",
              "      <th>tempo</th>\n",
              "      <th>year</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>862</th>\n",
              "      <td>Earthquake (feat. Tinie Tempah)</td>\n",
              "      <td>Labrinth</td>\n",
              "      <td>3SxiAdI8dP9AaaEz1Z24mn</td>\n",
              "      <td>02-04-2012</td>\n",
              "      <td>True</td>\n",
              "      <td>0.258</td>\n",
              "      <td>0.109</td>\n",
              "      <td>0.54</td>\n",
              "      <td>274600</td>\n",
              "      <td>0.856</td>\n",
              "      <td>0.0</td>\n",
              "      <td>-3.966</td>\n",
              "      <td>0</td>\n",
              "      <td>0.276</td>\n",
              "      <td>0</td>\n",
              "      <td>61</td>\n",
              "      <td>0.1</td>\n",
              "      <td>153.071</td>\n",
              "      <td>2012</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>883</th>\n",
              "      <td>Earthquake (feat. Tinie Tempah)</td>\n",
              "      <td>Labrinth</td>\n",
              "      <td>3SxiAdI8dP9AaaEz1Z24mn</td>\n",
              "      <td>02-04-2012</td>\n",
              "      <td>True</td>\n",
              "      <td>0.258</td>\n",
              "      <td>0.109</td>\n",
              "      <td>0.54</td>\n",
              "      <td>274600</td>\n",
              "      <td>0.856</td>\n",
              "      <td>0.0</td>\n",
              "      <td>-3.966</td>\n",
              "      <td>0</td>\n",
              "      <td>0.276</td>\n",
              "      <td>0</td>\n",
              "      <td>61</td>\n",
              "      <td>0.1</td>\n",
              "      <td>153.071</td>\n",
              "      <td>2012</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "                                name   artists  ...    tempo  year\n",
              "862  Earthquake (feat. Tinie Tempah)  Labrinth  ...  153.071  2012\n",
              "883  Earthquake (feat. Tinie Tempah)  Labrinth  ...  153.071  2012\n",
              "\n",
              "[2 rows x 19 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 28
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "N5UvuMsIJ6lh"
      },
      "source": [
        "**Drop the duplicate rows**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 704
        },
        "id": "g9JylKO9KAIU",
        "outputId": "44417e38-dfde-47bb-cdc4-3d8ef4a3bcfe"
      },
      "source": [
        "df2.drop_duplicates(keep=False)"
      ],
      "execution_count": 40,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>name</th>\n",
              "      <th>artists</th>\n",
              "      <th>id</th>\n",
              "      <th>release_date</th>\n",
              "      <th>explicit</th>\n",
              "      <th>valence</th>\n",
              "      <th>acousticness</th>\n",
              "      <th>danceability</th>\n",
              "      <th>duration_ms</th>\n",
              "      <th>energy</th>\n",
              "      <th>instrumentalness</th>\n",
              "      <th>loudness</th>\n",
              "      <th>key</th>\n",
              "      <th>liveness</th>\n",
              "      <th>mode</th>\n",
              "      <th>popularity</th>\n",
              "      <th>speechiness</th>\n",
              "      <th>tempo</th>\n",
              "      <th>year</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>Old Town Road - Remix</td>\n",
              "      <td>Lil Nas X</td>\n",
              "      <td>2YpeDb67231RjR0MgVLzsG</td>\n",
              "      <td>21-06-2019</td>\n",
              "      <td>False</td>\n",
              "      <td>0.639</td>\n",
              "      <td>0.05330</td>\n",
              "      <td>0.878</td>\n",
              "      <td>157066</td>\n",
              "      <td>0.619</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-5.560</td>\n",
              "      <td>6</td>\n",
              "      <td>0.1130</td>\n",
              "      <td>1</td>\n",
              "      <td>80</td>\n",
              "      <td>0.1020</td>\n",
              "      <td>136.041</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>bad guy</td>\n",
              "      <td>Billie Eilish</td>\n",
              "      <td>2Fxmhks0bxGSBdJ92vM42m</td>\n",
              "      <td>29-03-2019</td>\n",
              "      <td>False</td>\n",
              "      <td>0.562</td>\n",
              "      <td>0.32800</td>\n",
              "      <td>0.701</td>\n",
              "      <td>194087</td>\n",
              "      <td>0.425</td>\n",
              "      <td>0.130000</td>\n",
              "      <td>-10.965</td>\n",
              "      <td>7</td>\n",
              "      <td>0.1000</td>\n",
              "      <td>1</td>\n",
              "      <td>85</td>\n",
              "      <td>0.3750</td>\n",
              "      <td>135.128</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>Señorita</td>\n",
              "      <td>Shawn Mendes</td>\n",
              "      <td>6v3KW9xbzN5yKLt9YKDYA2</td>\n",
              "      <td>19-06-2019</td>\n",
              "      <td>False</td>\n",
              "      <td>0.749</td>\n",
              "      <td>0.03920</td>\n",
              "      <td>0.759</td>\n",
              "      <td>190799</td>\n",
              "      <td>0.548</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-6.049</td>\n",
              "      <td>9</td>\n",
              "      <td>0.0828</td>\n",
              "      <td>0</td>\n",
              "      <td>79</td>\n",
              "      <td>0.0290</td>\n",
              "      <td>116.967</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>7 rings</td>\n",
              "      <td>Ariana Grande</td>\n",
              "      <td>6ocbgoVGwYJhOv1GgI9NsF</td>\n",
              "      <td>08-02-2019</td>\n",
              "      <td>True</td>\n",
              "      <td>0.327</td>\n",
              "      <td>0.59200</td>\n",
              "      <td>0.778</td>\n",
              "      <td>178626</td>\n",
              "      <td>0.317</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-10.732</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0881</td>\n",
              "      <td>0</td>\n",
              "      <td>85</td>\n",
              "      <td>0.3340</td>\n",
              "      <td>140.048</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>Sunflower - Spider-Man: Into the Spider-Verse</td>\n",
              "      <td>Post Malone</td>\n",
              "      <td>0RiRZpuVRbi7oqRdSMwhQY</td>\n",
              "      <td>06-09-2019</td>\n",
              "      <td>False</td>\n",
              "      <td>0.925</td>\n",
              "      <td>0.53300</td>\n",
              "      <td>0.755</td>\n",
              "      <td>157560</td>\n",
              "      <td>0.522</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-4.368</td>\n",
              "      <td>2</td>\n",
              "      <td>0.0685</td>\n",
              "      <td>1</td>\n",
              "      <td>80</td>\n",
              "      <td>0.0575</td>\n",
              "      <td>89.960</td>\n",
              "      <td>2019</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>878</th>\n",
              "      <td>Sweat - Remix</td>\n",
              "      <td>Snoop Dogg</td>\n",
              "      <td>0R7YVi7w41Dr9jU5vblAok</td>\n",
              "      <td>01-01-2011</td>\n",
              "      <td>False</td>\n",
              "      <td>0.731</td>\n",
              "      <td>0.05970</td>\n",
              "      <td>0.813</td>\n",
              "      <td>195986</td>\n",
              "      <td>0.732</td>\n",
              "      <td>0.001370</td>\n",
              "      <td>-5.636</td>\n",
              "      <td>7</td>\n",
              "      <td>0.0826</td>\n",
              "      <td>1</td>\n",
              "      <td>65</td>\n",
              "      <td>0.0300</td>\n",
              "      <td>130.020</td>\n",
              "      <td>2011</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>879</th>\n",
              "      <td>Springsteen</td>\n",
              "      <td>Eric Church</td>\n",
              "      <td>05ZACkzW8YbRq3eFgIfSNB</td>\n",
              "      <td>01-01-2011</td>\n",
              "      <td>False</td>\n",
              "      <td>0.927</td>\n",
              "      <td>0.10000</td>\n",
              "      <td>0.692</td>\n",
              "      <td>263386</td>\n",
              "      <td>0.809</td>\n",
              "      <td>0.000098</td>\n",
              "      <td>-5.935</td>\n",
              "      <td>2</td>\n",
              "      <td>0.1850</td>\n",
              "      <td>1</td>\n",
              "      <td>72</td>\n",
              "      <td>0.0255</td>\n",
              "      <td>104.023</td>\n",
              "      <td>2011</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>880</th>\n",
              "      <td>Honey Bee</td>\n",
              "      <td>Blake Shelton</td>\n",
              "      <td>0U3xEfWLX4slslHJaAorSw</td>\n",
              "      <td>12-07-2011</td>\n",
              "      <td>False</td>\n",
              "      <td>0.723</td>\n",
              "      <td>0.00167</td>\n",
              "      <td>0.481</td>\n",
              "      <td>210720</td>\n",
              "      <td>0.849</td>\n",
              "      <td>0.000001</td>\n",
              "      <td>-5.131</td>\n",
              "      <td>4</td>\n",
              "      <td>0.1210</td>\n",
              "      <td>1</td>\n",
              "      <td>50</td>\n",
              "      <td>0.0385</td>\n",
              "      <td>205.570</td>\n",
              "      <td>2011</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>881</th>\n",
              "      <td>Stereo Love - Radio Edit</td>\n",
              "      <td>Edward Maya</td>\n",
              "      <td>1AguHaKOuggrVTebp7cZEI</td>\n",
              "      <td>02-02-2010</td>\n",
              "      <td>False</td>\n",
              "      <td>0.586</td>\n",
              "      <td>0.03460</td>\n",
              "      <td>0.799</td>\n",
              "      <td>184573</td>\n",
              "      <td>0.783</td>\n",
              "      <td>0.018600</td>\n",
              "      <td>-3.896</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0757</td>\n",
              "      <td>0</td>\n",
              "      <td>64</td>\n",
              "      <td>0.0322</td>\n",
              "      <td>127.041</td>\n",
              "      <td>2010</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>882</th>\n",
              "      <td>Black and Yellow</td>\n",
              "      <td>Wiz Khalifa</td>\n",
              "      <td>5A6OHHy73AR5tLxgTc98zz</td>\n",
              "      <td>29-03-2011</td>\n",
              "      <td>True</td>\n",
              "      <td>0.538</td>\n",
              "      <td>0.06460</td>\n",
              "      <td>0.684</td>\n",
              "      <td>217666</td>\n",
              "      <td>0.834</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-4.524</td>\n",
              "      <td>2</td>\n",
              "      <td>0.2710</td>\n",
              "      <td>0</td>\n",
              "      <td>75</td>\n",
              "      <td>0.0675</td>\n",
              "      <td>164.020</td>\n",
              "      <td>2011</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>882 rows × 19 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "                                              name  ...  year\n",
              "0                            Old Town Road - Remix  ...  2019\n",
              "1                                          bad guy  ...  2019\n",
              "2                                         Señorita  ...  2019\n",
              "3                                          7 rings  ...  2019\n",
              "4    Sunflower - Spider-Man: Into the Spider-Verse  ...  2019\n",
              "..                                             ...  ...   ...\n",
              "878                                  Sweat - Remix  ...  2011\n",
              "879                                    Springsteen  ...  2011\n",
              "880                                      Honey Bee  ...  2011\n",
              "881                       Stereo Love - Radio Edit  ...  2010\n",
              "882                               Black and Yellow  ...  2011\n",
              "\n",
              "[882 rows x 19 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 40
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "cUw6HVVTNvXG"
      },
      "source": [
        "**Group the songs by year and explicit values and display the average popularity of song in each group**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 457
        },
        "id": "bBVb_NB3NzJY",
        "outputId": "b3da9597-02c0-4e4a-c375-ff855351a514"
      },
      "source": [
        "df2.groupby(df2.year).agg('count')"
      ],
      "execution_count": 50,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>name</th>\n",
              "      <th>artists</th>\n",
              "      <th>id</th>\n",
              "      <th>release_date</th>\n",
              "      <th>explicit</th>\n",
              "      <th>valence</th>\n",
              "      <th>acousticness</th>\n",
              "      <th>danceability</th>\n",
              "      <th>duration_ms</th>\n",
              "      <th>energy</th>\n",
              "      <th>instrumentalness</th>\n",
              "      <th>loudness</th>\n",
              "      <th>key</th>\n",
              "      <th>liveness</th>\n",
              "      <th>mode</th>\n",
              "      <th>popularity</th>\n",
              "      <th>speechiness</th>\n",
              "      <th>tempo</th>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>year</th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>2009</th>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2010</th>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "      <td>29</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2011</th>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2012</th>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "      <td>109</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2013</th>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "      <td>76</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2014</th>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "      <td>96</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2015</th>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2016</th>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2017</th>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "      <td>105</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2018</th>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "      <td>88</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019</th>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "      <td>103</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2020</th>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "      <td>25</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "      name  artists   id  release_date  ...  mode  popularity  speechiness  tempo\n",
              "year                                    ...                                      \n",
              "2009     1        1    1             1  ...     1           1            1      1\n",
              "2010    29       29   29            29  ...    29          29           29     29\n",
              "2011    76       76   76            76  ...    76          76           76     76\n",
              "2012   109      109  109           109  ...   109         109          109    109\n",
              "2013    76       76   76            76  ...    76          76           76     76\n",
              "2014    96       96   96            96  ...    96          96           96     96\n",
              "2015    88       88   88            88  ...    88          88           88     88\n",
              "2016    88       88   88            88  ...    88          88           88     88\n",
              "2017   105      105  105           105  ...   105         105          105    105\n",
              "2018    88       88   88            88  ...    88          88           88     88\n",
              "2019   103      103  103           103  ...   103         103          103    103\n",
              "2020    25       25   25            25  ...    25          25           25     25\n",
              "\n",
              "[12 rows x 18 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 50
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 143
        },
        "id": "OomEraXeOR0f",
        "outputId": "d2f2bfd5-b1c4-4899-e169-34286881b0d0"
      },
      "source": [
        "df2.groupby(df2.explicit).agg('count')"
      ],
      "execution_count": 44,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>name</th>\n",
              "      <th>artists</th>\n",
              "      <th>id</th>\n",
              "      <th>release_date</th>\n",
              "      <th>valence</th>\n",
              "      <th>acousticness</th>\n",
              "      <th>danceability</th>\n",
              "      <th>duration_ms</th>\n",
              "      <th>energy</th>\n",
              "      <th>instrumentalness</th>\n",
              "      <th>loudness</th>\n",
              "      <th>key</th>\n",
              "      <th>liveness</th>\n",
              "      <th>mode</th>\n",
              "      <th>popularity</th>\n",
              "      <th>speechiness</th>\n",
              "      <th>tempo</th>\n",
              "      <th>year</th>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>explicit</th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>False</th>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "      <td>673</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>True</th>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "      <td>211</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "          name  artists   id  ...  speechiness  tempo  year\n",
              "explicit                      ...                          \n",
              "False      673      673  673  ...          673    673   673\n",
              "True       211      211  211  ...          211    211   211\n",
              "\n",
              "[2 rows x 18 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 44
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "KwI06uEhPfuD"
      },
      "source": [
        "**Display the name of the artist with highest number of occcurance with the number of occcurances **"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "4WA6da1fPWyN",
        "outputId": "a289a286-dc1b-4171-b31b-66ae7d4ee603"
      },
      "source": [
        "selection = df2['artists'].describe()\n",
        "print(selection)"
      ],
      "execution_count": 52,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "count              884\n",
            "unique             371\n",
            "top       Taylor Swift\n",
            "freq                18\n",
            "Name: artists, dtype: object\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "1euJ-Y9EQDQc"
      },
      "source": [
        "**Display the song name, artist and release date of the song with popularity more than 50**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 424
        },
        "id": "EZi8TBF8QIXf",
        "outputId": "e824baa9-b709-452d-a54e-f93236d292d3"
      },
      "source": [
        "df2.loc[0:884,['name','artists','release_date','popularity']]"
      ],
      "execution_count": 74,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>name</th>\n",
              "      <th>artists</th>\n",
              "      <th>release_date</th>\n",
              "      <th>popularity</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>Old Town Road - Remix</td>\n",
              "      <td>Lil Nas X</td>\n",
              "      <td>21-06-2019</td>\n",
              "      <td>False</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>bad guy</td>\n",
              "      <td>Billie Eilish</td>\n",
              "      <td>29-03-2019</td>\n",
              "      <td>False</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>Señorita</td>\n",
              "      <td>Shawn Mendes</td>\n",
              "      <td>19-06-2019</td>\n",
              "      <td>False</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>7 rings</td>\n",
              "      <td>Ariana Grande</td>\n",
              "      <td>08-02-2019</td>\n",
              "      <td>False</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>Sunflower - Spider-Man: Into the Spider-Verse</td>\n",
              "      <td>Post Malone</td>\n",
              "      <td>06-09-2019</td>\n",
              "      <td>False</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>879</th>\n",
              "      <td>Springsteen</td>\n",
              "      <td>Eric Church</td>\n",
              "      <td>01-01-2011</td>\n",
              "      <td>False</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>880</th>\n",
              "      <td>Honey Bee</td>\n",
              "      <td>Blake Shelton</td>\n",
              "      <td>12-07-2011</td>\n",
              "      <td>False</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>881</th>\n",
              "      <td>Stereo Love - Radio Edit</td>\n",
              "      <td>Edward Maya</td>\n",
              "      <td>02-02-2010</td>\n",
              "      <td>False</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>882</th>\n",
              "      <td>Black and Yellow</td>\n",
              "      <td>Wiz Khalifa</td>\n",
              "      <td>29-03-2011</td>\n",
              "      <td>False</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>883</th>\n",
              "      <td>Earthquake (feat. Tinie Tempah)</td>\n",
              "      <td>Labrinth</td>\n",
              "      <td>02-04-2012</td>\n",
              "      <td>False</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>884 rows × 4 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "                                              name  ... popularity\n",
              "0                            Old Town Road - Remix  ...      False\n",
              "1                                          bad guy  ...      False\n",
              "2                                         Señorita  ...      False\n",
              "3                                          7 rings  ...      False\n",
              "4    Sunflower - Spider-Man: Into the Spider-Verse  ...      False\n",
              "..                                             ...  ...        ...\n",
              "879                                    Springsteen  ...      False\n",
              "880                                      Honey Bee  ...      False\n",
              "881                       Stereo Love - Radio Edit  ...      False\n",
              "882                               Black and Yellow  ...      False\n",
              "883                Earthquake (feat. Tinie Tempah)  ...      False\n",
              "\n",
              "[884 rows x 4 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 74
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "rw49nN-JWX3z"
      },
      "source": [
        "**Read the dataset spotify_data_2021-1**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "sLTUSNBvWbPh",
        "outputId": "e7e90b54-dd64-45f0-bc13-49257e8e890a"
      },
      "source": [
        "df2 = pd.read_csv(\"/content/spotify_data_2021_1.csv\")\n",
        "print(df2)"
      ],
      "execution_count": 77,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "                                                 name  ...    tempo\n",
            "0                                          Easy On Me  ...  141.981\n",
            "1                           LA FAMA (with The Weeknd)  ...  136.010\n",
            "2                                               Woman  ...  107.998\n",
            "3                                           Oh My God  ...   88.098\n",
            "4                                         ESCAPE PLAN  ...  154.120\n",
            "..                                                ...  ...      ...\n",
            "95                                  WHOLE LOTTA MONEY  ...   81.008\n",
            "96  Not In The Mood (feat. Fivio Foreign & Kay Flock)  ...  141.908\n",
            "97                                          positions  ...  144.005\n",
            "98                   death bed (coffee for your head)  ...  144.026\n",
            "99                                             DÁKITI  ...  109.928\n",
            "\n",
            "[100 rows x 18 columns]\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "4IwTNS0qXHrH"
      },
      "source": [
        "**The given datasets have the same number of columns? Use shape function. Before concatenating check for the missing column ( the column that is there in spotify_data_2011-2020.csv but not in spotify_data_2021-1.csv)**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "k2vXnu40X8-1"
      },
      "source": [
        ""
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "8srHyq7MX92e"
      },
      "source": [
        "**Create the missing column in the new dataset. Find the hint at the end of the Notebook**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "5dSpqhXAYFWB"
      },
      "source": [
        ""
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "6_BFnOhPYFuw"
      },
      "source": [
        "**Concatenate the new songs of 2021 with the existing dataset**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "QF5edJBwYJ2s"
      },
      "source": [
        ""
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "7V_JBLqXYLss"
      },
      "source": [
        "**Arrange the songs with increasing order with respect to energy**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "r53HpUq4YQaF"
      },
      "source": [
        ""
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "bISWWpLvYSQ3"
      },
      "source": [
        "**The values in release date column is in the format dd-mm-yyyy extract the year from each of the value to vcreate a new column**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "UYyHv3HxYa5S"
      },
      "source": [
        ""
      ],
      "execution_count": null,
      "outputs": []
    }
  ]
}