DS104-Data-Wrangling-and-Visualization/DS104-L8-Complex-Visualizations.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "50e6ddbb-52d3-4a02-9b69-100a4181e3b0",
   "metadata": {},
   "source": [
    "# DS104 Data Wrangling and Visualization, Lesson Eight : More Complex Visualizations"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "d1bd4bfc-9b15-4b80-87b4-b8b60eb56371",
   "metadata": {},
   "source": [
    "### Table of Contents <a class=\"anchor\" id=\"DS104L8_toc\"></a>\n",
    "\n",
    "* [Table of Contents](#DS104L8_toc)\n",
    "    * [Page 1 - Introduction](#DS104L8_page_1)\n",
    "    * [Page 2 - Visualization History](#DS104L8_page_2)\n",
    "    * [Page 3 - Complex Visualizations Today](#DS104L8_page_3)\n",
    "    * [Page 4 - Dashboards](#DS104L8_page_4)\n",
    "    * [Page 5 - With Great Visualizations Come Great Responsibility](#DS104L8_page_5)\n",
    "    * [Page 6 - Dynamic Charts](#DS104L8_page_6)\n",
    "    * [Page 7 - Dynamic Chart Examples](#DS104L8_page_7)\n",
    "    * [Page 8 - Dynamic Charts in MS Excel](#DS104L8_page_8)\n",
    "    * [Page 9 - Key Terms](#DS104L8_page_9)\n",
    "    * [Page 10 - Lesson 8: More Complex Visualizations Practice Hands-On](#DS104L8_page_10)\n",
    "    * [Page 11 - Lesson 8: More Complex Visualizations Practice Hands-On Solution](#DS104L8_page_11)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "ef5a8c65-ed48-4354-a257-e01b0fd733d4",
   "metadata": {},
   "source": [
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n",
    "\n",
    "# Page 1 - Introduction<a class=\"anchor\" id=\"DS104L8_page_1\"></a>\n",
    "\n",
    "[Back to Top](#DS104L8_toc)\n",
    "\n",
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "id": "6817ce9c-f633-4d92-a54e-c9d4260c179b",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "\n",
       "        <iframe\n",
       "            width=\"720\"\n",
       "            height=\"480\"\n",
       "            src=\"https://player.vimeo.com/video/388134109\"\n",
       "            frameborder=\"0\"\n",
       "            allowfullscreen\n",
       "        ></iframe>\n",
       "        "
      ],
      "text/plain": [
       "<IPython.lib.display.VimeoVideo at 0x7fb300081490>"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from IPython.display import VimeoVideo\n",
    "# Tutorial Video Name: Infographics\n",
    "VimeoVideo('388134109', width=720, height=480)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "5b6ad526-95fa-43c4-bc43-1fe807708ed3",
   "metadata": {},
   "source": [
    "\n",
    "The transcript for the above overview video **[is located here](https://repo.exeterlms.com/documents/V2/DataScience/Video-Transcripts/DSO104L08overview.zip)**.\n",
    "\n",
    "# Introduction\n",
    "\n",
    "You have gone over some basic and intermediate visualizations in the past several lessons. At this point, you will learn about more complex visualizations and their limitations. It is easy to get carried away with more complex visualizations. Sometimes, the additions are incredibly helpful in advancing the narrative, but other times they just get in the way of themselves.\n",
    "\n",
    "There aren't a lot of rules about what is appropriate, and what is too much. It is a subjective call. The only rule of thumb is that 'more' is not always necessarily 'better.' The purpose of this lesson is to get your creative juices flowing a bit.\n",
    "\n",
    "By the end of this lesson, you should be able to: \n",
    "\n",
    "* Understand the historical context behind complex data visualizations\n",
    "* Interpret a wide variety of modern visuals\n",
    "* Recognize the importance and usage of dashboards\n",
    "* Affirm the importance of data integrity\n",
    "* Comprehend the possibilities of dynamic charts in MS Excel\n",
    "\n",
    "This lesson will culminate with a hands on in which you will critique visualizations you have found, to better engage your analytical and creative mind.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "7990ac7a-5a2f-4744-af14-1b7e385ea484",
   "metadata": {},
   "source": [
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n",
    "\n",
    "# Page 2 - Visualization History<a class=\"anchor\" id=\"DS104L8_page_2\"></a>\n",
    "\n",
    "[Back to Top](#DS104L8_toc)\n",
    "\n",
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "612429df-e4ef-4d85-8460-5bc8914079c3",
   "metadata": {},
   "source": [
    "# Visualization History\n",
    "\n",
    "There are a few names to know when it comes to visualization. The first is Charles Minard.\n",
    "\n",
    "![The portrait of a person. The picture is labeled science museum pictorial or science and society picture library.](Media/L08-02.png)\n",
    "\n",
    "Minard was a French civil engineer. He is recognized for his pioneering work in civil engineering, statistics, and visualization. Minard was not burdened with the history of those who had gone before him, nor with computers, software, and data tables. The stuff he came up with is truly amazing, even today. Here is some of his work:\n",
    "\n",
    "![A graph depicts the plot of the temperature of Russia from the year 1812 to 1813.](Media/L08-01.png)\n",
    "\n",
    "This is in French, so it is tough to interpret at first glance. But it has to do with French troop movements as Napoleon invaded Russia. It starts at the border, and ends in Moscow on the right side.\n",
    "\n",
    "With that brief prompt, take a look at the chart for a minute or two, and see if you can already deduce some tidbits of what is being displayed.\n",
    "\n",
    "Here is the English translation of the text provided on the graph:\n",
    "\n",
    "* _Figurative Map of the successive losses in men of the French Army in the Russian campaign 1812-1813._\n",
    "* _Drawn by M. Minard, Inspector General of Bridges and Roads (retired). Paris, November 20, 1869._\n",
    "* _The numbers of men present are represented by the widths of the colored zones at a rate of one millimeter for every ten thousand men; they are further written across the zones. The red designates the men who enter Russia, the black those who leave it. — The information which has served to draw up the map has been extracted from the works of M.M. Thiers, de Ségur, de Fezensac, de Chambray and the unpublished diary of Jacob, the pharmacist of the Army since October 28th._\n",
    "* _In order to better judge with the eye the diminution of the army, I have assumed that the troops of Prince Jérôme and of Marshal Davout, who had been detached at Minsk and Mogilev and have rejoined near Orsha and Vitebsk, had always marched with the army._\n",
    "\n",
    "In this one graphic, Minard displayed six types of data:\n",
    "\n",
    "* The number of Napoleon's troops are indicated by the 'thickness' of the lines where each millimeter represents 10,000 troops.\n",
    "* Distance traveled\n",
    "* Temperature\n",
    "* Latitude and longitude\n",
    "* Direction\n",
    "* Location at particular designated designates\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "832358fd-55fa-420a-8aa2-46fbf2097986",
   "metadata": {},
   "source": [
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n",
    "\n",
    "# Page 3 - Complex Visualizations Today<a class=\"anchor\" id=\"DS104L8_page_3\"></a>\n",
    "\n",
    "[Back to Top](#DS104L8_toc)\n",
    "\n",
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f564e3e7-3a7f-4936-b3a3-2e0a9ab78512",
   "metadata": {},
   "source": [
    "# Complex Visualizations Today\n",
    "\n",
    "What follows are several examples of typical complex charts seen today. It is interesting to note that as web capabilities explode, finding charts that move or respond to user input are now readily available as well.  \n",
    "\n",
    "---\n",
    "\n",
    "## 3D Scatterplot\n",
    "\n",
    "![Three-dimensional plot of the comparison of total energy, gas energy, and density. The x-axis represents the gas energy, the y-axis represents the density, and the z-axis represents total energy.](Media/L08-03.png)\n",
    "\n",
    "This is an example of a 3D scatterplot, with a fourth variable being displayed in color. Graphs such as this one are good for creating a general sense of what is happening, but if you want to draw the reader's attention to minutiae, this is usually not the best vehicle.\n",
    "\n",
    "<div class=\"panel panel-danger\">\n",
    "    <div class=\"panel-heading\">\n",
    "        <h3 class=\"panel-title\">Caution!</h3>\n",
    "    </div>\n",
    "    <div class=\"panel-body\">\n",
    "        <p>Although these 3D plots look cool, some new research shows that they may be harder to interpret and use than their 2D counterparts.</p>\n",
    "    </div>\n",
    "</div>\n",
    "\n",
    "---\n",
    "\n",
    "## Tornado Charts\n",
    "\n",
    "Below is an interesting graphic, because it repeats the information on the top row, and the bottom row is a drill-down by region of the data shown in the top row.\n",
    "\n",
    "![A page has a caption on top that reads, U S population trends 2000 census. Three bar chart labeled population pyramid, alternative view, and population by region. A box labeled select census year is placed on the right side of the page. The text field reads, 2000 census. Two boxes labeled male and female.](Media/L08-09.png)\n",
    "\n",
    "These types of graphs are called *tornado charts* for obvious reasons. A tornado chart is a way to describe differing frequencies or means by a categorical variable. Notice that the blue bars represent males, and the pink bars represent females, which is a great visualization tactic because it aligns with typical population norms. The vertical scale is for age, with oldest being at the top and youngest being at the bottom.\n",
    "\n",
    "There is so much to see in this visualization. The data are from the 2000 census, so the 'bubble' from age 35 to 55 represents the baby boomers. Near the top of the graph, the bars get shorter as mortality starts to kick in.\n",
    "\n",
    "Did you notice that the pink bars are longer than the blue bars at the top of the graph, but shorter early on? It is a fact that newborns aren't 50-50 boys-girls. Boys outnumber girls at birth, about 51-49 in the U.S. But boys have a higher mortality rate throughout their lives, and life expectancy is also shorter for boys.\n",
    "\n",
    "According to the graph, balance is reached somewhere in the 30-35 age bucket. It would be interesting to investigate the reasons behind this, if it holds true for each region, and whether it is the same in other countries. \n",
    "\n",
    "---\n",
    "\n",
    "## Poppy Diagram\n",
    "\n",
    "The below graph is unusual. It has a bunch of great information on war casualties, showing where the war was fought, how long it lasted, and what the death toll was. A poppy is often used in remembrance of those who have died in war, making this graphic appropriate to the subject matter, eye-catching, and elegant.  It adheres to one of the great principles of visualization, which is to keep things simple with lots of white space as well.\n",
    "\n",
    "![Flowers of different sizes are plotted on a graph. Four flowers are labeled first world war, second world war, Bangladesh war, and Israel versus Palestine.](Media/L08-12.png)\n",
    "\n",
    "---"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "bb1aade2-59af-4cbc-b5ed-da31e39f266d",
   "metadata": {},
   "source": [
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n",
    "\n",
    "# Page 4 - Dashboards<a class=\"anchor\" id=\"DS104L8_page_4\"></a>\n",
    "\n",
    "[Back to Top](#DS104L8_toc)\n",
    "\n",
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "eba2ed6e-98dd-43f7-8761-6ecc9a13af08",
   "metadata": {},
   "source": [
    "# Dashboards\n",
    "\n",
    "*Dashboards* provide a number of business metrics at once and are usually used with ongoing or reoccurring metrics that need to be briefed regularly - often monthly or quarterly.  The data shown on dashboards often indicate the health of a particular company, program, or initiative and can include data that measures outcomes as well as data that measures throughput, though throughput metrics are often more common. For this reason, dashboards often follow a red/amber/green color scheme to indicate status, with red being \"in trouble\" amber being \"potentially problematic\" and green being \"hunky dory.\" Managers like dashboards, because they can get a general feel of what is going on with the business at a glance.\n",
    "\n",
    "A good dashboard follows the same principles for infographic design: they are simple and easy to read, use, and interpret.  However, unlike infographics, dashboards tend to rely on more traditional data visualizations like bar and pie charts or line graphs. With work, dashboards can be automated to populate something beautifully designed with all the data on a regular basis, without the labor-intensive effort that a one-time infographic requires.  \n",
    "\n",
    "---\n",
    "\n",
    "## A Dashboard Example\n",
    "\n",
    "This is a great visualization tool. The subject matter is some sort of internet traffic monitor. The stacked area graph breaks down the types of traffic on a daily basis. The grey vertical areas are particularly helpful, because so much of what you do is dependent on whether it is a weekend or not.\n",
    "\n",
    "In this case, it seems like traffic tends to dip a bit during the weekend days, but there are weekdays when it dips, too; weekends do not fully explain what is happening with the trend.\n",
    "\n",
    "Pie charts can provide some helpful information here - mostly that Google is the most popular item - but that can easily be seen by the bar charts, too.\n",
    "\n",
    "Grouping traffic type by color is helpful. It is not clear what the short vertical black lines in the bar chart area are about. This dashboard needs a bit more explanation to fully know what is going on here.\n",
    "\n",
    "![A page has a heading that reads, web analytics: traffic sources from April 1st to April 23rd. A pie chart is divided into eight parts. The major part is labeled Google and the least part is labeled Facebook. The other parts are Bing, direct traffic, twitter, reddit, stumble upon, and LinkedIn. The details of referral sites, search engines, and direct traffic. A graph depicts the plot of April against visits. The x-axis represents April and the y-axis represents visits.](Media/L08-07.png)\n",
    "\n",
    "---\n",
    "\n",
    "## A Second Dashboard Example\n",
    "\n",
    "The below dashboard is also pretty good. It is a monitor of site traffic for a particular website. A daily trend, days of the week, and actual totals of hits is also shown. If your business is focused on internet traffic, a dashboard like this is going to convey a lot of information.\n",
    "\n",
    "In the upper right hand corner of the dashboard, there is a graph that looks like a speedometer. This is common visualization in dashboards, and is often used in conjunction with a red/amber/green color scheme.\n",
    "\n",
    "![A page titled Google analytics has seven panels. The first panel displays a graph labeled site traffic in the last thirty days. The second panel labeled sessions in the last 30 days 5.05k. The third panel labeled Google analytics. The fourth panel displays a speedometer labeled 124. The fifth panel labeled average daily usage 177. The sixth panel labeled new user percentage growth 30.42-percent. The sixth panel displays a pie chart labeled hits by a browser.](Media/L08-08.png)\n",
    "\n",
    "---\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "ead4ad3c-2fe6-457e-8924-1410e951bebd",
   "metadata": {},
   "source": [
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n",
    "\n",
    "# Page 5 - With Great Visualizations Come Great Responsibility<a class=\"anchor\" id=\"DS104L8_page_5\"></a>\n",
    "\n",
    "[Back to Top](#DS104L8_toc)\n",
    "\n",
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "bbbc06a2-e702-47a1-942f-cbcbe31221a7",
   "metadata": {},
   "source": [
    "# With Great Visualizations Come Great Responsibility\n",
    "\n",
    "There is an old saying that goes: \"There are liars, damn liars, and statisticians.\" There is a lot of power available in displaying data in a visualization format. If the person creating the graphs has an agenda, or wants to sway the readers, it is not hard to do. You don't even have to report false data; there are plenty of ways to display actual data and give the wrong impression.\n",
    "\n",
    "<div class=\"panel panel-success\">\n",
    "    <div class=\"panel-heading\">\n",
    "        <h3 class=\"panel-title\">Additional Info!</h3>\n",
    "    </div>\n",
    "    <div class=\"panel-body\">\n",
    "        <p>Interested in catching all the ways data can be manipulated to false ends, so you can avoid the traps and call out others who may not have your company's best interests at heart? Check out <a href=\"https://www.horace.org/blog/wp-content/uploads/2012/05/How-to-Lie-With-Statistics-1954-Huff.pdf\">this seminal work called \"How to Lie with Statistics.\"</a> The orginal is free in a PDF format, though new editions have been published and are available from commercial retailers. </p>\n",
    "    </div>\n",
    "</div>\n",
    "\n",
    "---\n",
    "\n",
    "## Responsibilities of the Data Scientist\n",
    "\n",
    "A data scientist has a few responsibilities related to responsible data reporting:\n",
    "\n",
    "* Leave your biases at the door. The quickest way for a data scientist to lose credibility is to report data that is purposely misleading.\n",
    "* Do not allow anyone, even your manager, to force you to present the data in a way that supports his or her agenda. Your integrity means everything as a data scientist.\n",
    "* Be on the lookout for others pulling a fast one, and point it out. This can be an awkward situation, so tread lightly. \n",
    "* Be committed to allowing the data to speak for themselves. In a sense, you are simply the translator and messenger.\n",
    "\n",
    "---\n",
    "\n",
    "## A Misleading Data Example\n",
    "\n",
    "45 years ago, Cal-Berkeley was sued for sex discrimination. Data indicated that the graduate school had accepted 44% of male applicants, and only 35% of female applicants. But when researchers scrutinized the data a bit more, they found that there was actually some bias in favor of women! Something called *Simpson's paradox* was at play here. Simpson's Paradox occurs when the observed phenomena is different from the explained phenomena after a lurking explanatory variable is taken into account.\n",
    "\n",
    "In the case of Cal-Berkeley, the overall fact was true: more men (as a percentage of applicants) were accepted to grad school than women. In this case, the lurking variable is the programs to which these men and women applied. It turns out that more men applied to graduate programs in science, whereas more women applied to graduate programs in the humanities. The sciences require special technical skills, but they accepted a large percentage of applicants. On the other hand, the humanities only required a standard undergrad curriculum, but they also had fewer slots. When the department to which they applied was accounted for, department by department the women's acceptance rates are actually higher overall than the men's acceptance rates. The difference was small, but real.\n",
    "\n",
    "---\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "dd9e3b8a-9224-447f-8cf7-5035cae86421",
   "metadata": {},
   "source": [
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n",
    "\n",
    "# Page 6 - Dynamic Charts<a class=\"anchor\" id=\"DS104L8_page_6\"></a>\n",
    "\n",
    "[Back to Top](#DS104L8_toc)\n",
    "\n",
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "id": "2683976b-d8ff-44be-a5ac-acb3f9824cad",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "\n",
       "        <iframe\n",
       "            width=\"720\"\n",
       "            height=\"480\"\n",
       "            src=\"https://player.vimeo.com/video/241243111\"\n",
       "            frameborder=\"0\"\n",
       "            allowfullscreen\n",
       "        ></iframe>\n",
       "        "
      ],
      "text/plain": [
       "<IPython.lib.display.VimeoVideo at 0x7fb2f0059d60>"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from IPython.display import VimeoVideo\n",
    "# Tutorial Video Name: Infographics\n",
    "VimeoVideo('241243111', width=720, height=480)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "a81e2098-28ef-4ff5-a155-afe824de4323",
   "metadata": {},
   "source": [
    "# Dynamic Charts\n",
    "\n",
    "Data visualization took a huge step forward when the notion of dynamic charts came into existence. The early dynamic charts consisted of graphs that would automatically update themselves as new data were added. This quickly evolved into charts with animation, leading to some fascinating and very creative displays of data. In learning dynamic charts, you will wander around the web and check out some of these displays of data that seem to live and breathe. The purpose here is to get some of your creative juices flowing, and open your eyes to what is being done out there on the cutting edge of the world of visualization.\n",
    "\n",
    "A *dynamic chart* is anything that has a user interface, or automatically updates with added data, or has animation. \n",
    "\n",
    "---\n",
    "\n",
    "## Dr. Rosling\n",
    "\n",
    "Another great name in data visualization is Hans Rosling. \n",
    "\n",
    "![A person addressing the audience by standing at a podium.](Media/L09-04.png)\n",
    "\n",
    "Dr. Hans Rosling was a Swedish physician and professor of international health. Dr. Rosling used a rare combination of charisma, knowledge, data visualization, dynamic charts, and interesting subject matter to become one of the world's greatest communicators. He pioneered a group called Gapminder, which brings the ability to create really cool data visualizations to everyone.\n",
    "\n",
    "**[This video](https://www.ted.com/talks/hans_rosling_shows_the_best_stats_you_ve_ever_seen)** is long, but will hopefully impact you. At worst, it will get you to see some things in a way that maybe you haven't thought of before. At best, it might just change your world view. \n",
    "\n",
    "Dr. Rosling did many presentations similar to this one. He believed there is a lot of misconception out there in the world regarding mortality, health, and wealth. He tries to clear up a lot of the misconceptions, but he seems to do it in such a way without an agenda. He touches on a lot of topics that are hot buttons with many, and are politicized all over the world in order for some to try and advance their agenda.\n",
    "\n",
    "The purpose for having you watch this video is two-fold:\n",
    "\n",
    "* First, you should get a sense of the potential dynamic charts have to communicate ideas clearly and succinctly, much better than a series of static charts would have.\n",
    "* Second, you should get a feel of how important it is to let data do the talking. Dr Rosling is making observations and predictions based on data, and not on opinion.\n",
    "\n",
    "<div class=\"panel panel-success\">\n",
    "    <div class=\"panel-heading\">\n",
    "        <h3 class=\"panel-title\">Learn how to do interactive plotting in R!</h3>\n",
    "    </div>\n",
    "    <div class=\"panel-body\">\n",
    "        <p>You may want to watch this <a href=\"https://vimeo.com/434212367\"> recorded live workshop </a> that goes over how to use ggplotly to make your normal R ggplots interactive! </p>\n",
    "    </div>\n",
    "</div>\n",
    "\n",
    "---\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "42cb7d8a-aced-42e5-ac24-32acf8c95473",
   "metadata": {},
   "source": [
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n",
    "\n",
    "# Page 7 - Dynamic Chart Examples<a class=\"anchor\" id=\"DS104L8_page_7\"></a>\n",
    "\n",
    "[Back to Top](#DS104L8_toc)\n",
    "\n",
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "cf0debaf-5fae-4035-8e7d-ae62e62456cb",
   "metadata": {},
   "source": [
    "# Dynamic Chart Examples\n",
    "\n",
    "Now that you have had a chance to look at some of Dr. Rosling's work, take a look at other dynamic visualizations available on the web. Remember that many of these are the result of some pretty slick web development along with a desire to communicate data. Most of these visualizations were not built in 30 minutes. But their impact made them worth the effort. This page will walk you through some interesting dynamic charts that are out there.\n",
    "\n",
    "---\n",
    "\n",
    "## Wind Map\n",
    "\n",
    "**[This is a great dynamic visualization](https://hint.fm/wind/)** that combines a heat map of sorts with interactivity. Take your mouse and hover over any location in the U.S., and you will see what the wind speed and direction is at that location in real time.\n",
    "\n",
    "---\n",
    "\n",
    "## Washington Wizards\n",
    "\n",
    "You may not be a basketball fan. Even if you are, you may not be a Wizards fan. But **[this is a fantastic visualization](https://www.washingtonpost.com/wp-srv/special/sports/wizards-shooting-stars/)** for the Wizards from the 2013-2014 season. Open it up, and take it for a drive. \n",
    "\n",
    "---\n",
    "\n",
    "## Americans and Their Moving Patterns\n",
    "\n",
    "**[This is another tool](https://www.nytimes.com/interactive/2014/08/13/upshot/where-people-in-each-state-were-born.html?abt=0002&abg=0#Arizona)** brought to you by the people at the NY Times. They have taken what is probably mountains of data over 120 years, and compiled it into a visualization tool where you can select the state, select whether you want to look at migration into or out of that state, and then see what has been happening for the past 120 years. The amount of information available here is staggering.\n",
    "\n",
    "---\n",
    "\n",
    "### Who's in the Office?\n",
    "\n",
    "**[This next visualization](https://www.npr.org/sections/money/2014/08/27/343415569/whos-in-the-office-the-american-workday-in-one-graph?/templates/story/story_php=)** can be used to compare the typical work day for various job categories.\n",
    "\n",
    "As an interactive user, you can either use the pulldown to select a jobs category, or you can just hover over the graph and select the curve you want to look at to see what typical hours are.\n",
    "\n",
    "It is interesting to note that a lot of people who want to open their own business think a restaurant is the way to go. If you pull open the 'Food Preparation and Serving' sector, it may surprise you to see that most people in the restaurant business work a lot of nights. This graph doesn't show it, but they work a lot of weekends, too. Unless you are willing to give up that time, you should probably pick something else to do.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "d7b3f800-0a14-4d13-8c32-390965c537ca",
   "metadata": {},
   "source": [
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n",
    "\n",
    "# Page 8 - Dynamic Charts in MS Excel<a class=\"anchor\" id=\"DS104L8_page_8\"></a>\n",
    "\n",
    "[Back to Top](#DS104L8_toc)\n",
    "\n",
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "4597e4b4-ce22-448d-843e-eab5ba74a9c4",
   "metadata": {},
   "source": [
    "# Dynamic Charts in MS Excel\n",
    "\n",
    "Although you are not required to create any dynamic charts of your own, if you are really craving it, a very simple way to get started is with MS Excel.  This page is meant to give you an idea of what is possible in MS Excel, and you can choose to watch additional material on the details if you'd like.\n",
    "\n",
    "---\n",
    "\n",
    "## First Example\n",
    "\n",
    "Here are a few examples of what MS Excel refers to as a dynamic chart:\n",
    "\n",
    "![Snapshot of a sheet displaying a table of data and a corresponding bar chart. The table is represented in two columns and nine-row entries. The column headings are labeled date and sales. The bar chart represents the date on the x-axis and sales on the y-axis. The bar chart has a caption on top that reads, sales for the last six months. The bar for Feb 2014 crosses 1200 on the y-axis.](Media/L09-01.png)\n",
    "\n",
    "This is a clever use of inputs from the user. This chart is dynamic in that it allows a user to change the entry in cell N1, and determine how many months worth of data they want to include in the graph. Changing the entry in cell N1 to 3 (for example) will modify the amount of the table in columns A and B that are included in the graph. It also modifies a cell (not shown, off to the right of the shown portion) from which the graph title is taken. If cell N1 is changed to 3, then the graph label will read ```Sales for the last **3** Months```.\n",
    "\n",
    "<div class=\"panel panel-success\">\n",
    "    <div class=\"panel-heading\">\n",
    "        <h3 class=\"panel-title\">Additional Info!</h3>\n",
    "    </div>\n",
    "    <div class=\"panel-body\">\n",
    "        <p>If you would like to build a chart like this, refer to this <a href=\"https://www.youtube.com/watch?v=a8Dboi42_ys\">YouTube video.</a></p>\n",
    "    </div>\n",
    "</div>\n",
    "\n",
    "---\n",
    "\n",
    "## A Second Example\n",
    "\n",
    "Here is another dynamic chart that can be created in MS Excel.\n",
    "\n",
    "![Snapshot of a sheet displaying a table of data and a corresponding graph. The table is represented in four columns and nine-row entries. The column headings are labeled year, shirts, pants, and shoes. The graph represents the year on the x-axis and sales on the y-axis. The bar chart has a caption on top that reads, shoes.](Media/L09-02.png)\n",
    "\n",
    "In this graph, a table to the left shows sales figures for Shirts, Pants, and Shoes for an eleven-year period from 2003 to 2013. The graph is set up to show one article of clothing at a time, selected using the radio buttons at the bottom of the graph. Again, this is a clever trick where the creator of the graph has set up a dummy table which is out of view. When the user selects one of the radio buttons, the dummy table is modified so that the two 'not selected' columns from the original data table are filled with N/A's. This modifies the graph so that only the selected curve is shown.\n",
    "\n",
    "In reality, this graph always has all three curves on it. The kicker is that two of the three curves are invisible. This is a pretty clever approach.\n",
    "\n",
    "<div class=\"panel panel-success\">\n",
    "    <div class=\"panel-heading\">\n",
    "        <h3 class=\"panel-title\">Additional Info!</h3>\n",
    "    </div>\n",
    "    <div class=\"panel-body\">\n",
    "        <p>If you would like to build a chart like this, refer to this <a href=\"https://www.youtube.com/watch?v=2pF7sKR8wRQ\">YouTube video.</a></p>\n",
    "    </div>\n",
    "</div>\n",
    "\n",
    "---\n",
    "\n",
    "## A Third Example\n",
    "\n",
    "Take a look at one more:\n",
    "\n",
    "![Snapshot of a sheet displaying a table of data and a corresponding graph. The table represented in two columns and nine row entries. The column headings are labeled January and sales. The graph represents the date on the x-axis and sales on the y-axis. The bar chart has a caption on top that reads, sales.](Media/L09-03.png)\n",
    "\n",
    "Here is an example of a scroll bar being used to interactively adjust how many points are shown on the graph. The scroll bar is in column C. If you have a graph like this, and took the mouse to pull down on the scroll bar, one by one new data points would appear on the graph. This is another clever little trick that uses the scroll bar to determine how many rows of the 'Sales' column appear on the table at the left.\n",
    "\n",
    "One note on this graph - Is it practical? Can you think of a situation where you would only want to show a portion of the available data starting from the left? Perhaps to build drama as you scrolled down slowly, and added points to the graph, but this dynamic chart may be less useful than the others. \n",
    "\n",
    "<div class=\"panel panel-success\">\n",
    "    <div class=\"panel-heading\">\n",
    "        <h3 class=\"panel-title\">Additional Info!</h3>\n",
    "    </div>\n",
    "    <div class=\"panel-body\">\n",
    "        <p>If you would like to build a chart like this, refer to this <a href=\"https://www.youtube.com/watch?v=AmarzW6TK90\">YouTube video.</a></p>\n",
    "    </div>\n",
    "</div>\n",
    "\n",
    "---\n",
    "\n",
    "## Summary\n",
    "\n",
    "* Data visualization has been used for 150 years to communicate information.\n",
    "* Complex visualization began to occur when different aspects of bar charts, trends, data maps, and scatterplots were organized into a single display of data.\n",
    "* Dashboards are not necessarily a complex visualization, but rather a group of visualizations compiled onto a single page.\n",
    "\n",
    "---\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "36943bcd-7e16-4af1-97d3-c09e81ae5e99",
   "metadata": {},
   "source": [
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n",
    "\n",
    "# Page 9 - Key Terms<a class=\"anchor\" id=\"DS104L8_page_9\"></a>\n",
    "\n",
    "[Back to Top](#DS104L8_toc)\n",
    "\n",
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "fdf2cdde-9447-49b5-8936-17d80f46b45e",
   "metadata": {},
   "source": [
    "# Key Terms\n",
    "\n",
    "Below is a list and short description of the important keywords learned in this lesson. Please read through and go back and review any concepts you do not fully understand. Great Work!\n",
    "\n",
    "<table class=\"table table-striped\">\n",
    "    <tr>\n",
    "        <th>Keyword</th>\n",
    "        <th>Description</th>\n",
    "    </tr>\n",
    "    <tr>\n",
    "        <td style=\"font-weight: bold;\" nowrap>Charles Minard</td>\n",
    "        <td>A data visualization pioneer.</td>\n",
    "    </tr>\n",
    "    <tr>\n",
    "        <td style=\"font-weight: bold;\" nowrap>Tornado Charts</td>\n",
    "        <td>A chart that looks like a tornado which has frequency or mean information split by category.</td>\n",
    "    </tr>\n",
    "    <tr>\n",
    "        <td style=\"font-weight: bold;\" nowrap>Dashboard</td>\n",
    "        <td>A compilation of visualized metrics that give information about the health of a company.  Often used routinely.</td>\n",
    "    </tr>\n",
    "    <tr>\n",
    "        <td style=\"font-weight: bold;\" nowrap>Simpson's Paradox</td>\n",
    "        <td>The information changes after you discover an additional explanatory variable.</td>\n",
    "    </tr>\n",
    "    <tr>\n",
    "        <td style=\"font-weight: bold;\" nowrap>Dynamic Chart</td>\n",
    "        <td>A graphic that has a user interface, is automatically updated with data, or has animation.</td>\n",
    "    </tr>\n",
    "    <tr>\n",
    "        <td style=\"font-weight: bold;\" nowrap>Dr. Hans Rosling</td>\n",
    "        <td>A dynamic chart pioneer.</td>\n",
    "    </tr>\n",
    "</table>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "2a0d02d5-04fa-4220-9637-d02c3b32dce5",
   "metadata": {},
   "source": [
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n",
    "\n",
    "# Page 10 - Lesson 8 Practice Hands-On <a class=\"anchor\" id=\"DS104L8_page_10\"></a>\n",
    "\n",
    "[Back to Top](#DS104L8_toc)\n",
    "\n",
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "8263fe3f-59a6-41ae-8ed6-5672336d390b",
   "metadata": {},
   "source": [
    "For your Lesson 8 Hands-On, you will examine and assess complex visualizations. This Hands-On will **not** be graded, but you are encouraged to complete it. The best way to become a great data scientist is to practice! When you are done, please submit one document with all of your findings for grading.\n",
    "\n",
    "<div class=\"panel panel-danger\">\n",
    "    <div class=\"panel-heading\">\n",
    "        <h3 class=\"panel-title\">Caution!</h3>\n",
    "    </div>\n",
    "    <div class=\"panel-body\">\n",
    "        <p>Do not submit your project until you have completed all requirements, as you will not be able to resubmit.</p>\n",
    "    </div>\n",
    "</div>\n",
    "\n",
    "---\n",
    "## Requirements\n",
    "\n",
    "For this skills mastery assessment, you will do something a bit different. Since software used to create complex visualizations is usually proprietary and not readily available, you won't be asked to create one from a given dataset.\n",
    "\n",
    "Instead, you should find four different complex visualizations on the web. Your task is to critique the visualizations you find. You should list both pros and cons for each visualization, and also talk about what you might do differently if you were creating the visualization.\n",
    "\n",
    "<div class=\"panel panel-danger\">\n",
    "    <div class=\"panel-heading\">\n",
    "        <h3 class=\"panel-title\">Caution!</h3>\n",
    "    </div>\n",
    "    <div class=\"panel-body\">\n",
    "        <p>Be sure to zip and submit your entire directory when finished!</p>\n",
    "    </div>\n",
    "</div>\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "cce45dc6-77a1-44db-b1cb-b4277954f0b5",
   "metadata": {},
   "source": [
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">\n",
    "\n",
    "# Page 11 - Lesson 8 Practice Hands-On Solution<a class=\"anchor\" id=\"DS104L8_page_11\"></a>\n",
    "\n",
    "[Back to Top](#DS104L8_toc)\n",
    "\n",
    "<hr style=\"height:10px;border-width:0;color:gray;background-color:gray\">"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "d11cb5ea-33df-4905-a7d2-612237587458",
   "metadata": {},
   "source": [
    "# Lesson 8 Hands-on Solution\n",
    "\n",
    "Below you will find the solution to the Lesson 9 hands-on.\n",
    "\n",
    "---\n",
    "\n",
    "## Visualization 1\n",
    "\n",
    "![A screen has two panels labeled mission area rollup and installation rollup. The mission area rollup displays the data in three columns labeled performance, financial, and risk. The installation rollup panel displays eleven rectangular bars divided into several boxes.](Media/visualization1.jpg)\n",
    "\n",
    "The red/amber/green color scheme of the data reporting makes this easy to understand what parts are going well and what parts aren't.  However, the rest of this graphic isn't doing well.  The vibrant blue background is colored a little too strongly, which takes away from the message and makes you blink a little.  There are a lot of unexplained acronyms here that many might not understand, unless you were fully embedded in the military. There is also no key, so the reader is unsure exactly what the direction of the arrows mean or what the bar graph on the right represents.\n",
    "\n",
    "---\n",
    "\n",
    "## Visualization 2\n",
    "\n",
    "![A window labeled Quartz open square bracket asterisk close square bracket. The screen displays a bar chart labeled means of standard length to intestine length ratio. The x-axis has two bars labeled Mackerel and Gurnard. The y-axis represents standard length: intestine ratio. The bar for Gurnard is the highest.](Media/visualization2.jpg)\n",
    "\n",
    "The graph above is very easy to read and understand, and keeps things pretty simple in grey and white.  However, it could benefit from a label on the x-axis, and depending on the audience, it probably makes sense to remove the error bars as well to keep things nice and clean.\n",
    "\n",
    "---\n",
    "\n",
    "## Visualization 3\n",
    "\n",
    "![A page has a title that reads, Swiss leaks, globalized finance. Mapping leaked HSBC amounts by country. A world map is depicted with shaded boxes to represent the Swiss leaks country-wise. All the countries are labeled near the shaded boxes.](Media/visualization3.jpg)\n",
    "\n",
    "Although this has the potential to be a compelling data visualization, it is very cluttered and suffers from a lack of focal point.  It has not defined the acronym of HSBC, so the audience may not exactly understand what is going on here, and this visualization may have made more sense if it had been superimposed over a map rather than just broken out spatially.  However, there is a key, the data used is labeled clearly, and this sticks to only three colors, all of which are pluses. \n",
    "\n",
    "---\n",
    "\n",
    "## Visualization 4\n",
    "\n",
    "![A graph depicts the plot of the year and mean sea level in centimeters. The x-axis represents years from 1992 to 2012 and the y-axis represents mean sea level with the range from 0 to 6. A globe is drawn on the graph and it is labeled extra water. A slope is plotted on the graph and the slope is labeled trend equals 3.2 mm increase per year.](Media/visualization4.jpg)\n",
    "\n",
    "This graph is not too bad! You can clearly understand that sea level seems to be increasing over time and you have an understanding where that water is going.  However, this graph is not labeled and does not have an x-axis either.  Further, it shows gridlines, and their removal would probably make this relatively busy graphic cleaner. It is also a little unclear exactly what the arrows are pointing to or for, so a litle extra explanation may be needed."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "bc11183f-b389-4afb-83e5-10f80412a581",
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.9.10"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}