inferential_statistics_1b.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Inferential Statistics Ib - Frequentism"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Learning objectives"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Welcome to the second Frequentist inference mini-project! Over the course of working on this mini-project and the previous frequentist mini-project, you'll learn the fundamental concepts associated with frequentist inference. The following list includes the topics you will become familiar with as you work through these two mini-projects:\n",
    "* the _z_-statistic\n",
    "* the _t_-statistic\n",
    "* the difference and relationship between the two\n",
    "* the Central Limit Theorem, its assumptions and consequences\n",
    "* how to estimate the population mean and standard deviation from a sample\n",
    "* the concept of a sampling distribution of a test statistic, particularly for the mean\n",
    "* how to combine these concepts to calculate confidence intervals and p-values\n",
    "* how those confidence intervals and p-values allow you to perform hypothesis (or A/B) tests"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Prerequisites"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "* what a random variable is\n",
    "* what a probability density function (pdf) is\n",
    "* what the cumulative density function is\n",
    "* a high-level sense of what the Normal distribution\n",
    "\n",
    "If these concepts are new to you, please take a few moments to Google these topics in order to get a sense of what they are and how you might use them.\n",
    "\n",
    "These two notebooks were designed to bridge the gap between having a basic understanding of probability and random variables and being able to apply these concepts in Python. This second frequentist inference mini-project focuses on a real-world application of this type of inference to give you further practice using these concepts. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the previous notebook, we used only data from a known normal distribution. You'll now tackle real data, rather than simulated data, and answer some relevant real-world business problems using the data."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Hospital medical charges"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Imagine that a hospital has hired you as their data analyst. An administrator is working on the hospital's business operations plan and needs you to help them answer some business questions. This mini-project, as well as the bootstrap and Bayesian inference mini-projects also found in this unit are designed to illustrate how each of the inferential statistics methods have their uses for different use cases. In this assignment notebook, you're going to use frequentist statistical inference on a data sample to answer the questions:\n",
    "* has the hospital's revenue stream fallen below a key threshold?\n",
    "* are patients with insurance really charged different amounts than those without?\n",
    "Answering that last question with a frequentist approach makes some assumptions, or requires some knowledge, about the two groups. In the next mini-project, you'll use bootstrapping to test that assumption. And in the final mini-project of the unit, you're going to create a model for simulating _individual_ charges (not a sampling distribution) that the hospital can use to model a range of scenarios."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We are going to use some data on medical charges obtained from [Kaggle](https://www.kaggle.com/easonlai/sample-insurance-claim-prediction-dataset). For the purposes of this exercise, assume the observations are the result of random sampling from our one hospital. Recall in the previous assignment, we introduced the Central Limit Theorem (CLT), and how it tells us that the distributions of sample statistics approach a normal distribution as $n$ increases. The amazing thing about this is that it applies to the sampling distributions of statistics that have been calculated from even highly non-normal distributions of data. Remember, also, that hypothesis testing is very much based on making inferences about such sample statistics. You're going to rely heavily on the CLT to apply frequentist (parametric) tests to answer the questions in this notebook."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import numpy as np\n",
    "import matplotlib.pyplot as plt\n",
    "from scipy.stats import t\n",
    "from numpy.random import seed\n",
    "medical = pd.read_csv('data/insurance2.csv')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(1338, 8)"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "medical.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>age</th>\n",
       "      <th>sex</th>\n",
       "      <th>bmi</th>\n",
       "      <th>children</th>\n",
       "      <th>smoker</th>\n",
       "      <th>region</th>\n",
       "      <th>charges</th>\n",
       "      <th>insuranceclaim</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>19</td>\n",
       "      <td>0</td>\n",
       "      <td>27.900</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>16884.92400</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>18</td>\n",
       "      <td>1</td>\n",
       "      <td>33.770</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>1725.55230</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>28</td>\n",
       "      <td>1</td>\n",
       "      <td>33.000</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>4449.46200</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>33</td>\n",
       "      <td>1</td>\n",
       "      <td>22.705</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>21984.47061</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>32</td>\n",
       "      <td>1</td>\n",
       "      <td>28.880</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>3866.85520</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   age  sex     bmi  children  smoker  region      charges  insuranceclaim\n",
       "0   19    0  27.900         0       1       3  16884.92400               1\n",
       "1   18    1  33.770         1       0       2   1725.55230               1\n",
       "2   28    1  33.000         3       0       2   4449.46200               0\n",
       "3   33    1  22.705         0       0       1  21984.47061               0\n",
       "4   32    1  28.880         0       0       1   3866.85520               1"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "medical.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "__Q:__ Plot the histogram of charges and calculate the mean and standard deviation. Comment on the appropriateness of these statistics for the data."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "__A:__"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYUAAAEWCAYAAACJ0YulAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy8QZhcZAAAgAElEQVR4nO3deZgcZbn38e+PsCkEQkjAAAkhGlDwxQAj6osoCnrYPOjrkUUOREAjm6h4XgVxiSIe0CMiegQCRBYBQRCIiApyBERkSTCEsARCGCAkkGEPi0jCff6op4vK0J2pmelleub3ua66uvqp7a7pmr67nqfqKUUEZmZmAKu0OgAzMxs4nBTMzCznpGBmZjknBTMzyzkpmJlZzknBzMxyTgqDkKTTJX2zTusaJ+kFScPS++slfbYe607r+72kyfVaXy+2+z1JT0p6vJfL1XX/m0HS/pKuacJ2xksKSas2eluFbe4oaV4/lj9H0vfqGVO7c1JoM5I6Jb0saamkZyXdLOlQSflnGRGHRsTxJde1y8rmiYhHImLtiFheh9inSvplt/XvFhHn9nfdvYxjLPAVYMuIeEszt90KEXFBRHy01XE0QkT8JSK2qLwvc0zbyjkptKePRcRwYFPgROBrwNn13kgzf/E12abAUxGxpJVBVM6+zAYSJ4U2FhHPRcQMYB9gsqR3woqnxJJGSboqnVU8LekvklaRdD4wDvhtqh76auH0/xBJjwD/U6NK4K2SbpP0nKQrJY1M29pJ0sJijJVfbpJ2Bb4O7JO2d2eanlfHpLi+IelhSUsknSdp3TStEsdkSY+kqp/jav1tJK2blu9K6/tGWv8uwLXARimOc2osv5ek2ZKel/Rgir9iU0l/TWdr10gaVVju15IeT3+bGyVtVZh2jqTTJF0t6UXgQ5LWl/TbtJ3bU7XWTYVl3i7p2vTZzZO0d2Ha7pLuSXE8Juk/auzLZ7qtM9LZ5QOSnpH035JUY9ntJf0tHT+LJf1M0uq1/u7J/tU+I0lrSDpF0qI0nCJpjTSt6nGapnVKOjbt6zOSfiFpzTQtP+aqHdM9fSZWRUR4aKMB6AR2qVL+CHBYGj8H+F4a/0/gdGC1NOwIqNq6gPFAAOcBawFvKpStmua5HngMeGea5zLgl2naTsDCWvECUyvzFqZfD3w2jR8MzAcmAGsDvwHO7xbbmSmudwGvAO+o8Xc6D7gSGJ6WvR84pFac3ZbdHngO+AjZD6eNgbcX4n0Q2DzFcT1wYmHZg9M21wBOAWYXpp2T1rtDWu+awK/S8GZgS+BR4KY0/1rp/UHAqsC2wJPAVmn6YmDHNL4esG2N/flMZZ3pfQBXASPIvkS7gF1rLLsd8N60/fHAvcCXasy70s8I+C5wC7ABMBq4GTi+5HE6FxgLjAT+yuvH9wqfJVX+P0p8Jt9r9f/1QBp8pjB4LCL7h+nuVWAMsGlEvBpZHWxPHV5NjYgXI+LlGtPPj4i5EfEi8E1gb9WnKmR/4OSIWBARLwDHAvt2O0v5TkS8HBF3AneSffGsIMWyD3BsRCyNiE7gR8ABJeM4BJgeEddGxGsR8VhE3FeY/ouIuD/9fS4BJlUmRMT0tM1XyJLguypnO8mVEfHXiHiN7LP5JPDtiHgpIu4Biu0rewKdEfGLiFgWEXeQJeF/S9NfBbaUtE5EPJOml3ViRDwbEY8Afy7uQ1FEzIqIW9L2O4EzgA/2sO5an9H+wHcjYklEdAHf4fXPpKfj9GcR8WhEPA2cAOxXdkdLfCZW4KQweGwMPF2l/Idkv76vkbRA0jEl1vVoL6Y/TPbLblSNeXtjo7S+4rpXBTYslBWvFnqJ7Iyiu1HA6lXWtXHJOMaSnQ3UUjUGScMknZiqm54n+9Vaiaei+LcbTbZ/j9aYvinwnlSl8qykZ8m+WCuN458EdgcelnSDpPeV2ruV7EN3kjZP1TqPp336Pj1/1rXWXe3z3SiN93Scdj/mNqKEkp+JFTgpDAKS3k32hXdT92npF9JXImIC8DHgaEk7VybXWGVPZxJjC+PjyH7lPQm8SFYNUolrGNkXX9n1LiL7IiyuexnwRA/Ldfdkiqn7uh4rufyjwFt7uU2ATwN7AbsA65JVpwAU6+uLf4Musv3bpFBW/Ns+CtwQESMKw9oRcRhARNweEXuRVcdcQXbWUm+nAfcBEyNiHbJ2oartDyVU+3wXQY/HKbzxmFtUYxvdj7Eyn4kVOCm0MUnrSNqTrE76lxFxV5V59pT0ttSQ+DywPA2QfdlO6MOm/13SlpLeTFZPfGlkl6zeD6wpaQ9JqwHfIKvHrXgCGK/C5bPdXAR8WdJmktYm+1V6cUQs601wKZZLgBMkDZe0KXA08MuVL5k7GzhI0s7KGqc3lvT2EssNJ6tDf4osOX6/RJy/AaZKenPaxoGFWa4CNpd0gKTV0vBuSe+QtLqy+w/WjYhXef2zrbfhad0vpPgO68e6LgK+IWm0ssb5b5E+kx6OU4AjJG2i7KKGrwMX19hG92O6V5+JOSm0q99KWkr2S/I44GSyxshqJgJ/Al4A/gb8PCKuT9P+k+yf9NlaV67UcD5ZA93jZI2lR0F2NRRwOHAW2a/yF4Hi1Ui/Tq9PSapW/z09rftG4CHgH8AXehFX0RfS9heQnUFdmNbfo4i4jezv+WOyhuEbWPEXbi3nkVVtPAbcQ9ao2pMjyX7BPk627xeRfYkREUuBjwL7kv0yfhw4idcT7QFAZ6oWORT49xLb663/IPu1vZSsAbnWl3EZ3wNmAnOAu4A7Uhms/DiF7PO7huzzXFBYrrvux3RfPpMhTdFjm6OZNYukk4C3RETT7/IeqCR1kl2h9qdWxzIU+EzBrIWU3YewtTLbk135dHmr47Kha7DesWrWLoaTVRltBCwhu3T2ypZGZEOaq4/MzCzn6iMzM8u1dfXRqFGjYvz48a0Ow8ysrcyaNevJiBhdbVpbJ4Xx48czc+bMVodhZtZWJD1ca5qrj8zMLOekYGZmOScFMzPLOSmYmVnOScHMzHJOCmZmlnNSMDOznJOCmZnlnBTMzCzX1nc099f4Y35Xar7OE/docCRmZgODzxTMzCznpGBmZjknBTMzyzkpmJlZrmFJQdJYSX+WdK+kuyV9MZWPlHStpAfS63qpXJJOlTRf0hxJ2zYqNjMzq66RZwrLgK9ExDuA9wJHSNoSOAa4LiImAtel9wC7ARPTMAU4rYGxmZlZFQ1LChGxOCLuSONLgXuBjYG9gHPTbOcCH0/jewHnReYWYISkMY2Kz8zM3qgpbQqSxgPbALcCG0bEYsgSB7BBmm1j4NHCYgtTWfd1TZE0U9LMrq6uRoZtZjbkNDwpSFobuAz4UkQ8v7JZq5TFGwoipkVER0R0jB5d9RGjZmbWRw1NCpJWI0sIF0TEb1LxE5VqofS6JJUvBMYWFt8EWNTI+MzMbEWNvPpIwNnAvRFxcmHSDGByGp8MXFkoPzBdhfRe4LlKNZOZmTVHI/s+2gE4ALhL0uxU9nXgROASSYcAjwCfStOuBnYH5gMvAQc1MDYzM6uiYUkhIm6iejsBwM5V5g/giEbFY2ZmPfMdzWZmlnNSMDOznJOCmZnlnBTMzCznpGBmZjknBTMzyzkpmJlZzknBzMxyTgpmZpZzUjAzs5yTgpmZ5ZwUzMws56RgZmY5JwUzM8s5KZiZWa6RT16bLmmJpLmFsoslzU5DZ+XhO5LGS3q5MO30RsVlZma1NfLJa+cAPwPOqxRExD6VcUk/Ap4rzP9gRExqYDxmZtaDRj557UZJ46tNS89v3hv4cKO2b2ZmvdeqNoUdgSci4oFC2WaS/i7pBkk7tiguM7MhrZHVRyuzH3BR4f1iYFxEPCVpO+AKSVtFxPPdF5Q0BZgCMG7cuKYEa2Y2VDQ9KUhaFfh/wHaVsoh4BXgljc+S9CCwOTCz+/IRMQ2YBtDR0RHNiHn8Mb8rNV/niXs0OBIzs8ZqRfXRLsB9EbGwUiBptKRhaXwCMBFY0ILYzMyGtEZeknoR8DdgC0kLJR2SJu3LilVHAB8A5ki6E7gUODQinm5UbGZmVl0jrz7ar0b5Z6qUXQZc1qhYzMysHN/RbGZmOScFMzPLOSmYmVnOScHMzHJOCmZmlnNSMDOznJOCmZnlnBTMzCznpGBmZjknBTMzyzkpmJlZzknBzMxyTgpmZpZzUjAzs5yTgpmZ5Vr1jOZByY/tNLN218gnr02XtETS3ELZVEmPSZqdht0L046VNF/SPEn/0qi4zMystkZWH50D7Fql/McRMSkNVwNI2pLsMZ1bpWV+Xnlms5mZNU/DkkJE3AiUfc7yXsCvIuKViHgImA9s36jYzMysulY0NB8paU6qXlovlW0MPFqYZ2EqewNJUyTNlDSzq6ur0bGamQ0pPSYFSW+VtEYa30nSUZJG9HF7pwFvBSYBi4EfVTZTZd6otoKImBYRHRHRMXr06D6GYWZm1ZQ5U7gMWC7pbcDZwGbAhX3ZWEQ8ERHLI+I14ExeryJaCIwtzLoJsKgv2zAzs74rkxRei4hlwCeAUyLiy8CYvmxMUnG5TwCVK5NmAPtKWkPSZsBE4La+bMPMzPquzH0Kr0raD5gMfCyVrdbTQpIuAnYCRklaCHwb2EnSJLKqoU7g8wARcbekS4B7gGXAERGxvHe7YmZm/VUmKRwEHAqcEBEPpV/yv+xpoYjYr0rx2SuZ/wTghBLxmJlZg/SYFCLiHklfA8al9w8BJzY6MDMza74yVx99DJgN/CG9nyRpRqMDMzOz5ivT0DyV7CqhZwEiYjbZFUhmZjbIlEkKyyLiuW5lVe8hMDOz9lamoXmupE8DwyRNBI4Cbm5sWIObe1M1s4GqTFL4AnAc8ApwEfBH4PhGBmUZJw8za7YyVx+9RJYUjks9l64VEf9oeGRmZtZ0Za4+ulDSOpLWAu4G5kn6/40PzczMmq1MQ/OWEfE88HHgarL7FQ5oaFRmZtYSZZLCapJWI0sKV0bEq/jqIzOzQalMUjiDrJ+itYAbJW0KPN/IoMzMrDXKNDSfCpxaKHpY0ocaF5KZmbVKmUtSkbQH2fOT1ywUf7chEZmZWcuUufrodGAfsvsVBHwK2LTBcZmZWQuUaVP4vxFxIPBMRHwHeB8rPiXNzMwGiTJJ4eX0+pKkjYBXcYd4ZmaDUpmkcJWkEcAPgTvIrkT6VU8LSZouaYmkuYWyH0q6T9IcSZen9SJpvKSXJc1Ow+l92x0zM+uPHpNCRBwfEc9GxGVkbQlvj4hvllj3OcCu3cquBd4ZEVsD9wPHFqY9GBGT0nBoufDNzKyeyjQ0H1H5RR8RrwCrSDq8p+Ui4kbg6W5l10TEsvT2FmCT3odsZmaNUqb66HMR8WzlTUQ8A3yuDts+GPh94f1mkv4u6QZJO9ZaSNIUSTMlzezq6qpDGGZmVlEmKawiSZU3qafU1fuzUUnHAcuAC1LRYmBcRGwDHA1cKGmdastGxLSI6IiIjtGjR/cnDDMz66ZMUvgjcImknSV9mOyZCn/o6wYlTQb2BPaPiICsWioinkrjs4AHgc37ug0zM+ubMnc0fw2YAhxGdvPaNcBZfdmYpF3T+j6YntNQKR8NPB0RyyVNACYCC/qyDTMz67syfR+9BpyehtIkXQTsBIyStBD4NtnVRmsA16YaqVvSlUYfAL4raRmwHDg0Ip6uumIzM2uYUn0f9UVE7Fel+Owa814GXNaoWMzMrJyGJQVrHj/L2czqpWZDs6Tz0+sXmxeOmZm10squPtouPVDnYEnrSRpZHJoVoJmZNc/Kqo9OJ7v0dAIwi+zKo4pI5WZmNojUPFOIiFMj4h3A9IiYEBGbFQYnBDOzQajMJamHSXoXUOl64saImNPYsMzMrBXKdIh3FFl3FBuk4QJJX2h0YGZm1nxlLkn9LPCeiHgRQNJJwN+AnzYyMDMza74yfR+J7C7jiuWs2OhsZmaDRJkzhV8At0q6PL3/ODXuTDYzs/ZWpqH5ZEnXA+8nO0M4KCL+3ujAzMys+Up1cxERd5A9n9nMzAaxMm0KZmY2RDgpmJlZbqVJQdIwSX9qVjBmZtZaK00KEbEceEnSuk2Kx8zMWqhMQ/M/gLskXQu8WCmMiKN6WlDSdLLnMS+JiHemspHAxcB4oBPYOyKeUfYotp8AuwMvAZ9JDdxmZtYkZdoUfgd8E7iRrLfUylDGOcCu3cqOAa6LiInAdek9wG5kz2aeSPZM6NNKbsPMzOqkzH0K50p6EzAuIub1ZuURcaOk8d2K9yJ7djPAucD1wNdS+XkREcAtkkZIGhMRi3uzTTMz67syHeJ9DJhN9mwFJE2SNKMf29yw8kWfXjdI5RsDjxbmW5jKusczRdJMSTO7urr6EYaZmXVXpvpoKrA98CxARMwGNmtALNX6U4o3FERMi4iOiOgYPXp0A8IwMxu6yiSFZRHxXLeyN3xZ98ITksYApNclqXwhMLYw3ybAon5sx8zMeqlMUpgr6dPAMEkTJf0UuLkf25wBTE7jk4ErC+UHKvNe4Dm3J5iZNVeZpPAFYCvgFeAi4HngS2VWLukismcvbCFpoaRDgBOBj0h6APhIeg9wNbAAmA+cCRzei/0wM7M6KHP10UvAcenhOhERS8uuPCL2qzFp5yrzBnBE2XWbmVn9lbn66N2S7gLmkN3Edqek7RofmpmZNVuZO5rPBg6PiL8ASHo/2YN3tm5kYGZm1nxl2hSWVhICQETcBJSuQjIzs/ZR80xB0rZp9DZJZ5A1MgewD9ldyGZmNsisrProR93ef7sw3p/7FMzMbICqmRQi4kPNDMTMzFqvx4ZmSSOAA8m6us7nL9N1tpmZtZcyVx9dDdwC3AW81thwzMyslcokhTUj4uiGR2JmZi1X5pLU8yV9TtIYSSMrQ8MjMzOzpitzpvBP4IfAcbx+1VEAExoVlJmZtUaZpHA08LaIeLLRwZiZWWuVqT66G3ip0YGYmVnrlTlTWA7MlvRnsu6zAV+SamY2GJVJClekwczMBrkyz1M4txmBmJlZ65W5o/khqvR1FBF9uvpI0hbAxYWiCcC3gBHA54CuVP71iLi6L9swM7O+KVN91FEYXxP4FNDn+xQiYh4wCUDSMOAx4HLgIODHEfFffV23mZn1T49XH0XEU4XhsYg4Bfhwnba/M/BgRDxcp/WZmVk/lKk+2rbwdhWyM4fhddr+vmTPaag4UtKBwEzgKxHxTJV4pgBTAMaNG1enMMzMDMpVHxWfq7AM6AT27u+GJa0O/CtwbCo6DTierP3i+LTdg7svFxHTgGkAHR0dfq6DmVkdlbn6qFHPVdgNuCMinkjbeaIyQdKZwFUN2q6ZmdVQpvpoDeCTvPF5Ct/t57b3o1B1JGlMRCxObz8BzO3n+s3MrJfKVB9dCTwHzKJwR3N/SHoz8BHg84XiH0iaRFZ91NltmpmZNUGZpLBJROxaz41GxEvA+t3KDqjnNszMrPfKdIh3s6T/0/BIzMys5cqcKbwf+Ey6s/kVQEBExNYNjczMzJquTFLYreFRmJnZgFDmklTfbWxmNkSUaVMwM7MhwknBzMxyTgpmZpZzUjAzs5yTgpmZ5ZwUzMws56RgZmY5JwUzM8s5KZiZWc5JwczMcmX6PrJBYvwxvys9b+eJezQwEjMbqHymYGZmuZadKUjqBJYCy4FlEdEhaSRwMdmjPzuBvSPimVbFaGY21LT6TOFDETEpIjrS+2OA6yJiInBdem9mZk3S6qTQ3V7AuWn8XODjLYzFzGzIaWVSCOAaSbMkTUllG0bEYoD0ukH3hSRNkTRT0syurq4mhmtmNvi18uqjHSJikaQNgGsl3VdmoYiYBkwD6OjoiEYGaGY21LTsTCEiFqXXJcDlwPbAE5LGAKTXJa2Kz8xsKGpJUpC0lqThlXHgo8BcYAYwOc02GbiyFfGZmQ1Vrao+2hC4XFIlhgsj4g+SbgcukXQI8AjwqRbFZ2Y2JLUkKUTEAuBdVcqfAnZufkRmZgYD75JUMzNrIScFMzPLuUM865eyney5gz2z9uAzBTMzyzkpmJlZzknBzMxyTgpmZpZzUjAzs5yvPrKm8FVKZu3BZwpmZpZzUjAzs5yTgpmZ5dymYFWVbQMws8HFZwpmZpZzUjAzs5yTgpmZ5ZqeFCSNlfRnSfdKulvSF1P5VEmPSZqdht2bHZuZ2VDXiobmZcBXIuKO9JzmWZKuTdN+HBH/1YKYrM34Zjizxmh6UoiIxcDiNL5U0r3Axs2Ow8zM3qilbQqSxgPbALemoiMlzZE0XdJ6NZaZImmmpJldXV1NitTMbGhoWVKQtDZwGfCliHgeOA14KzCJ7EziR9WWi4hpEdERER2jR49uWrxmZkNBS25ek7QaWUK4ICJ+AxARTxSmnwlc1YrYrLV805xZazU9KUgScDZwb0ScXCgfk9obAD4BzG12bGat0KpE6EZ4q6YVZwo7AAcAd0mancq+DuwnaRIQQCfw+RbEZmY2pLXi6qObAFWZdHWzYzEzsxW5QzyzIcr3elg17ubCzMxyTgpmZpZz9ZENao24smeoVaf05m9Y9m/jqquBy0nBrEF8z4W1IycFM6sbJ8L25zYFMzPLOSmYmVnOScHMzHJOCmZmlnNSMDOznJOCmZnlnBTMzCznpGBmZjknBTMzyzkpmJlZbsB1cyFpV+AnwDDgrIg4scUhma3AXTnYYDagkoKkYcB/Ax8BFgK3S5oREfe0NjIza4Wh2Jtqq/d5QCUFYHtgfkQsAJD0K2AvwEnBzGqq99lbvbsAbycDLSlsDDxaeL8QeE9xBklTgCnp7QuS5pVY7yjgybpE2Drtvg/tHj+0/z60e/zQpH3QSQ1dfV32oZ8xblprwkBLCqpSFiu8iZgGTOvVSqWZEdHRn8Bard33od3jh/bfh3aPH7wPzTDQrj5aCIwtvN8EWNSiWMzMhpyBlhRuByZK2kzS6sC+wIwWx2RmNmQMqOqjiFgm6Ujgj2SXpE6PiLvrsOpeVTcNUO2+D+0eP7T/PrR7/OB9aDhFRM9zmZnZkDDQqo/MzKyFnBTMzCw36JOCpF0lzZM0X9IxLY5luqQlkuYWykZKulbSA+l1vVQuSaemuOdI2rawzOQ0/wOSJhfKt5N0V1rmVEnVLvHtT/xjJf1Z0r2S7pb0xTbchzUl3SbpzrQP30nlm0m6NcVzcbrQAUlrpPfz0/TxhXUdm8rnSfqXQnnDjzlJwyT9XdJVbRp/Z/qcZ0uamcra5jhK2xgh6VJJ96X/ife12z5UFRGDdiBrrH4QmACsDtwJbNnCeD4AbAvMLZT9ADgmjR8DnJTGdwd+T3bvxnuBW1P5SGBBel0vja+Xpt0GvC8t83tgtzrHPwbYNo0PB+4HtmyzfRCwdhpfDbg1xXYJsG8qPx04LI0fDpyexvcFLk7jW6bjaQ1gs3ScDWvWMQccDVwIXJXet1v8ncCobmVtcxylbZwLfDaNrw6MaLd9qLpfzdhIq4b0B/1j4f2xwLEtjmk8KyaFecCYND4GmJfGzwD26z4fsB9wRqH8jFQ2BrivUL7CfA3alyvJ+qlqy30A3gzcQXbX/JPAqt2PG7Ir4d6XxldN86n7sVSZrxnHHNn9O9cBHwauSvG0TfxpvZ28MSm0zXEErAM8RLpYpx33odYw2KuPqnWbsXGLYqllw4hYDJBeN0jltWJfWfnCKuUNkaohtiH7pd1W+5CqXmYDS4BryX4ZPxsRy6psN481TX8OWL+HfWj0MXcK8FXgtfR+/TaLH7KeCq6RNEtZ1zXQXsfRBKAL+EWqxjtL0lpttg9VDfak0GO3GQNYrdh7W153ktYGLgO+FBHPr2zWGjG1dB8iYnlETCL7xb098I6VbHdA7YOkPYElETGrWLySbQ6o+At2iIhtgd2AIyR9YCXzDsR9WJWsKvi0iNgGeJGsuqiWgbgPVQ32pNAO3WY8IWkMQHpdksprxb6y8k2qlNeVpNXIEsIFEfGbdtyHioh4FrierI53hKTKzZzF7eaxpunrAk/T+32rlx2Af5XUCfyKrArplDaKH4CIWJRelwCXkyXndjqOFgILI+LW9P5SsiTRTvtQXTPqqFo1kGXzBWQNaZVGs61aHNN4VmxT+CErNkz9II3vwYoNU7el8pFkdZnrpeEhYGSadnuat9IwtXudYxdwHnBKt/J22ofRwIg0/ibgL8CewK9ZsaH28DR+BCs21F6SxrdixYbaBWSNtE075oCdeL2huW3iB9YChhfGbwZ2bafjKG3jL8AWaXxqir+t9qHqfjVjI60cyFr97yerNz6uxbFcBCwGXiX7JXAIWf3udcAD6bVyQIjsgUMPAncBHYX1HAzMT8NBhfIOYG5a5md0awSrQ/zvJzuFnQPMTsPubbYPWwN/T/swF/hWKp9AdrXHfLIv2DVS+Zrp/fw0fUJhXcelOOdRuDKkWcccKyaFtok/xXpnGu6ubKOdjqO0jUnAzHQsXUH2pd5W+1BtcDcXZmaWG+xtCmZm1gtOCmZmlnNSMDOznJOCmZnlnBTMzCznpGCWSDpH0r+1OIZtJJ3VrWxqlfn+VOmB06yenBTM6iB1jVyP/6evAz9N61xb0iVk3UDMkXRSYb7zyXpANasrJwUbkiQdmL5o75R0fmHSByTdLGlB5awhfTlfJ+mO1L/9Xql8fOpH/+dkva2OlXSIpPslXS/pTEk/S/OOlnSZpNvTsEOVmIYDW0fEnanoQOBlsjuUJ5ElgooZZD1nmtXVqj3PYja4SNqK7G7eHSLiSUkjC5PHkN25/XayL95LgX8An4iI5yWNAm6RNCPNvwXZXaiHS9oI+CZZHzhLgf8hu2sX4CfAjyPiJknjyLqq7t4RX+UO1op/knWD8HhEvFacFhHPKHuAzvoR8VS//iBmBU4KNhR9GLg0Ip4EiIinC9OuSF/A90jaMJUJ+H7qyfM1si6MK9Mejohb0vj2wA2V9Un6NbB5mrYLsGXh4VnrSBoeEUsL2x5D1h1zxXlp+cmSdgROjohLC9OXABsBTgpWN04KNhSJ2t0Qv9JtPoD9yTrS2y4iXk09lK6Zpr1YZf5qViF72M3LK5nn5cJ6iYh/Al+V9BJwMfBHSTMjojPNsmZaxqxu3KZgQ9F1wN6S1ofs2cA9zL8u2TMMXpX0IX5+s+QAAAECSURBVGDTGvPdBnxQ0nqpm+pPFqZdAxxZeSNpUpXl7wXeVphnotKzlsk6WHuO7GlxpOf1voXsCWZmdeOkYENORNwNnADcIOlO4OQeFrkA6FD2gPn9gftqrPcx4PtkT6P7E3AP2Rc5wFFpHXMk3QMcWmX5+4B1U4MzZO0a1wMHkfXs+ruIuCdN2w64JV5/2ppZXbiXVLM6krR2RLyQzhQuB6ZHxOW9WP7LwNKIOKtQNjUipnab7yfAjIi4rk6hmwE+UzCrt6np+c9zyR6YckUvlz+NFds1IDtb6G6uE4I1gs8UzMws5zMFMzPLOSmYmVnOScHMzHJOCmZmlnNSMDOz3P8CuXuBsVZQRXIAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Plot the histogram of charges \n",
    "_ = plt.hist(medical['charges'], bins=30)\n",
    "_ = plt.xlabel('charge ($)')\n",
    "_ = plt.ylabel('number of cases')\n",
    "_ = plt.title('Distribution of charges in a hospital')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The mean: 13270.4\n",
      "The standard deviation: 12110.0\n"
     ]
    }
   ],
   "source": [
    "# Calculate the sample mean and sample standard deviation\n",
    "sample_mean = medical['charges'].mean()\n",
    "sample_std = medical['charges'].std(ddof=1)\n",
    "\n",
    "print('The mean:', np.round(sample_mean, 1))\n",
    "print('The standard deviation:', np.round(sample_std, 1))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**The distribution is not a normal distribution. Because of this, it is not appropriate to use the sample mean and the sample standard deviation as the population parameters.**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "__Q:__ The administrator is concerned that the actual average charge has fallen below 12000, threatening the hospital's operational model. On the assumption that these data represent a random sample of charges, how would you justify that these data allow you to answer that question? And what would be the most appropriate frequentist test, of the ones discussed so far, to apply?"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "__A:__ **The sample distribution is not a normal distribution. However, if the sample size is enogh, we can estimate the standard error from the sample standard deviation and the sample size. Then, we can calculate the margin of error to have the Confidence Interval of the mean. We do not have any information about the population parameters. So t-test is used.**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "__Q:__ Given the nature of the administrator's concern, what is the appropriate confidence interval in this case? A one-sided or two-sided interval? Calculate the critical value and the relevant 95% confidence interval for the mean and comment on whether the administrator should be concerned?"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "__A:__ **The one-sided confidence interval is more appropriate because the administrator is concerned whether the average is below 12,000.**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1.6459941145571317"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Get the t value: the degrees of freedom = 1338 - 1, the alpha level = 0.050\n",
    "t_val = t.ppf(1-0.050, 1337)\n",
    "t_val"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "544.9350813250254"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Calculate the (95%) margin of error \n",
    "me_t = t_val * sample_std / np.sqrt(1338)\n",
    "me_t"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The population mean is more than 12725.48718381623 .\n"
     ]
    }
   ],
   "source": [
    "# Calculate the 95% Confidence Interval of the mean\n",
    "ci = sample_mean - me_t\n",
    "print('The population mean is more than', ci, '.')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**The average charge of all the hospitals is estimated at more than 12,725 (95% of the time). It does not tend to be less than $12,000.**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The administrator then wants to know whether people with insurance really are charged a different amount to those without.\n",
    "\n",
    "__Q:__ State the null and alternative hypothesis here. Use the _t_-test for the difference between means where the pooled standard deviation of the two groups is given by\n",
    "\\begin{equation}\n",
    "s_p = \\sqrt{\\frac{(n_0 - 1)s^2_0 + (n_1 - 1)s^2_1}{n_0 + n_1 - 2}}\n",
    "\\end{equation}\n",
    "\n",
    "and the *t* test statistic is then given by\n",
    "\n",
    "\\begin{equation}\n",
    "t = \\frac{\\bar{x}_0 - \\bar{x}_1}{s_p \\sqrt{1/n_0 + 1/n_1}}.\n",
    "\\end{equation}\n",
    "\n",
    "What assumption about the variances of the two groups are we making here?"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "__A:__  **There is no difference between the variances of the two groups.**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "__Q:__ Perform this hypothesis test both manually, using the above formulae, and then using the appropriate function from [scipy.stats](https://docs.scipy.org/doc/scipy/reference/stats.html#statistical-tests) (hint, you're looking for a function to perform a _t_-test on two independent samples). For the manual approach, calculate the value of the test statistic and then its probability (the p-value). Verify you get the same results from both."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "__A:__ "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "t statistic: -11.89329903087671\n",
      "p value: 0.0\n"
     ]
    }
   ],
   "source": [
    "# Set the charges without insurance as Group0 and the charges with insurance as Group1\n",
    "df_group0 = medical[medical['insuranceclaim'] == 0]\n",
    "df_group1 = medical[medical['insuranceclaim'] == 1]\n",
    "\n",
    "# Get each sample size\n",
    "n_0 = len(df_group0)\n",
    "n_1 = len(df_group1)\n",
    "\n",
    "# Get the sample means\n",
    "x_0 = df_group0['charges'].mean()\n",
    "x_1 = df_group1['charges'].mean()\n",
    "\n",
    "# Get the sample standard deviations\n",
    "s_0 = df_group0['charges'].std(ddof=1)\n",
    "s_1 = df_group1['charges'].std(ddof=1)\n",
    "\n",
    "# Calculate the pooled standard deviation\n",
    "s_p = np.sqrt(((n_0 - 1) * s_0**2 + (n_1 - 1) * s_1**2) / (n_0 + n_1 - 2))\n",
    "\n",
    "# Calculate the t test statistic \n",
    "t_sta = (x_0 - x_1) / (s_p * np.sqrt(1 / n_0 + 1 / n_1))\n",
    "\n",
    "# Get the p value\n",
    "p_val = t.cdf(t_sta, n_0-1, n_1-1)\n",
    "\n",
    "# Prind the result\n",
    "print('t statistic:', t_sta)\n",
    "print('p value:', p_val)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Ttest_indResult(statistic=-11.893299030876712, pvalue=4.461230231620717e-31)"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from scipy import stats\n",
    "\n",
    "stats.ttest_ind(df_group0['charges'].values, df_group1['charges'].values)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**The two results are same.**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Congratulations! Hopefully you got the exact same numerical results. This shows that you correctly calculated the numbers by hand. Secondly, you used the correct function and saw that it's much easier to use. All you need to do pass your data to it."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "__Q:__ In the above calculations, we assumed the sample variances were equal. We may well suspect they are not (we'll explore this in another assignment). The calculation becomes a little more complicated to do by hand in this case, but we now know of a helpful function. Check the documentation for the function to tell it not to assume equal variances and perform the test again."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "__A:__"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Ttest_indResult(statistic=-13.298031957975649, pvalue=1.1105103216309125e-37)"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "stats.ttest_ind(df_group0['charges'].values, df_group1['charges'].values, equal_var=False)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "__Q:__ Conceptual question: look through the documentation for statistical test functions in scipy.stats. You'll see the above _t_-test for a sample, but can you see an equivalent one for performing a *z*-test from a sample? Comment on your answer."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "__A:__  **No. When we can use a z-test, we already know the population parameters (the means, standard deviations). Because of that, we can calculate the p-value and z statistic by stats.norm.cdf() and norm.ppf().  Also, if the sample number is very large, the z statistic approximates the value calculated by the t statistic formula. The same goes for the p-value. These mean stats.ttest_ind() can be used to calculate the z statistic and p-value.**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Learning outcomes"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Having completed this project notebook, you now have good hands-on experience:\n",
    "* using the central limit theorem to help you apply frequentist techniques to answer questions that pertain to very non-normally distributed data from the real world\n",
    "* performing inference using such data to answer business questions\n",
    "* forming a hypothesis and framing the null and alternative hypotheses\n",
    "* testing this using a _t_-test"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.10"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}