rent_in_Ghana copy.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "6c7e849a",
   "metadata": {
    "ExecuteTime": {
     "end_time": "2021-06-11T09:24:53.643384Z",
     "start_time": "2021-06-11T09:24:53.622385Z"
    }
   },
   "source": [
    "# Rent in Ghana\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "05600c92",
   "metadata": {},
   "source": [
    "<a id=\"cont\"></a>\n",
    "\n",
    "## Table of Contents\n",
    "\n",
    "<a href=#one>1. Importing Packages</a>\n",
    "\n",
    "<a href=#two>2. Loading Data</a>\n",
    "\n",
    "<a href=#three>3. Data Cleaning (EDA)</a>\n",
    "\n",
    "<a href=#four>4. Data Engineering</a>\n",
    "\n",
    "<a href=#five>5. Modeling</a>\n",
    "\n",
    "<a href=#six>6. Model Performance</a>\n",
    "\n",
    "<a href=#seven>7. Model Explanations</a>"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "90ead430",
   "metadata": {},
   "source": [
    "## Project Objectives\n",
    "\n",
    "* Clean the dataset to the point where it can be used effectively for model design \n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "d9fce362",
   "metadata": {},
   "source": [
    "## Definition of Data Features\n",
    "\n",
    "\n",
    "\n",
    "1. Title\n",
    "2. Location\n",
    "3. Price\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "997462e2",
   "metadata": {},
   "source": [
    " <a id=\"one\"></a>\n",
    "## 1. Importing Packages\n",
    "<a href=#cont>Back to Table of Contents</a>\n",
    "\n",
    "---\n",
    "    \n",
    "| ⚡ Description: Importing Packages ⚡ |\n",
    "| :--------------------------- |\n",
    "| In this section we would import, and briefly discuss, the libraries that will be used throughout our analysis and modelling. |\n",
    "\n",
    "---"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "6cd26b00",
   "metadata": {},
   "source": [
    "### Import the packages that are neccessary to carry out the stated objectives of the project"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 678,
   "id": "475dbe93",
   "metadata": {
    "ExecuteTime": {
     "end_time": "2021-06-23T10:30:53.800892Z",
     "start_time": "2021-06-23T10:30:50.215449Z"
    }
   },
   "outputs": [],
   "source": [
    "# Libraries for data loading, data manipulation and data visulisation\n",
    "import numpy as np # for linear algebra\n",
    "import pandas as pd # Data processing, CSV file importation\n",
    "\n",
    "# Libraries for data preparation and model building\n",
    "\n",
    "#Machine learning performance libraries\n",
    "from sklearn.metrics import mean_squared_error\n",
    "from sklearn import *\n",
    "from sklearn.model_selection import train_test_split\n",
    "from sklearn.model_selection import KFold\n",
    "\n",
    "\n",
    "\n",
    "\n",
    "#other packages\n",
    "from datetime import datetime\n",
    "import re\n",
    "import handcalcs.render\n",
    "\n",
    "#Visualization Packages\n",
    "import plotly.express as px\n",
    "import matplotlib.pyplot as plt\n",
    "%matplotlib inline\n",
    "import seaborn as sns \n",
    "import matplotlib.pyplot as plt\n",
    "\n",
    "\n",
    "import warnings\n",
    "warnings.filterwarnings('ignore')\n",
    "\n",
    "# Set option to display all columns\n",
    "pd.set_option('display.max_colwidth', None)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f22a6718",
   "metadata": {},
   "source": [
    "<a id=\"two\"></a>\n",
    "## 2. Loading the Data\n",
    "<a class=\"anchor\" id=\"1.1\"></a>\n",
    "<a href=#cont>Back to Table of Contents</a>\n",
    "\n",
    "---\n",
    "    \n",
    "| ⚡ Description: Loading the data ⚡ |\n",
    "| :--------------------------- |\n",
    "| In this section we load the data from the `df` file into a DataFrame. |\n",
    "\n",
    "---"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "fd29bd63",
   "metadata": {},
   "source": [
    "To begin loading our data, we need to make sure that the raw data and the notebook file are both in the same folder on our local machine. Both the train and test data sets will be loaded into our notebook using the code below. If the files aren't in the same folder, we'll have to point to the directory where the file is stored on our machine or on the cloud. It is a good practice to call up the loaded data once it has been loaded to ensure that the data has loaded correctly."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 679,
   "id": "75f8b21c",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Price</th>\n",
       "      <th>Description</th>\n",
       "      <th>Location</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>\\n        3bdrm Apartment in Spintex for Rent\\n</td>\n",
       "      <td>\\n        GH₵ 3,500\\n</td>\n",
       "      <td>\\n                            Semi furnished 3 bedrooms apartment,\\n2 washrooms,\\n2 spacious balconies,\\nDinning area,\\nFitted...\\n</td>\n",
       "      <td>\\n            Greater Accra, Spintex\\n</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>\\n        Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent\\n</td>\n",
       "      <td>\\n        GH₵ 32,000\\n</td>\n",
       "      <td>\\n                            4 bedroom townhouse + going for ; \\nLocated Cantonment\\n</td>\n",
       "      <td>\\n            Greater Accra, Cantonments\\n</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>\\n        2bdrm Apartment in West Trassaco, Adjiriganor for Rent\\n</td>\n",
       "      <td>\\n        GH₵ 3,500\\n</td>\n",
       "      <td>\\n                            Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom\\n</td>\n",
       "      <td>\\n            Greater Accra, Adjiriganor\\n</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>\\n        3bdrm Duplex in Spintex, Tema Metropolitan for Rent\\n</td>\n",
       "      <td>\\n        GH₵ 6,400\\n</td>\n",
       "      <td>\\n                            Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...\\n</td>\n",
       "      <td>\\n            Greater Accra, Tema Metropolitan\\n</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>\\n        Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan\\n</td>\n",
       "      <td>\\n        GH₵ 800\\n</td>\n",
       "      <td>\\n                            Separate meter, Available water .Space for car pack, big dinning hall and pouch\\n</td>\n",
       "      <td>\\n            Ashanti, Kumasi Metropolitan\\n</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                                   Title  \\\n",
       "0                                    \\n        3bdrm Apartment in Spintex for Rent\\n       \n",
       "1  \\n        Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent\\n       \n",
       "2                 \\n        2bdrm Apartment in West Trassaco, Adjiriganor for Rent\\n       \n",
       "3                    \\n        3bdrm Duplex in Spintex, Tema Metropolitan for Rent\\n       \n",
       "4       \\n        Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan\\n       \n",
       "\n",
       "                        Price  \\\n",
       "0   \\n        GH₵ 3,500\\n       \n",
       "1  \\n        GH₵ 32,000\\n       \n",
       "2   \\n        GH₵ 3,500\\n       \n",
       "3   \\n        GH₵ 6,400\\n       \n",
       "4     \\n        GH₵ 800\\n       \n",
       "\n",
       "                                                                                                                                                   Description  \\\n",
       "0  \\n                            Semi furnished 3 bedrooms apartment,\\n2 washrooms,\\n2 spacious balconies,\\nDinning area,\\nFitted...\\n                           \n",
       "1                                               \\n                            4 bedroom townhouse + going for ; \\nLocated Cantonment\\n                           \n",
       "2     \\n                            Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom\\n                           \n",
       "3  \\n                            Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...\\n                           \n",
       "4                      \\n                            Separate meter, Available water .Space for car pack, big dinning hall and pouch\\n                           \n",
       "\n",
       "                                                   Location  \n",
       "0            \\n            Greater Accra, Spintex\\n          \n",
       "1        \\n            Greater Accra, Cantonments\\n          \n",
       "2        \\n            Greater Accra, Adjiriganor\\n          \n",
       "3  \\n            Greater Accra, Tema Metropolitan\\n          \n",
       "4      \\n            Ashanti, Kumasi Metropolitan\\n          "
      ]
     },
     "execution_count": 679,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# load the train data\n",
    "df= pd.read_csv('20augrentghana.csv')\n",
    "dfr= pd.read_csv('List of all state_s in Ghana with Latitude and Longitude.csv')\n",
    "dfs= pd.read_csv('List of all suburb_s in Ghana with Latitude and Longitude.csv')\n",
    " \n",
    "df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 680,
   "id": "adb3ef05",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Regions</th>\n",
       "      <th>Latitude_Regions</th>\n",
       "      <th>Longitude_Regions</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>ahafo region</td>\n",
       "      <td>6.916885</td>\n",
       "      <td>-2.535097</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>ashanti region</td>\n",
       "      <td>6.800332</td>\n",
       "      <td>-1.518814</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>bono east region</td>\n",
       "      <td>7.803524</td>\n",
       "      <td>-1.087649</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>bono region</td>\n",
       "      <td>7.676179</td>\n",
       "      <td>-2.473540</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>central region</td>\n",
       "      <td>5.724415</td>\n",
       "      <td>-1.376175</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>eastern region</td>\n",
       "      <td>6.446877</td>\n",
       "      <td>-0.377096</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>greater accra region</td>\n",
       "      <td>5.810153</td>\n",
       "      <td>0.099524</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>north east region</td>\n",
       "      <td>10.395977</td>\n",
       "      <td>-0.541079</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>northern region</td>\n",
       "      <td>9.660000</td>\n",
       "      <td>-0.394380</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>oti region</td>\n",
       "      <td>7.863387</td>\n",
       "      <td>0.318598</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>savannah region</td>\n",
       "      <td>9.140065</td>\n",
       "      <td>-1.711123</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>upper west region</td>\n",
       "      <td>10.366953</td>\n",
       "      <td>-2.092143</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>volta region</td>\n",
       "      <td>6.534862</td>\n",
       "      <td>0.455605</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>western north region</td>\n",
       "      <td>6.227937</td>\n",
       "      <td>-2.823489</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>western region</td>\n",
       "      <td>5.426124</td>\n",
       "      <td>-2.128657</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                 Regions  Latitude_Regions  Longitude_Regions\n",
       "0           ahafo region          6.916885          -2.535097\n",
       "1         ashanti region          6.800332          -1.518814\n",
       "2       bono east region          7.803524          -1.087649\n",
       "3            bono region          7.676179          -2.473540\n",
       "4         central region          5.724415          -1.376175\n",
       "5         eastern region          6.446877          -0.377096\n",
       "6   greater accra region          5.810153           0.099524\n",
       "7      north east region         10.395977          -0.541079\n",
       "8        northern region          9.660000          -0.394380\n",
       "9             oti region          7.863387           0.318598\n",
       "10       savannah region          9.140065          -1.711123\n",
       "11     upper west region         10.366953          -2.092143\n",
       "12          volta region          6.534862           0.455605\n",
       "13  western north region          6.227937          -2.823489\n",
       "14        western region          5.426124          -2.128657"
      ]
     },
     "execution_count": 680,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "dfr"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 681,
   "id": "199cf3a7",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Suburb</th>\n",
       "      <th>Latitude_Suburb</th>\n",
       "      <th>Longitude_Suburb</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>abawdikro</td>\n",
       "      <td>7.609215999</td>\n",
       "      <td>-1.960575</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>abeka</td>\n",
       "      <td>5.599984099</td>\n",
       "      <td>-0.241833</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>abelenkpe</td>\n",
       "      <td>5.608003599</td>\n",
       "      <td>-0.217334</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>ablekuma newtown</td>\n",
       "      <td>5.637302199</td>\n",
       "      <td>-0.313772</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>aboabo</td>\n",
       "      <td>6.701056199</td>\n",
       "      <td>-1.596086</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "             Suburb Latitude_Suburb  Longitude_Suburb\n",
       "0         abawdikro     7.609215999         -1.960575\n",
       "1             abeka     5.599984099         -0.241833\n",
       "2         abelenkpe     5.608003599         -0.217334\n",
       "3  ablekuma newtown     5.637302199         -0.313772\n",
       "4            aboabo     6.701056199         -1.596086"
      ]
     },
     "execution_count": 681,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "dfs.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "ed085c39",
   "metadata": {},
   "source": [
    "\n",
    "\n",
    "### Dataset summary\n",
    "It is important to identify the columns that have null entries as null values can affect the performance of our model. The \"isnull\" function shows the number of null values that are contained in each column of the dataset. This data set is relatively clean \n",
    "Pandas dataframe.info() function is used to get a concise summary of the dataframe"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 682,
   "id": "d24cc5d5",
   "metadata": {},
   "outputs": [],
   "source": [
    "def Summary(df):\n",
    "    i = df.info()\n",
    "    print (\"NUL Values\")\n",
    "    n = df.isna().sum()\n",
    "    return i,n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 683,
   "id": "61cd44fb",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 940 entries, 0 to 939\n",
      "Data columns (total 4 columns):\n",
      " #   Column       Non-Null Count  Dtype \n",
      "---  ------       --------------  ----- \n",
      " 0   Title        940 non-null    object\n",
      " 1   Price        940 non-null    object\n",
      " 2   Description  940 non-null    object\n",
      " 3   Location     940 non-null    object\n",
      "dtypes: object(4)\n",
      "memory usage: 29.5+ KB\n",
      "NUL Values\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "(None,\n",
       " Title          0\n",
       " Price          0\n",
       " Description    0\n",
       " Location       0\n",
       " dtype: int64)"
      ]
     },
     "execution_count": 683,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Summary(df)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "b0904d05",
   "metadata": {},
   "source": [
    "### Check the \"Shape\" of the data-sets\n",
    "The data has been split into two sets, as evidenced by the form of both datasets. Seventy-five percent of the data is designated as train data, whereas twenty-five percent is designated as test data. The shape also reveals that the training data set includes 49 columns, whereas the test data set only has 48. The column that our model is supposed to predict is the one that is absent from the test set. We may find that specific object by looking for the entity (Column) that is missing from the test data set. That column can be identified as the load shortfall 3hr column after looking at both datasets."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 684,
   "id": "cb5cb283",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(940, 4)"
      ]
     },
     "execution_count": 684,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "a1cbf667",
   "metadata": {},
   "source": [
    "<a id=\"three\"></a>\n",
    "## 3. Data Cleaning (EDA)\n",
    "<a class=\"anchor\" id=\"1.1\"></a>\n",
    "<a href=#cont>Back to Table of Contents</a>\n",
    "\n",
    "| ⚡ Description: Data Cleaning ⚡ |\n",
    "| :--------------------------- |\n",
    "| In this section, we are required to perform an in-depth analysis of all the variables in the DataFrame. |"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 685,
   "id": "a5c057e1",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Price</th>\n",
       "      <th>Description</th>\n",
       "      <th>Location</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>935</th>\n",
       "      <td>\\n        5bdrm Duplex in Living Large, East Legon for Rent\\n</td>\n",
       "      <td>9000</td>\n",
       "      <td>\\n                            Executive 5 bedroom newly built house with a boy’s quarters for rent at west trasacco very nice also...\\n</td>\n",
       "      <td>\\n            Greater Accra, East Legon\\n</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>936</th>\n",
       "      <td>\\n        Furnished 3bdrm Apartment in Tamale Airport Road. For Rent\\n</td>\n",
       "      <td>3000</td>\n",
       "      <td>\\n                            V.I.P furnished apartment house for rent on the Tamale airport road\\n</td>\n",
       "      <td>\\n            Northern Region, Tamale Municipal\\n</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>937</th>\n",
       "      <td>\\n        Furnished 1bdrm Apartment in East Legon, American House for Rent\\n</td>\n",
       "      <td>7480</td>\n",
       "      <td>\\n                            This beautiful chamber and hall Apartment is going for 3months or 1year advance it,s so affordable...\\n</td>\n",
       "      <td>\\n            Greater Accra, East Legon\\n</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>938</th>\n",
       "      <td>\\n        1bdrm Apartment in Divine Mercy Agency, Awutu Senya East Municipal\\n</td>\n",
       "      <td>400</td>\n",
       "      <td>\\n                            Chamber and hall self contained.\\nLocated at Choice weija\\ngoing for 400gh accept 1year rent.\\nWall and...\\n</td>\n",
       "      <td>\\n            Central Region, Awutu Senya East Municipal\\n</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>939</th>\n",
       "      <td>\\n        2bdrm Apartment in Tamale, Shishegu for Rent\\n</td>\n",
       "      <td>700</td>\n",
       "      <td>\\n                            2 bedroom apartment self compound,comes with p.o.p,nice kitchen, washroom, water flows always\\n</td>\n",
       "      <td>\\n            Northern Region, Tamale Municipal\\n</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                                  Title  \\\n",
       "935                   \\n        5bdrm Duplex in Living Large, East Legon for Rent\\n       \n",
       "936          \\n        Furnished 3bdrm Apartment in Tamale Airport Road. For Rent\\n       \n",
       "937    \\n        Furnished 1bdrm Apartment in East Legon, American House for Rent\\n       \n",
       "938  \\n        1bdrm Apartment in Divine Mercy Agency, Awutu Senya East Municipal\\n       \n",
       "939                        \\n        2bdrm Apartment in Tamale, Shishegu for Rent\\n       \n",
       "\n",
       "     Price  \\\n",
       "935   9000   \n",
       "936   3000   \n",
       "937   7480   \n",
       "938    400   \n",
       "939    700   \n",
       "\n",
       "                                                                                                                                                            Description  \\\n",
       "935     \\n                            Executive 5 bedroom newly built house with a boy’s quarters for rent at west trasacco very nice also...\\n                           \n",
       "936                                         \\n                            V.I.P furnished apartment house for rent on the Tamale airport road\\n                           \n",
       "937       \\n                            This beautiful chamber and hall Apartment is going for 3months or 1year advance it,s so affordable...\\n                           \n",
       "938  \\n                            Chamber and hall self contained.\\nLocated at Choice weija\\ngoing for 400gh accept 1year rent.\\nWall and...\\n                           \n",
       "939               \\n                            2 bedroom apartment self compound,comes with p.o.p,nice kitchen, washroom, water flows always\\n                           \n",
       "\n",
       "                                                               Location  \n",
       "935                   \\n            Greater Accra, East Legon\\n          \n",
       "936           \\n            Northern Region, Tamale Municipal\\n          \n",
       "937                   \\n            Greater Accra, East Legon\\n          \n",
       "938  \\n            Central Region, Awutu Senya East Municipal\\n          \n",
       "939           \\n            Northern Region, Tamale Municipal\\n          "
      ]
     },
     "execution_count": 685,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#Extracting the price collumn from the title\n",
    "df['Price'] = df['Price'].astype('str').str.extractall('(\\d+)').unstack().fillna('').sum(axis=1).astype(int)\n",
    "df.tail()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 686,
   "id": "b3466725",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Price</th>\n",
       "      <th>Description</th>\n",
       "      <th>Location</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>3bdrm Apartment in Spintex for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...</td>\n",
       "      <td>Greater Accra, Spintex</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent</td>\n",
       "      <td>32000</td>\n",
       "      <td>4 bedroom townhouse + going for ;  Located Cantonment</td>\n",
       "      <td>Greater Accra, Cantonments</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2bdrm Apartment in West Trassaco, Adjiriganor for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom</td>\n",
       "      <td>Greater Accra, Adjiriganor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>3bdrm Duplex in Spintex, Tema Metropolitan for Rent</td>\n",
       "      <td>6400</td>\n",
       "      <td>Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...</td>\n",
       "      <td>Greater Accra, Tema Metropolitan</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan</td>\n",
       "      <td>800</td>\n",
       "      <td>Separate meter, Available water .Space for car pack, big dinning hall and pouch</td>\n",
       "      <td>Ashanti, Kumasi Metropolitan</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                                 Title  \\\n",
       "0                                             3bdrm Apartment in Spintex for Rent        \n",
       "1           Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent        \n",
       "2                          2bdrm Apartment in West Trassaco, Adjiriganor for Rent        \n",
       "3                             3bdrm Duplex in Spintex, Tema Metropolitan for Rent        \n",
       "4                Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan        \n",
       "\n",
       "   Price  \\\n",
       "0   3500   \n",
       "1  32000   \n",
       "2   3500   \n",
       "3   6400   \n",
       "4    800   \n",
       "\n",
       "                                                                                                                                                 Description  \\\n",
       "0                                   Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...                            \n",
       "1                                                                             4 bedroom townhouse + going for ;  Located Cantonment                            \n",
       "2                                  Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom                            \n",
       "3                               Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...                            \n",
       "4                                                   Separate meter, Available water .Space for car pack, big dinning hall and pouch                            \n",
       "\n",
       "                                                 Location  \n",
       "0                         Greater Accra, Spintex           \n",
       "1                     Greater Accra, Cantonments           \n",
       "2                     Greater Accra, Adjiriganor           \n",
       "3               Greater Accra, Tema Metropolitan           \n",
       "4                   Ashanti, Kumasi Metropolitan           "
      ]
     },
     "execution_count": 686,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#removing \"\\n\" from the title\n",
    "df = df.replace(r'\\n',' ', regex=True) \n",
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "3fa93ec6",
   "metadata": {},
   "source": [
    "<a id=\"four\"></a>\n",
    "## 4. Data Engineering\n",
    "<a class=\"anchor\" id=\"1.1\"></a>\n",
    "<a href=#cont>Back to Table of Contents</a>\n",
    "\n",
    "---\n",
    "    \n",
    "| ⚡ Description: Data engineering ⚡ |\n",
    "| :--------------------------- |\n",
    "| In this section we would be: cleaning the dataset, and possibly create new features - as identified in the EDA phase. |\n",
    "\n",
    "---"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "e70a1df4",
   "metadata": {},
   "source": [
    "### 4.1 The Importance of Feature Engineering in data science?\n",
    "In Data Science, the quality of data input into a model determines the model's performance. Data preprocessing and data handling are commonly used to improve data quality. Let's say we develop a model without engineering the data and attain a 40 percent accuracy. The model's performance can be improved by up to 70% or more by doing feature engineering on the same data before feeding it to the model.\n",
    "\n",
    "Simply, by using Feature Engineering we improve can the performance of the model greatly. As we saw in the previous section (EDA), we highlighted some columns to be dropped as well as columns with categorical values.\n",
    "\n",
    "We will now do the following:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 687,
   "id": "c1eb000d",
   "metadata": {},
   "outputs": [],
   "source": [
    "#extracting \n",
    "df['Rooms'] = df['Title'].astype('str').str.extractall('(\\d+)').unstack().fillna('').sum(axis=1).astype(int)\n",
    "# #convert the Romss colum to string\n",
    "df['Rooms'] = df['Rooms'].astype(str)\n",
    "# extracting the first number\n",
    "df['Rooms'] = df['Rooms'].str.extract('(\\d{,1})')\n",
    "df[\"Rooms\"] = pd.to_numeric(df[\"Rooms\"])\n",
    "# df.loc[df['Rooms'] > 10]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 688,
   "id": "d3e83b76",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 940 entries, 0 to 939\n",
      "Data columns (total 5 columns):\n",
      " #   Column       Non-Null Count  Dtype  \n",
      "---  ------       --------------  -----  \n",
      " 0   Title        940 non-null    object \n",
      " 1   Price        940 non-null    int32  \n",
      " 2   Description  940 non-null    object \n",
      " 3   Location     940 non-null    object \n",
      " 4   Rooms        936 non-null    float64\n",
      "dtypes: float64(1), int32(1), object(3)\n",
      "memory usage: 33.2+ KB\n",
      "NUL Values\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "(None,\n",
       " Title          0\n",
       " Price          0\n",
       " Description    0\n",
       " Location       0\n",
       " Rooms          4\n",
       " dtype: int64)"
      ]
     },
     "execution_count": 688,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Summary(df)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 689,
   "id": "52fe17b8",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Price</th>\n",
       "      <th>Description</th>\n",
       "      <th>Location</th>\n",
       "      <th>Rooms</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>3bdrm Apartment in Spintex for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...</td>\n",
       "      <td>Greater Accra, Spintex</td>\n",
       "      <td>3.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent</td>\n",
       "      <td>32000</td>\n",
       "      <td>4 bedroom townhouse + going for ;  Located Cantonment</td>\n",
       "      <td>Greater Accra, Cantonments</td>\n",
       "      <td>4.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2bdrm Apartment in West Trassaco, Adjiriganor for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom</td>\n",
       "      <td>Greater Accra, Adjiriganor</td>\n",
       "      <td>2.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>3bdrm Duplex in Spintex, Tema Metropolitan for Rent</td>\n",
       "      <td>6400</td>\n",
       "      <td>Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...</td>\n",
       "      <td>Greater Accra, Tema Metropolitan</td>\n",
       "      <td>3.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan</td>\n",
       "      <td>800</td>\n",
       "      <td>Separate meter, Available water .Space for car pack, big dinning hall and pouch</td>\n",
       "      <td>Ashanti, Kumasi Metropolitan</td>\n",
       "      <td>2.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>285</th>\n",
       "      <td>5bdrm House in East Legon for Rent</td>\n",
       "      <td>15600</td>\n",
       "      <td>5-bedroom house with 1bq to-let at East Legon not far from Emanuel eye clinic asking price is...</td>\n",
       "      <td>Greater Accra, East Legon</td>\n",
       "      <td>5.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>286</th>\n",
       "      <td>Furnished 3bdrm Apartment in Airport Residential for Rent</td>\n",
       "      <td>36000</td>\n",
       "      <td>3 BEDROOM APARTMENT LETTING IN WEST AIRPORT RESIDENTIAL AREA, ACCRA.  $4500 Living in the highest...</td>\n",
       "      <td>Greater Accra, Airport Residential Area</td>\n",
       "      <td>3.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>287</th>\n",
       "      <td>2bdrm Apartment in Íke, East Legon for Rent</td>\n",
       "      <td>1700</td>\n",
       "      <td>2 BEDROOMS 2 WASHROOMS 1700 Newly Built Agbogba 3 tenants to be on the compounded</td>\n",
       "      <td>Greater Accra, East Legon</td>\n",
       "      <td>2.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>288</th>\n",
       "      <td>3bdrm Apartment in Kings Properties, Old Ashomang for Rent</td>\n",
       "      <td>2700</td>\n",
       "      <td>Three bedroom self compound,gated community at old ashongman ghc 2,700 a month for one year.contact...</td>\n",
       "      <td>Greater Accra, Old Ashomang</td>\n",
       "      <td>3.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>289</th>\n",
       "      <td>2bdrm Apartment in Abokobi Council for Rent</td>\n",
       "      <td>1500</td>\n",
       "      <td>Two bedroom apartment for rent at Abokobi council... 24/7water flow and gated and walled as well has...</td>\n",
       "      <td>Greater Accra, Abokobi</td>\n",
       "      <td>2.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>290 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                                   Title  \\\n",
       "0                                               3bdrm Apartment in Spintex for Rent        \n",
       "1             Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent        \n",
       "2                            2bdrm Apartment in West Trassaco, Adjiriganor for Rent        \n",
       "3                               3bdrm Duplex in Spintex, Tema Metropolitan for Rent        \n",
       "4                  Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan        \n",
       "..                                                                                   ...   \n",
       "285                                              5bdrm House in East Legon for Rent        \n",
       "286                       Furnished 3bdrm Apartment in Airport Residential for Rent        \n",
       "287                                     2bdrm Apartment in Íke, East Legon for Rent        \n",
       "288                      3bdrm Apartment in Kings Properties, Old Ashomang for Rent        \n",
       "289                                     2bdrm Apartment in Abokobi Council for Rent        \n",
       "\n",
       "     Price  \\\n",
       "0     3500   \n",
       "1    32000   \n",
       "2     3500   \n",
       "3     6400   \n",
       "4      800   \n",
       "..     ...   \n",
       "285  15600   \n",
       "286  36000   \n",
       "287   1700   \n",
       "288   2700   \n",
       "289   1500   \n",
       "\n",
       "                                                                                                                                                       Description  \\\n",
       "0                                         Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...                            \n",
       "1                                                                                   4 bedroom townhouse + going for ;  Located Cantonment                            \n",
       "2                                        Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom                            \n",
       "3                                     Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...                            \n",
       "4                                                         Separate meter, Available water .Space for car pack, big dinning hall and pouch                            \n",
       "..                                                                                                                                                             ...   \n",
       "285                                      5-bedroom house with 1bq to-let at East Legon not far from Emanuel eye clinic asking price is...                            \n",
       "286                                  3 BEDROOM APARTMENT LETTING IN WEST AIRPORT RESIDENTIAL AREA, ACCRA.  $4500 Living in the highest...                            \n",
       "287                                                     2 BEDROOMS 2 WASHROOMS 1700 Newly Built Agbogba 3 tenants to be on the compounded                            \n",
       "288                                Three bedroom self compound,gated community at old ashongman ghc 2,700 a month for one year.contact...                            \n",
       "289                               Two bedroom apartment for rent at Abokobi council... 24/7water flow and gated and walled as well has...                            \n",
       "\n",
       "                                                          Location  Rooms  \n",
       "0                                  Greater Accra, Spintex             3.0  \n",
       "1                              Greater Accra, Cantonments             4.0  \n",
       "2                              Greater Accra, Adjiriganor             2.0  \n",
       "3                        Greater Accra, Tema Metropolitan             3.0  \n",
       "4                            Ashanti, Kumasi Metropolitan             2.0  \n",
       "..                                                             ...    ...  \n",
       "285                             Greater Accra, East Legon             5.0  \n",
       "286               Greater Accra, Airport Residential Area             3.0  \n",
       "287                             Greater Accra, East Legon             2.0  \n",
       "288                           Greater Accra, Old Ashomang             3.0  \n",
       "289                                Greater Accra, Abokobi             2.0  \n",
       "\n",
       "[290 rows x 5 columns]"
      ]
     },
     "execution_count": 689,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.head(290)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 690,
   "id": "9aff57d6",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Price</th>\n",
       "      <th>Description</th>\n",
       "      <th>Location</th>\n",
       "      <th>Rooms</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>38</th>\n",
       "      <td>An Executive Four Bedroom House for Rent</td>\n",
       "      <td>11480</td>\n",
       "      <td>4-bedrooms house plus boys quarter with fully loaded kitchen, fitted air conditioners in all rooms...</td>\n",
       "      <td>Greater Accra, Accra Metropolitan</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>293</th>\n",
       "      <td>Mini Flat in Adenta Municipal for Rent</td>\n",
       "      <td>1000</td>\n",
       "      <td>1Bedroom flat, huge hall, huge bedroom, visitors washroom, AC available,separate meter, neat kitchen...</td>\n",
       "      <td>Greater Accra, Adenta</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>478</th>\n",
       "      <td>Executive Newly Built House For Rent At East Legon Hills</td>\n",
       "      <td>2500</td>\n",
       "      <td>*executive newly  built 3 bedroom house for rent at east legon hills   *price:ghc 2,500   **spacious...</td>\n",
       "      <td>Greater Accra, East Legon</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>499</th>\n",
       "      <td>Very Big Store at Fuel Station for Rent in Tamale</td>\n",
       "      <td>700</td>\n",
       "      <td>Fuel station super market/store for rent</td>\n",
       "      <td>Northern Region, Tamale Municipal</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                      Title  \\\n",
       "38                            An Executive Four Bedroom House for Rent        \n",
       "293                             Mini Flat in Adenta Municipal for Rent        \n",
       "478           Executive Newly Built House For Rent At East Legon Hills        \n",
       "499                  Very Big Store at Fuel Station for Rent in Tamale        \n",
       "\n",
       "     Price  \\\n",
       "38   11480   \n",
       "293   1000   \n",
       "478   2500   \n",
       "499    700   \n",
       "\n",
       "                                                                                                                                                       Description  \\\n",
       "38                                  4-bedrooms house plus boys quarter with fully loaded kitchen, fitted air conditioners in all rooms...                            \n",
       "293                               1Bedroom flat, huge hall, huge bedroom, visitors washroom, AC available,separate meter, neat kitchen...                            \n",
       "478                               *executive newly  built 3 bedroom house for rent at east legon hills   *price:ghc 2,500   **spacious...                            \n",
       "499                                                                                              Fuel station super market/store for rent                            \n",
       "\n",
       "                                                    Location  Rooms  \n",
       "38                Greater Accra, Accra Metropolitan             NaN  \n",
       "293                           Greater Accra, Adenta             NaN  \n",
       "478                       Greater Accra, East Legon             NaN  \n",
       "499               Northern Region, Tamale Municipal             NaN  "
      ]
     },
     "execution_count": 690,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#identify the empty columns\n",
    "df[df['Rooms'].isna()]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 691,
   "id": "b395b05f",
   "metadata": {},
   "outputs": [],
   "source": [
    "df['Rooms'] = df['Rooms'].fillna(pd.to_numeric(df['Description'].astype('str').str.extractall('(\\d+)').unstack().fillna('').sum(axis=1).astype(int)))\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 692,
   "id": "29fcc1fc",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Price</th>\n",
       "      <th>Description</th>\n",
       "      <th>Location</th>\n",
       "      <th>Rooms</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>3bdrm Apartment in Spintex for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...</td>\n",
       "      <td>Greater Accra, Spintex</td>\n",
       "      <td>3.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent</td>\n",
       "      <td>32000</td>\n",
       "      <td>4 bedroom townhouse + going for ;  Located Cantonment</td>\n",
       "      <td>Greater Accra, Cantonments</td>\n",
       "      <td>4.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2bdrm Apartment in West Trassaco, Adjiriganor for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom</td>\n",
       "      <td>Greater Accra, Adjiriganor</td>\n",
       "      <td>2.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>3bdrm Duplex in Spintex, Tema Metropolitan for Rent</td>\n",
       "      <td>6400</td>\n",
       "      <td>Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...</td>\n",
       "      <td>Greater Accra, Tema Metropolitan</td>\n",
       "      <td>3.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan</td>\n",
       "      <td>800</td>\n",
       "      <td>Separate meter, Available water .Space for car pack, big dinning hall and pouch</td>\n",
       "      <td>Ashanti, Kumasi Metropolitan</td>\n",
       "      <td>2.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>495</th>\n",
       "      <td>1bdrm Apartment in Mic Properties, Ashaley Botwe for Rent</td>\n",
       "      <td>800</td>\n",
       "      <td>Chamber and hall s/c for rent @ Ashley Botwe</td>\n",
       "      <td>Greater Accra, Ashaley Botwe</td>\n",
       "      <td>1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>496</th>\n",
       "      <td>1bdrm Apartment in Divine Mercy Agency, Awutu Senya West for Rent</td>\n",
       "      <td>300</td>\n",
       "      <td>Chamber and hall self contained  Located at Lamptey area kasoa going for 300gh accept 1year...</td>\n",
       "      <td>Central Region, Awutu Senya West</td>\n",
       "      <td>1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>497</th>\n",
       "      <td>4bdrm House in Living Large, East Legon for Rent</td>\n",
       "      <td>8500</td>\n",
       "      <td>4 BEDROOM LUXURIOUS HOUSE FOR RENT East legon Ajiriganor  4 bedrooms is available for tent at East...</td>\n",
       "      <td>Greater Accra, East Legon</td>\n",
       "      <td>4.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>498</th>\n",
       "      <td>3bdrm Apartment in Dome for Rent</td>\n",
       "      <td>1500</td>\n",
       "      <td>Executive standard ultramodern newly built three bedrooms apartment located in a nice serene...</td>\n",
       "      <td>Greater Accra, Dome</td>\n",
       "      <td>3.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>499</th>\n",
       "      <td>Very Big Store at Fuel Station for Rent in Tamale</td>\n",
       "      <td>700</td>\n",
       "      <td>Fuel station super market/store for rent</td>\n",
       "      <td>Northern Region, Tamale Municipal</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>500 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                                   Title  \\\n",
       "0                                               3bdrm Apartment in Spintex for Rent        \n",
       "1             Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent        \n",
       "2                            2bdrm Apartment in West Trassaco, Adjiriganor for Rent        \n",
       "3                               3bdrm Duplex in Spintex, Tema Metropolitan for Rent        \n",
       "4                  Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan        \n",
       "..                                                                                   ...   \n",
       "495                       1bdrm Apartment in Mic Properties, Ashaley Botwe for Rent        \n",
       "496               1bdrm Apartment in Divine Mercy Agency, Awutu Senya West for Rent        \n",
       "497                                4bdrm House in Living Large, East Legon for Rent        \n",
       "498                                                3bdrm Apartment in Dome for Rent        \n",
       "499                               Very Big Store at Fuel Station for Rent in Tamale        \n",
       "\n",
       "     Price  \\\n",
       "0     3500   \n",
       "1    32000   \n",
       "2     3500   \n",
       "3     6400   \n",
       "4      800   \n",
       "..     ...   \n",
       "495    800   \n",
       "496    300   \n",
       "497   8500   \n",
       "498   1500   \n",
       "499    700   \n",
       "\n",
       "                                                                                                                                                     Description  \\\n",
       "0                                       Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...                            \n",
       "1                                                                                 4 bedroom townhouse + going for ;  Located Cantonment                            \n",
       "2                                      Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom                            \n",
       "3                                   Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...                            \n",
       "4                                                       Separate meter, Available water .Space for car pack, big dinning hall and pouch                            \n",
       "..                                                                                                                                                           ...   \n",
       "495                                                                                        Chamber and hall s/c for rent @ Ashley Botwe                            \n",
       "496                                      Chamber and hall self contained  Located at Lamptey area kasoa going for 300gh accept 1year...                            \n",
       "497                               4 BEDROOM LUXURIOUS HOUSE FOR RENT East legon Ajiriganor  4 bedrooms is available for tent at East...                            \n",
       "498                                     Executive standard ultramodern newly built three bedrooms apartment located in a nice serene...                            \n",
       "499                                                                                            Fuel station super market/store for rent                            \n",
       "\n",
       "                                                    Location  Rooms  \n",
       "0                            Greater Accra, Spintex             3.0  \n",
       "1                        Greater Accra, Cantonments             4.0  \n",
       "2                        Greater Accra, Adjiriganor             2.0  \n",
       "3                  Greater Accra, Tema Metropolitan             3.0  \n",
       "4                      Ashanti, Kumasi Metropolitan             2.0  \n",
       "..                                                       ...    ...  \n",
       "495                    Greater Accra, Ashaley Botwe             1.0  \n",
       "496                Central Region, Awutu Senya West             1.0  \n",
       "497                       Greater Accra, East Legon             4.0  \n",
       "498                             Greater Accra, Dome             3.0  \n",
       "499               Northern Region, Tamale Municipal             NaN  \n",
       "\n",
       "[500 rows x 5 columns]"
      ]
     },
     "execution_count": 692,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.head(500)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 693,
   "id": "e58f9510",
   "metadata": {},
   "outputs": [],
   "source": [
    "# droping empty rows in price\n",
    "df = df.drop(labels=499, axis=0)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 694,
   "id": "3660b887",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Price</th>\n",
       "      <th>Description</th>\n",
       "      <th>Location</th>\n",
       "      <th>Rooms</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>3bdrm Apartment in Spintex for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...</td>\n",
       "      <td>Greater Accra, Spintex</td>\n",
       "      <td>3.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent</td>\n",
       "      <td>32000</td>\n",
       "      <td>4 bedroom townhouse + going for ;  Located Cantonment</td>\n",
       "      <td>Greater Accra, Cantonments</td>\n",
       "      <td>4.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2bdrm Apartment in West Trassaco, Adjiriganor for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom</td>\n",
       "      <td>Greater Accra, Adjiriganor</td>\n",
       "      <td>2.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>3bdrm Duplex in Spintex, Tema Metropolitan for Rent</td>\n",
       "      <td>6400</td>\n",
       "      <td>Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...</td>\n",
       "      <td>Greater Accra, Tema Metropolitan</td>\n",
       "      <td>3.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan</td>\n",
       "      <td>800</td>\n",
       "      <td>Separate meter, Available water .Space for car pack, big dinning hall and pouch</td>\n",
       "      <td>Ashanti, Kumasi Metropolitan</td>\n",
       "      <td>2.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>495</th>\n",
       "      <td>1bdrm Apartment in Mic Properties, Ashaley Botwe for Rent</td>\n",
       "      <td>800</td>\n",
       "      <td>Chamber and hall s/c for rent @ Ashley Botwe</td>\n",
       "      <td>Greater Accra, Ashaley Botwe</td>\n",
       "      <td>1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>496</th>\n",
       "      <td>1bdrm Apartment in Divine Mercy Agency, Awutu Senya West for Rent</td>\n",
       "      <td>300</td>\n",
       "      <td>Chamber and hall self contained  Located at Lamptey area kasoa going for 300gh accept 1year...</td>\n",
       "      <td>Central Region, Awutu Senya West</td>\n",
       "      <td>1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>497</th>\n",
       "      <td>4bdrm House in Living Large, East Legon for Rent</td>\n",
       "      <td>8500</td>\n",
       "      <td>4 BEDROOM LUXURIOUS HOUSE FOR RENT East legon Ajiriganor  4 bedrooms is available for tent at East...</td>\n",
       "      <td>Greater Accra, East Legon</td>\n",
       "      <td>4.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>498</th>\n",
       "      <td>3bdrm Apartment in Dome for Rent</td>\n",
       "      <td>1500</td>\n",
       "      <td>Executive standard ultramodern newly built three bedrooms apartment located in a nice serene...</td>\n",
       "      <td>Greater Accra, Dome</td>\n",
       "      <td>3.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>500</th>\n",
       "      <td>Furnished 5bdrm Townhouse/Terrace in Eastlegon, Accra Metropolitan</td>\n",
       "      <td>22400</td>\n",
       "      <td>FOR RENT: Newly Built 5 Bedroom Town House for rent #Location Eastlegon  Price-$3,500 for all...</td>\n",
       "      <td>Greater Accra, Accra Metropolitan</td>\n",
       "      <td>5.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>500 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                                   Title  \\\n",
       "0                                               3bdrm Apartment in Spintex for Rent        \n",
       "1             Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent        \n",
       "2                            2bdrm Apartment in West Trassaco, Adjiriganor for Rent        \n",
       "3                               3bdrm Duplex in Spintex, Tema Metropolitan for Rent        \n",
       "4                  Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan        \n",
       "..                                                                                   ...   \n",
       "495                       1bdrm Apartment in Mic Properties, Ashaley Botwe for Rent        \n",
       "496               1bdrm Apartment in Divine Mercy Agency, Awutu Senya West for Rent        \n",
       "497                                4bdrm House in Living Large, East Legon for Rent        \n",
       "498                                                3bdrm Apartment in Dome for Rent        \n",
       "500              Furnished 5bdrm Townhouse/Terrace in Eastlegon, Accra Metropolitan        \n",
       "\n",
       "     Price  \\\n",
       "0     3500   \n",
       "1    32000   \n",
       "2     3500   \n",
       "3     6400   \n",
       "4      800   \n",
       "..     ...   \n",
       "495    800   \n",
       "496    300   \n",
       "497   8500   \n",
       "498   1500   \n",
       "500  22400   \n",
       "\n",
       "                                                                                                                                                     Description  \\\n",
       "0                                       Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...                            \n",
       "1                                                                                 4 bedroom townhouse + going for ;  Located Cantonment                            \n",
       "2                                      Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom                            \n",
       "3                                   Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...                            \n",
       "4                                                       Separate meter, Available water .Space for car pack, big dinning hall and pouch                            \n",
       "..                                                                                                                                                           ...   \n",
       "495                                                                                        Chamber and hall s/c for rent @ Ashley Botwe                            \n",
       "496                                      Chamber and hall self contained  Located at Lamptey area kasoa going for 300gh accept 1year...                            \n",
       "497                               4 BEDROOM LUXURIOUS HOUSE FOR RENT East legon Ajiriganor  4 bedrooms is available for tent at East...                            \n",
       "498                                     Executive standard ultramodern newly built three bedrooms apartment located in a nice serene...                            \n",
       "500                                    FOR RENT: Newly Built 5 Bedroom Town House for rent #Location Eastlegon  Price-$3,500 for all...                            \n",
       "\n",
       "                                                    Location  Rooms  \n",
       "0                            Greater Accra, Spintex             3.0  \n",
       "1                        Greater Accra, Cantonments             4.0  \n",
       "2                        Greater Accra, Adjiriganor             2.0  \n",
       "3                  Greater Accra, Tema Metropolitan             3.0  \n",
       "4                      Ashanti, Kumasi Metropolitan             2.0  \n",
       "..                                                       ...    ...  \n",
       "495                    Greater Accra, Ashaley Botwe             1.0  \n",
       "496                Central Region, Awutu Senya West             1.0  \n",
       "497                       Greater Accra, East Legon             4.0  \n",
       "498                             Greater Accra, Dome             3.0  \n",
       "500               Greater Accra, Accra Metropolitan             5.0  \n",
       "\n",
       "[500 rows x 5 columns]"
      ]
     },
     "execution_count": 694,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#checking if nan values have been filled\n",
    "df.head(500)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 695,
   "id": "979b3bd5",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "Int64Index: 939 entries, 0 to 939\n",
      "Data columns (total 5 columns):\n",
      " #   Column       Non-Null Count  Dtype  \n",
      "---  ------       --------------  -----  \n",
      " 0   Title        939 non-null    object \n",
      " 1   Price        939 non-null    int32  \n",
      " 2   Description  939 non-null    object \n",
      " 3   Location     939 non-null    object \n",
      " 4   Rooms        939 non-null    float64\n",
      "dtypes: float64(1), int32(1), object(3)\n",
      "memory usage: 40.3+ KB\n",
      "NUL Values\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "(None,\n",
       " Title          0\n",
       " Price          0\n",
       " Description    0\n",
       " Location       0\n",
       " Rooms          0\n",
       " dtype: int64)"
      ]
     },
     "execution_count": 695,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#from line 603 we see some values in the rooms column have 2 figures\n",
    "Summary(df)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 696,
   "id": "1d01cb3a",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Price</th>\n",
       "      <th>Description</th>\n",
       "      <th>Location</th>\n",
       "      <th>Rooms</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>478</th>\n",
       "      <td>Executive Newly Built House For Rent At East Legon Hills</td>\n",
       "      <td>2500</td>\n",
       "      <td>*executive newly  built 3 bedroom house for rent at east legon hills   *price:ghc 2,500   **spacious...</td>\n",
       "      <td>Greater Accra, East Legon</td>\n",
       "      <td>32500.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>531</th>\n",
       "      <td>EXECUTIVE 9 BEDROOMS FOR RENTALS AT EAST LEGON A&amp;C MALL FOR 4000 $</td>\n",
       "      <td>20000</td>\n",
       "      <td>EXECUTIVE 9 BEDROOMS   AND A GARDEN #Location: EAST LEGON-A&amp;C MALL # RESIDENTIAL AND OFFICE...</td>\n",
       "      <td>Greater Accra, Agbogbloshie</td>\n",
       "      <td>9.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                                Title  \\\n",
       "478                     Executive Newly Built House For Rent At East Legon Hills        \n",
       "531           EXECUTIVE 9 BEDROOMS FOR RENTALS AT EAST LEGON A&C MALL FOR 4000 $        \n",
       "\n",
       "     Price  \\\n",
       "478   2500   \n",
       "531  20000   \n",
       "\n",
       "                                                                                                                                                       Description  \\\n",
       "478                               *executive newly  built 3 bedroom house for rent at east legon hills   *price:ghc 2,500   **spacious...                            \n",
       "531                                        EXECUTIVE 9 BEDROOMS   AND A GARDEN #Location: EAST LEGON-A&C MALL # RESIDENTIAL AND OFFICE...                            \n",
       "\n",
       "                                              Location    Rooms  \n",
       "478                 Greater Accra, East Legon           32500.0  \n",
       "531               Greater Accra, Agbogbloshie               9.0  "
      ]
     },
     "execution_count": 696,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.loc[df['Rooms'] >= 9]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 697,
   "id": "b21d06a3",
   "metadata": {},
   "outputs": [],
   "source": [
    "#extracting the first 2 element of the column\n",
    "df['Rooms'] = df.Rooms.astype(str).str[:1]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 698,
   "id": "5f597eae",
   "metadata": {},
   "outputs": [],
   "source": [
    "# extracting the numbers to get rid of the comma\n",
    "df['Rooms'] = df['Rooms'].astype('str').str.extractall('(\\d+)').unstack().fillna('').sum(axis=1).astype(int)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 699,
   "id": "58b2f774",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Price</th>\n",
       "      <th>Description</th>\n",
       "      <th>Location</th>\n",
       "      <th>Rooms</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>3bdrm Apartment in Spintex for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...</td>\n",
       "      <td>Greater Accra, Spintex</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent</td>\n",
       "      <td>32000</td>\n",
       "      <td>4 bedroom townhouse + going for ;  Located Cantonment</td>\n",
       "      <td>Greater Accra, Cantonments</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2bdrm Apartment in West Trassaco, Adjiriganor for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom</td>\n",
       "      <td>Greater Accra, Adjiriganor</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>3bdrm Duplex in Spintex, Tema Metropolitan for Rent</td>\n",
       "      <td>6400</td>\n",
       "      <td>Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...</td>\n",
       "      <td>Greater Accra, Tema Metropolitan</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan</td>\n",
       "      <td>800</td>\n",
       "      <td>Separate meter, Available water .Space for car pack, big dinning hall and pouch</td>\n",
       "      <td>Ashanti, Kumasi Metropolitan</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>600</th>\n",
       "      <td>2bdrm Apartment in the Dorns Properties, New Town for Rent</td>\n",
       "      <td>1300</td>\n",
       "      <td>Executive newly built 2 bedroom apartment for rent @ teshie bush road, separate light meter,water...</td>\n",
       "      <td>Greater Accra, Teshie</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>601</th>\n",
       "      <td>3bdrm Apartment in East Legon for Rent</td>\n",
       "      <td>2800</td>\n",
       "      <td>2 bedroom  American House - East Legon. ...  1 year Accepted. 2 years Accepted... etc ...  Newly...</td>\n",
       "      <td>Greater Accra, East Legon</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>602</th>\n",
       "      <td>2bdrm Apartment in Living Large, East Legon for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Executive 2 bedroom apartment house to let at west trasacco not far from the main trasacco...</td>\n",
       "      <td>Greater Accra, East Legon</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>603</th>\n",
       "      <td>2bdrm Apartment in East Legon for Rent</td>\n",
       "      <td>2000</td>\n",
       "      <td>Newly built 2 bedrooms, spacious, glazed, p.o.p, water and electricity available, balcony, kitchen...</td>\n",
       "      <td>Greater Accra, East Legon</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>604</th>\n",
       "      <td>Furnished 2bdrm Apartment in East Legon for Rent</td>\n",
       "      <td>8000</td>\n",
       "      <td>Executive fully-furnished 2bedroom at East legon ability is for rent</td>\n",
       "      <td>Greater Accra, East Legon</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>604 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                                   Title  \\\n",
       "0                                               3bdrm Apartment in Spintex for Rent        \n",
       "1             Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent        \n",
       "2                            2bdrm Apartment in West Trassaco, Adjiriganor for Rent        \n",
       "3                               3bdrm Duplex in Spintex, Tema Metropolitan for Rent        \n",
       "4                  Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan        \n",
       "..                                                                                   ...   \n",
       "600                      2bdrm Apartment in the Dorns Properties, New Town for Rent        \n",
       "601                                          3bdrm Apartment in East Legon for Rent        \n",
       "602                            2bdrm Apartment in Living Large, East Legon for Rent        \n",
       "603                                          2bdrm Apartment in East Legon for Rent        \n",
       "604                                Furnished 2bdrm Apartment in East Legon for Rent        \n",
       "\n",
       "     Price  \\\n",
       "0     3500   \n",
       "1    32000   \n",
       "2     3500   \n",
       "3     6400   \n",
       "4      800   \n",
       "..     ...   \n",
       "600   1300   \n",
       "601   2800   \n",
       "602   3500   \n",
       "603   2000   \n",
       "604   8000   \n",
       "\n",
       "                                                                                                                                                     Description  \\\n",
       "0                                       Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...                            \n",
       "1                                                                                 4 bedroom townhouse + going for ;  Located Cantonment                            \n",
       "2                                      Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom                            \n",
       "3                                   Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...                            \n",
       "4                                                       Separate meter, Available water .Space for car pack, big dinning hall and pouch                            \n",
       "..                                                                                                                                                           ...   \n",
       "600                                Executive newly built 2 bedroom apartment for rent @ teshie bush road, separate light meter,water...                            \n",
       "601                                 2 bedroom  American House - East Legon. ...  1 year Accepted. 2 years Accepted... etc ...  Newly...                            \n",
       "602                                       Executive 2 bedroom apartment house to let at west trasacco not far from the main trasacco...                            \n",
       "603                               Newly built 2 bedrooms, spacious, glazed, p.o.p, water and electricity available, balcony, kitchen...                            \n",
       "604                                                                Executive fully-furnished 2bedroom at East legon ability is for rent                            \n",
       "\n",
       "                                                   Location  Rooms  \n",
       "0                           Greater Accra, Spintex               3  \n",
       "1                       Greater Accra, Cantonments               4  \n",
       "2                       Greater Accra, Adjiriganor               2  \n",
       "3                 Greater Accra, Tema Metropolitan               3  \n",
       "4                     Ashanti, Kumasi Metropolitan               2  \n",
       "..                                                      ...    ...  \n",
       "600                          Greater Accra, Teshie               2  \n",
       "601                      Greater Accra, East Legon               3  \n",
       "602                      Greater Accra, East Legon               2  \n",
       "603                      Greater Accra, East Legon               2  \n",
       "604                      Greater Accra, East Legon               2  \n",
       "\n",
       "[604 rows x 5 columns]"
      ]
     },
     "execution_count": 699,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#checking if line 603 is fixed\n",
    "df.head(604)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 700,
   "id": "75d13ce7",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "Int64Index: 939 entries, 0 to 939\n",
      "Data columns (total 5 columns):\n",
      " #   Column       Non-Null Count  Dtype \n",
      "---  ------       --------------  ----- \n",
      " 0   Title        939 non-null    object\n",
      " 1   Price        939 non-null    int32 \n",
      " 2   Description  939 non-null    object\n",
      " 3   Location     939 non-null    object\n",
      " 4   Rooms        939 non-null    int32 \n",
      "dtypes: int32(2), object(3)\n",
      "memory usage: 36.7+ KB\n",
      "NUL Values\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "(None,\n",
       " Title          0\n",
       " Price          0\n",
       " Description    0\n",
       " Location       0\n",
       " Rooms          0\n",
       " dtype: int64)"
      ]
     },
     "execution_count": 700,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Summary(df)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 701,
   "id": "7e1023b7",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Price</th>\n",
       "      <th>Description</th>\n",
       "      <th>Location</th>\n",
       "      <th>Rooms</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>3bdrm Apartment in Spintex for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...</td>\n",
       "      <td>Greater Accra, Spintex</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent</td>\n",
       "      <td>32000</td>\n",
       "      <td>4 bedroom townhouse + going for ;  Located Cantonment</td>\n",
       "      <td>Greater Accra, Cantonments</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2bdrm Apartment in West Trassaco, Adjiriganor for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom</td>\n",
       "      <td>Greater Accra, Adjiriganor</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>3bdrm Duplex in Spintex, Tema Metropolitan for Rent</td>\n",
       "      <td>6400</td>\n",
       "      <td>Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...</td>\n",
       "      <td>Greater Accra, Tema Metropolitan</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan</td>\n",
       "      <td>800</td>\n",
       "      <td>Separate meter, Available water .Space for car pack, big dinning hall and pouch</td>\n",
       "      <td>Ashanti, Kumasi Metropolitan</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                                 Title  \\\n",
       "0                                             3bdrm Apartment in Spintex for Rent        \n",
       "1           Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent        \n",
       "2                          2bdrm Apartment in West Trassaco, Adjiriganor for Rent        \n",
       "3                             3bdrm Duplex in Spintex, Tema Metropolitan for Rent        \n",
       "4                Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan        \n",
       "\n",
       "   Price  \\\n",
       "0   3500   \n",
       "1  32000   \n",
       "2   3500   \n",
       "3   6400   \n",
       "4    800   \n",
       "\n",
       "                                                                                                                                                 Description  \\\n",
       "0                                   Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...                            \n",
       "1                                                                             4 bedroom townhouse + going for ;  Located Cantonment                            \n",
       "2                                  Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom                            \n",
       "3                               Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...                            \n",
       "4                                                   Separate meter, Available water .Space for car pack, big dinning hall and pouch                            \n",
       "\n",
       "                                                 Location  Rooms  \n",
       "0                         Greater Accra, Spintex               3  \n",
       "1                     Greater Accra, Cantonments               4  \n",
       "2                     Greater Accra, Adjiriganor               2  \n",
       "3               Greater Accra, Tema Metropolitan               3  \n",
       "4                   Ashanti, Kumasi Metropolitan               2  "
      ]
     },
     "execution_count": 701,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 702,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Price</th>\n",
       "      <th>Description</th>\n",
       "      <th>Location</th>\n",
       "      <th>Rooms</th>\n",
       "      <th>Regions</th>\n",
       "      <th>Suburb</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>3bdrm Apartment in Spintex for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...</td>\n",
       "      <td>greater accra, spintex</td>\n",
       "      <td>3</td>\n",
       "      <td>greater accra</td>\n",
       "      <td>spintex</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent</td>\n",
       "      <td>32000</td>\n",
       "      <td>4 bedroom townhouse + going for ;  Located Cantonment</td>\n",
       "      <td>greater accra, cantonments</td>\n",
       "      <td>4</td>\n",
       "      <td>greater accra</td>\n",
       "      <td>cantonments</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2bdrm Apartment in West Trassaco, Adjiriganor for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom</td>\n",
       "      <td>greater accra, adjiriganor</td>\n",
       "      <td>2</td>\n",
       "      <td>greater accra</td>\n",
       "      <td>adjiriganor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>3bdrm Duplex in Spintex, Tema Metropolitan for Rent</td>\n",
       "      <td>6400</td>\n",
       "      <td>Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...</td>\n",
       "      <td>greater accra, tema metropolitan</td>\n",
       "      <td>3</td>\n",
       "      <td>greater accra</td>\n",
       "      <td>tema metropolitan</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan</td>\n",
       "      <td>800</td>\n",
       "      <td>Separate meter, Available water .Space for car pack, big dinning hall and pouch</td>\n",
       "      <td>ashanti, kumasi metropolitan</td>\n",
       "      <td>2</td>\n",
       "      <td>ashanti</td>\n",
       "      <td>kumasi metropolitan</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                                 Title  \\\n",
       "0                                             3bdrm Apartment in Spintex for Rent        \n",
       "1           Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent        \n",
       "2                          2bdrm Apartment in West Trassaco, Adjiriganor for Rent        \n",
       "3                             3bdrm Duplex in Spintex, Tema Metropolitan for Rent        \n",
       "4                Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan        \n",
       "\n",
       "   Price  \\\n",
       "0   3500   \n",
       "1  32000   \n",
       "2   3500   \n",
       "3   6400   \n",
       "4    800   \n",
       "\n",
       "                                                                                                                                                 Description  \\\n",
       "0                                   Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...                            \n",
       "1                                                                             4 bedroom townhouse + going for ;  Located Cantonment                            \n",
       "2                                  Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom                            \n",
       "3                               Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...                            \n",
       "4                                                   Separate meter, Available water .Space for car pack, big dinning hall and pouch                            \n",
       "\n",
       "                           Location  Rooms        Regions               Suburb  \n",
       "0            greater accra, spintex      3  greater accra              spintex  \n",
       "1        greater accra, cantonments      4  greater accra          cantonments  \n",
       "2        greater accra, adjiriganor      2  greater accra          adjiriganor  \n",
       "3  greater accra, tema metropolitan      3  greater accra    tema metropolitan  \n",
       "4      ashanti, kumasi metropolitan      2        ashanti  kumasi metropolitan  "
      ]
     },
     "execution_count": 702,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df[\"Location\"] = df[\"Location\"].str.strip() #striping the Location collum\n",
    "df[\"Location\"] = df[\"Location\"].str.lower() #converting to lowercase\n",
    "df['Regions'] = df['Location'].str.split(',').str[0] #extracting similar Regions\n",
    "df['Suburb'] = df['Location'].str.split(',').str[1] #extracting similar Subrb\n",
    "df['Suburb'] = df['Suburb'].str.strip()\n",
    "df\n",
    "sorted(df[\"Location\"].unique())\n",
    "df.head()\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 703,
   "id": "4c116823",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['ashanti',\n",
       " 'brong ahafo',\n",
       " 'central region',\n",
       " 'eastern region',\n",
       " 'greater accra',\n",
       " 'northern region',\n",
       " 'volta region',\n",
       " 'western region']"
      ]
     },
     "execution_count": 703,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "sorted(df[\"Regions\"].unique())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 704,
   "id": "75da73a5",
   "metadata": {},
   "outputs": [],
   "source": [
    "df['Regions'] = df['Regions'].str.replace(' region', '')\n",
    "df['Regions'] = df['Regions'].str.replace('brong ', '')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 705,
   "id": "cf57e541",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['ahafo',\n",
       " 'ashanti',\n",
       " 'central',\n",
       " 'eastern',\n",
       " 'greater accra',\n",
       " 'northern',\n",
       " 'volta',\n",
       " 'western']"
      ]
     },
     "execution_count": 705,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "sorted(df[\"Regions\"].unique())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 706,
   "id": "248fdea3",
   "metadata": {},
   "outputs": [],
   "source": [
    "df['Regions'] =df['Regions'].astype(str)+' region'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 707,
   "id": "3f71b3ae",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['ahafo region',\n",
       " 'ashanti region',\n",
       " 'central region',\n",
       " 'eastern region',\n",
       " 'greater accra region',\n",
       " 'northern region',\n",
       " 'volta region',\n",
       " 'western region']"
      ]
     },
     "execution_count": 707,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "sorted(df[\"Regions\"].unique())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 708,
   "id": "8b6437bb",
   "metadata": {},
   "outputs": [],
   "source": [
    "new_df = pd.merge(df, dfr,  how='left', on=[\"Regions\"])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 709,
   "id": "4e1a10b5",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Price</th>\n",
       "      <th>Description</th>\n",
       "      <th>Location</th>\n",
       "      <th>Rooms</th>\n",
       "      <th>Regions</th>\n",
       "      <th>Suburb</th>\n",
       "      <th>Latitude_Regions</th>\n",
       "      <th>Longitude_Regions</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>3bdrm Apartment in Spintex for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...</td>\n",
       "      <td>greater accra, spintex</td>\n",
       "      <td>3</td>\n",
       "      <td>greater accra region</td>\n",
       "      <td>spintex</td>\n",
       "      <td>5.810153</td>\n",
       "      <td>0.099524</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent</td>\n",
       "      <td>32000</td>\n",
       "      <td>4 bedroom townhouse + going for ;  Located Cantonment</td>\n",
       "      <td>greater accra, cantonments</td>\n",
       "      <td>4</td>\n",
       "      <td>greater accra region</td>\n",
       "      <td>cantonments</td>\n",
       "      <td>5.810153</td>\n",
       "      <td>0.099524</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2bdrm Apartment in West Trassaco, Adjiriganor for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom</td>\n",
       "      <td>greater accra, adjiriganor</td>\n",
       "      <td>2</td>\n",
       "      <td>greater accra region</td>\n",
       "      <td>adjiriganor</td>\n",
       "      <td>5.810153</td>\n",
       "      <td>0.099524</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>3bdrm Duplex in Spintex, Tema Metropolitan for Rent</td>\n",
       "      <td>6400</td>\n",
       "      <td>Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...</td>\n",
       "      <td>greater accra, tema metropolitan</td>\n",
       "      <td>3</td>\n",
       "      <td>greater accra region</td>\n",
       "      <td>tema metropolitan</td>\n",
       "      <td>5.810153</td>\n",
       "      <td>0.099524</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan</td>\n",
       "      <td>800</td>\n",
       "      <td>Separate meter, Available water .Space for car pack, big dinning hall and pouch</td>\n",
       "      <td>ashanti, kumasi metropolitan</td>\n",
       "      <td>2</td>\n",
       "      <td>ashanti region</td>\n",
       "      <td>kumasi metropolitan</td>\n",
       "      <td>6.800332</td>\n",
       "      <td>-1.518814</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>934</th>\n",
       "      <td>5bdrm Duplex in Living Large, East Legon for Rent</td>\n",
       "      <td>9000</td>\n",
       "      <td>Executive 5 bedroom newly built house with a boy’s quarters for rent at west trasacco very nice also...</td>\n",
       "      <td>greater accra, east legon</td>\n",
       "      <td>5</td>\n",
       "      <td>greater accra region</td>\n",
       "      <td>east legon</td>\n",
       "      <td>5.810153</td>\n",
       "      <td>0.099524</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>935</th>\n",
       "      <td>Furnished 3bdrm Apartment in Tamale Airport Road. For Rent</td>\n",
       "      <td>3000</td>\n",
       "      <td>V.I.P furnished apartment house for rent on the Tamale airport road</td>\n",
       "      <td>northern region, tamale municipal</td>\n",
       "      <td>3</td>\n",
       "      <td>northern region</td>\n",
       "      <td>tamale municipal</td>\n",
       "      <td>9.660000</td>\n",
       "      <td>-0.394380</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>936</th>\n",
       "      <td>Furnished 1bdrm Apartment in East Legon, American House for Rent</td>\n",
       "      <td>7480</td>\n",
       "      <td>This beautiful chamber and hall Apartment is going for 3months or 1year advance it,s so affordable...</td>\n",
       "      <td>greater accra, east legon</td>\n",
       "      <td>1</td>\n",
       "      <td>greater accra region</td>\n",
       "      <td>east legon</td>\n",
       "      <td>5.810153</td>\n",
       "      <td>0.099524</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>937</th>\n",
       "      <td>1bdrm Apartment in Divine Mercy Agency, Awutu Senya East Municipal</td>\n",
       "      <td>400</td>\n",
       "      <td>Chamber and hall self contained. Located at Choice weija going for 400gh accept 1year rent. Wall and...</td>\n",
       "      <td>central region, awutu senya east municipal</td>\n",
       "      <td>1</td>\n",
       "      <td>central region</td>\n",
       "      <td>awutu senya east municipal</td>\n",
       "      <td>5.724415</td>\n",
       "      <td>-1.376175</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>938</th>\n",
       "      <td>2bdrm Apartment in Tamale, Shishegu for Rent</td>\n",
       "      <td>700</td>\n",
       "      <td>2 bedroom apartment self compound,comes with p.o.p,nice kitchen, washroom, water flows always</td>\n",
       "      <td>northern region, tamale municipal</td>\n",
       "      <td>2</td>\n",
       "      <td>northern region</td>\n",
       "      <td>tamale municipal</td>\n",
       "      <td>9.660000</td>\n",
       "      <td>-0.394380</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>939 rows × 9 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                                   Title  \\\n",
       "0                                               3bdrm Apartment in Spintex for Rent        \n",
       "1             Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent        \n",
       "2                            2bdrm Apartment in West Trassaco, Adjiriganor for Rent        \n",
       "3                               3bdrm Duplex in Spintex, Tema Metropolitan for Rent        \n",
       "4                  Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan        \n",
       "..                                                                                   ...   \n",
       "934                               5bdrm Duplex in Living Large, East Legon for Rent        \n",
       "935                      Furnished 3bdrm Apartment in Tamale Airport Road. For Rent        \n",
       "936                Furnished 1bdrm Apartment in East Legon, American House for Rent        \n",
       "937              1bdrm Apartment in Divine Mercy Agency, Awutu Senya East Municipal        \n",
       "938                                    2bdrm Apartment in Tamale, Shishegu for Rent        \n",
       "\n",
       "     Price  \\\n",
       "0     3500   \n",
       "1    32000   \n",
       "2     3500   \n",
       "3     6400   \n",
       "4      800   \n",
       "..     ...   \n",
       "934   9000   \n",
       "935   3000   \n",
       "936   7480   \n",
       "937    400   \n",
       "938    700   \n",
       "\n",
       "                                                                                                                                                       Description  \\\n",
       "0                                         Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...                            \n",
       "1                                                                                   4 bedroom townhouse + going for ;  Located Cantonment                            \n",
       "2                                        Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom                            \n",
       "3                                     Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...                            \n",
       "4                                                         Separate meter, Available water .Space for car pack, big dinning hall and pouch                            \n",
       "..                                                                                                                                                             ...   \n",
       "934                               Executive 5 bedroom newly built house with a boy’s quarters for rent at west trasacco very nice also...                            \n",
       "935                                                                   V.I.P furnished apartment house for rent on the Tamale airport road                            \n",
       "936                                 This beautiful chamber and hall Apartment is going for 3months or 1year advance it,s so affordable...                            \n",
       "937                               Chamber and hall self contained. Located at Choice weija going for 400gh accept 1year rent. Wall and...                            \n",
       "938                                         2 bedroom apartment self compound,comes with p.o.p,nice kitchen, washroom, water flows always                            \n",
       "\n",
       "                                       Location  Rooms               Regions  \\\n",
       "0                        greater accra, spintex      3  greater accra region   \n",
       "1                    greater accra, cantonments      4  greater accra region   \n",
       "2                    greater accra, adjiriganor      2  greater accra region   \n",
       "3              greater accra, tema metropolitan      3  greater accra region   \n",
       "4                  ashanti, kumasi metropolitan      2        ashanti region   \n",
       "..                                          ...    ...                   ...   \n",
       "934                   greater accra, east legon      5  greater accra region   \n",
       "935           northern region, tamale municipal      3       northern region   \n",
       "936                   greater accra, east legon      1  greater accra region   \n",
       "937  central region, awutu senya east municipal      1        central region   \n",
       "938           northern region, tamale municipal      2       northern region   \n",
       "\n",
       "                         Suburb  Latitude_Regions  Longitude_Regions  \n",
       "0                       spintex          5.810153           0.099524  \n",
       "1                   cantonments          5.810153           0.099524  \n",
       "2                   adjiriganor          5.810153           0.099524  \n",
       "3             tema metropolitan          5.810153           0.099524  \n",
       "4           kumasi metropolitan          6.800332          -1.518814  \n",
       "..                          ...               ...                ...  \n",
       "934                  east legon          5.810153           0.099524  \n",
       "935            tamale municipal          9.660000          -0.394380  \n",
       "936                  east legon          5.810153           0.099524  \n",
       "937  awutu senya east municipal          5.724415          -1.376175  \n",
       "938            tamale municipal          9.660000          -0.394380  \n",
       "\n",
       "[939 rows x 9 columns]"
      ]
     },
     "execution_count": 709,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "new_df"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 711,
   "id": "1b0012f6",
   "metadata": {},
   "outputs": [],
   "source": [
    "new_df1 = pd.merge(new_df, dfs,  how='left', on=[\"Suburb\"])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 713,
   "id": "fda6a715",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Price</th>\n",
       "      <th>Description</th>\n",
       "      <th>Location</th>\n",
       "      <th>Rooms</th>\n",
       "      <th>Regions</th>\n",
       "      <th>Suburb</th>\n",
       "      <th>Latitude_Regions</th>\n",
       "      <th>Longitude_Regions</th>\n",
       "      <th>Latitude_Suburb</th>\n",
       "      <th>Longitude_Suburb</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>3bdrm Apartment in Spintex for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...</td>\n",
       "      <td>greater accra, spintex</td>\n",
       "      <td>3</td>\n",
       "      <td>greater accra region</td>\n",
       "      <td>spintex</td>\n",
       "      <td>5.810153</td>\n",
       "      <td>0.099524</td>\n",
       "      <td>5.628826499</td>\n",
       "      <td>-0.090199</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent</td>\n",
       "      <td>32000</td>\n",
       "      <td>4 bedroom townhouse + going for ;  Located Cantonment</td>\n",
       "      <td>greater accra, cantonments</td>\n",
       "      <td>4</td>\n",
       "      <td>greater accra region</td>\n",
       "      <td>cantonments</td>\n",
       "      <td>5.810153</td>\n",
       "      <td>0.099524</td>\n",
       "      <td>5.584156299</td>\n",
       "      <td>-0.169249</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2bdrm Apartment in West Trassaco, Adjiriganor for Rent</td>\n",
       "      <td>3500</td>\n",
       "      <td>Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom</td>\n",
       "      <td>greater accra, adjiriganor</td>\n",
       "      <td>2</td>\n",
       "      <td>greater accra region</td>\n",
       "      <td>adjiriganor</td>\n",
       "      <td>5.810153</td>\n",
       "      <td>0.099524</td>\n",
       "      <td>5.651</td>\n",
       "      <td>-0.135400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>3bdrm Duplex in Spintex, Tema Metropolitan for Rent</td>\n",
       "      <td>6400</td>\n",
       "      <td>Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...</td>\n",
       "      <td>greater accra, tema metropolitan</td>\n",
       "      <td>3</td>\n",
       "      <td>greater accra region</td>\n",
       "      <td>tema metropolitan</td>\n",
       "      <td>5.810153</td>\n",
       "      <td>0.099524</td>\n",
       "      <td>5.6477</td>\n",
       "      <td>-0.001500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan</td>\n",
       "      <td>800</td>\n",
       "      <td>Separate meter, Available water .Space for car pack, big dinning hall and pouch</td>\n",
       "      <td>ashanti, kumasi metropolitan</td>\n",
       "      <td>2</td>\n",
       "      <td>ashanti region</td>\n",
       "      <td>kumasi metropolitan</td>\n",
       "      <td>6.800332</td>\n",
       "      <td>-1.518814</td>\n",
       "      <td>6.68848</td>\n",
       "      <td>-1.624430</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                                 Title  \\\n",
       "0                                             3bdrm Apartment in Spintex for Rent        \n",
       "1           Furnished 4bdrm Townhouse/Terrace in Cantonment, Cantonments for Rent        \n",
       "2                          2bdrm Apartment in West Trassaco, Adjiriganor for Rent        \n",
       "3                             3bdrm Duplex in Spintex, Tema Metropolitan for Rent        \n",
       "4                Furnished 2bdrm House in Glory Vel Junction, Kumasi Metropolitan        \n",
       "\n",
       "   Price  \\\n",
       "0   3500   \n",
       "1  32000   \n",
       "2   3500   \n",
       "3   6400   \n",
       "4    800   \n",
       "\n",
       "                                                                                                                                                 Description  \\\n",
       "0                                   Semi furnished 3 bedrooms apartment, 2 washrooms, 2 spacious balconies, Dinning area, Fitted...                            \n",
       "1                                                                             4 bedroom townhouse + going for ;  Located Cantonment                            \n",
       "2                                  Newly built 2bedroom apartment in west trassaco for rent at a price of 3500 cedis ... 3 washroom                            \n",
       "3                               Nice 3 Bedroom Duplex For Rent in a serene area at Spintex. It comes with all rooms ensuite with...                            \n",
       "4                                                   Separate meter, Available water .Space for car pack, big dinning hall and pouch                            \n",
       "\n",
       "                           Location  Rooms               Regions  \\\n",
       "0            greater accra, spintex      3  greater accra region   \n",
       "1        greater accra, cantonments      4  greater accra region   \n",
       "2        greater accra, adjiriganor      2  greater accra region   \n",
       "3  greater accra, tema metropolitan      3  greater accra region   \n",
       "4      ashanti, kumasi metropolitan      2        ashanti region   \n",
       "\n",
       "                Suburb  Latitude_Regions  Longitude_Regions Latitude_Suburb  \\\n",
       "0              spintex          5.810153           0.099524     5.628826499   \n",
       "1          cantonments          5.810153           0.099524     5.584156299   \n",
       "2          adjiriganor          5.810153           0.099524           5.651   \n",
       "3    tema metropolitan          5.810153           0.099524          5.6477   \n",
       "4  kumasi metropolitan          6.800332          -1.518814         6.68848   \n",
       "\n",
       "   Longitude_Suburb  \n",
       "0         -0.090199  \n",
       "1         -0.169249  \n",
       "2         -0.135400  \n",
       "3         -0.001500  \n",
       "4         -1.624430  "
      ]
     },
     "execution_count": 713,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "new_df1.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 676,
   "id": "2229c830",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "Int64Index: 939 entries, 0 to 938\n",
      "Data columns (total 9 columns):\n",
      " #   Column       Non-Null Count  Dtype  \n",
      "---  ------       --------------  -----  \n",
      " 0   Title        939 non-null    object \n",
      " 1   Price        939 non-null    int32  \n",
      " 2   Description  939 non-null    object \n",
      " 3   Location     939 non-null    object \n",
      " 4   Rooms        939 non-null    int32  \n",
      " 5   Regions      939 non-null    object \n",
      " 6   Suburb       939 non-null    object \n",
      " 7   Latitude     939 non-null    object \n",
      " 8   Longitude    939 non-null    float64\n",
      "dtypes: float64(1), int32(2), object(6)\n",
      "memory usage: 66.0+ KB\n",
      "NUL Values\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "(None,\n",
       " Title          0\n",
       " Price          0\n",
       " Description    0\n",
       " Location       0\n",
       " Rooms          0\n",
       " Regions        0\n",
       " Suburb         0\n",
       " Latitude       0\n",
       " Longitude      0\n",
       " dtype: int64)"
      ]
     },
     "execution_count": 676,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Summary(new_df1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 639,
   "id": "c7a9cd1a",
   "metadata": {},
   "outputs": [],
   "source": [
    "#identify the empty columns\n",
    "samp = new_df1[new_df1['Latitude'].isna()]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 640,
   "id": "880a0a79",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['ablekuma',\n",
       " 'accra metropolitan',\n",
       " 'achimota',\n",
       " 'adenta',\n",
       " 'adjiriganor',\n",
       " 'agbogba',\n",
       " 'agbogbloshie',\n",
       " 'akuapim south',\n",
       " 'ashaiman municipal',\n",
       " 'ashomang estate',\n",
       " 'awutu senya east municipal',\n",
       " 'awutu senya west',\n",
       " 'dodowa',\n",
       " 'dworwulu',\n",
       " 'ga east municipal',\n",
       " 'ga south municipal',\n",
       " 'ga west municipal',\n",
       " 'gomoa east',\n",
       " 'haatso',\n",
       " 'ho municipal',\n",
       " 'kasoa',\n",
       " 'kumasi metropolitan',\n",
       " 'kwashieman',\n",
       " 'madina',\n",
       " 'new-juaben municipal',\n",
       " 'north legon',\n",
       " 'old ashomang',\n",
       " 'oyarifa',\n",
       " 'oyibi',\n",
       " 'ridge',\n",
       " 'shama ahanta east metropolitan',\n",
       " 'south la',\n",
       " 'south shiashie',\n",
       " 'sowutwuom',\n",
       " 'sunyani municipal',\n",
       " 'taifa-burkina',\n",
       " 'takoradi',\n",
       " 'tamale municipal',\n",
       " 'tantra hills',\n",
       " 'tarkwa nsuaem',\n",
       " 'tema metropolitan',\n",
       " 'teshie',\n",
       " 'weija',\n",
       " 'west legon']"
      ]
     },
     "execution_count": 640,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "sorted(samp[\"Suburb\"].unique())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 641,
   "id": "0471ea4f",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['abawdikro',\n",
       " 'abeka',\n",
       " 'abelenkpe',\n",
       " 'ablekuma newtown',\n",
       " 'aboabo',\n",
       " 'abofu',\n",
       " 'abokobi',\n",
       " 'abossey okai',\n",
       " 'abouabo',\n",
       " 'abrepo',\n",
       " 'abusuakruwa',\n",
       " 'accra new town',\n",
       " 'adentan',\n",
       " 'adisadel',\n",
       " 'adjiringanor',\n",
       " 'adoato',\n",
       " 'adum',\n",
       " 'adum-line',\n",
       " 'adumanu',\n",
       " 'afful nkwanta',\n",
       " 'agdegya',\n",
       " 'agric',\n",
       " 'ahodwo',\n",
       " 'airport residential area',\n",
       " 'akutubo',\n",
       " 'akwatia-line',\n",
       " 'akweteyman',\n",
       " 'alabar',\n",
       " 'alaji',\n",
       " 'alajo',\n",
       " 'alogboshie',\n",
       " 'amakom',\n",
       " 'amasaman',\n",
       " 'amedenuta',\n",
       " 'amoabisi',\n",
       " 'ampabame',\n",
       " 'anfoeta zongo',\n",
       " 'anomangye',\n",
       " 'antem',\n",
       " 'anwomaso',\n",
       " 'aprade',\n",
       " 'aputuogya',\n",
       " 'area 2',\n",
       " 'area 4',\n",
       " 'asafo',\n",
       " 'asawase',\n",
       " 'aseebu',\n",
       " 'asem',\n",
       " 'ashaley botwe',\n",
       " 'ashongman',\n",
       " 'ashtown',\n",
       " 'asikafoamantem',\n",
       " 'asokore mampong',\n",
       " 'asokwa',\n",
       " 'asongen',\n",
       " 'asufufu',\n",
       " 'asuogya',\n",
       " 'asylum down',\n",
       " 'atafoa',\n",
       " 'atonkwa, elmina',\n",
       " 'atorkukope',\n",
       " 'atta mills',\n",
       " 'avakome',\n",
       " 'avoeme',\n",
       " 'awoshie',\n",
       " 'awudome estates',\n",
       " 'ayeduase',\n",
       " 'ayi mensah',\n",
       " 'ayigbe town',\n",
       " 'ayigya',\n",
       " 'baakoniaba',\n",
       " 'bantama',\n",
       " 'banvum',\n",
       " 'bari',\n",
       " 'bawa villa',\n",
       " 'begyeahaso',\n",
       " 'benkute',\n",
       " 'beo',\n",
       " 'berlin top',\n",
       " 'bethlehem',\n",
       " 'blockso',\n",
       " 'boadi',\n",
       " 'bobkrom',\n",
       " 'bofre ase',\n",
       " 'bohyen',\n",
       " 'bomso',\n",
       " 'brahabebome',\n",
       " 'breman',\n",
       " 'breman north',\n",
       " 'bukere',\n",
       " 'bukom',\n",
       " 'bulpiela',\n",
       " 'buokrom',\n",
       " 'buokrom estate',\n",
       " 'burma camp',\n",
       " 'cantonments',\n",
       " 'changi',\n",
       " 'chapel hill',\n",
       " 'choggu',\n",
       " 'chorkor',\n",
       " 'christian village',\n",
       " 'community 1',\n",
       " 'community 10',\n",
       " 'community 11',\n",
       " 'community 12',\n",
       " 'community 17',\n",
       " 'community 18',\n",
       " 'community 2',\n",
       " 'community 22',\n",
       " 'community 25',\n",
       " 'community 3',\n",
       " 'community 4',\n",
       " 'community 5',\n",
       " 'community 6',\n",
       " 'community 7',\n",
       " 'community 8',\n",
       " 'community 9',\n",
       " 'cuba',\n",
       " 'dabokpaa',\n",
       " 'daboren',\n",
       " 'dagbandabo fong',\n",
       " 'dansoman',\n",
       " 'danyame',\n",
       " 'daporetindongo',\n",
       " 'darkuman',\n",
       " 'dechem',\n",
       " 'deduako',\n",
       " 'dichemso',\n",
       " 'dixcove hill',\n",
       " 'dome',\n",
       " 'dotoba zongo',\n",
       " 'dulugu',\n",
       " 'duuli',\n",
       " 'dzorwulu',\n",
       " 'east airport',\n",
       " 'east legon',\n",
       " 'east legon hills',\n",
       " 'ecomog',\n",
       " 'effiduase',\n",
       " 'esreso',\n",
       " 'fante new town',\n",
       " 'feyiasi',\n",
       " 'fiapre anhwere',\n",
       " 'first ridge',\n",
       " 'fou',\n",
       " 'freetown',\n",
       " 'galiliea',\n",
       " 'gbanbaya',\n",
       " 'george baryeh',\n",
       " 'gmc',\n",
       " 'government hill',\n",
       " 'greda estate',\n",
       " 'green hill',\n",
       " 'green view',\n",
       " 'gumani',\n",
       " 'hausa zong',\n",
       " 'hedzranawo',\n",
       " 'iture',\n",
       " 'jakarayili town',\n",
       " 'james town',\n",
       " 'kaase',\n",
       " 'kabore',\n",
       " 'kakasunaka no.1',\n",
       " 'kakpagayili',\n",
       " 'kakraba down',\n",
       " 'kalpohin',\n",
       " 'kalpohin estates',\n",
       " 'kambali',\n",
       " 'kanda estates',\n",
       " 'kaneshie',\n",
       " 'kantia',\n",
       " 'kantunso',\n",
       " 'kasalgo',\n",
       " 'katanga',\n",
       " 'kenyasi no.1',\n",
       " 'kenyasi no.2',\n",
       " 'kisseman',\n",
       " 'kokoado',\n",
       " 'kokoase',\n",
       " 'kokompe',\n",
       " 'konta',\n",
       " 'korle gonno',\n",
       " 'korlebu',\n",
       " 'kotei',\n",
       " 'kotobabi',\n",
       " 'kpaguri',\n",
       " 'kpedze lowcost',\n",
       " 'krapa',\n",
       " 'krofuom',\n",
       " 'kronum',\n",
       " 'kropo',\n",
       " 'kukuo town',\n",
       " 'kumbosku',\n",
       " 'kunbiasi',\n",
       " 'kunkoa',\n",
       " 'kwabenya',\n",
       " 'kwadaso',\n",
       " 'kwadaso estate',\n",
       " 'kwansakrom',\n",
       " 'kwasi bukro',\n",
       " 'kyanshiogo',\n",
       " 'labone',\n",
       " 'lamashegu',\n",
       " 'lantemame',\n",
       " 'lapaz',\n",
       " 'lartebiokorshie',\n",
       " 'little legon',\n",
       " 'low cost',\n",
       " 'low cost estate',\n",
       " 'lowcost',\n",
       " 'maamobi',\n",
       " 'mallam',\n",
       " 'mallam borla',\n",
       " 'mamprobi',\n",
       " 'mangu',\n",
       " 'masalatsi',\n",
       " 'mataheko',\n",
       " 'mbrom',\n",
       " 'mccarthy hill',\n",
       " 'mendskrom',\n",
       " 'ministries',\n",
       " 'mohiyarinh',\n",
       " 'morta',\n",
       " 'moshie zongo',\n",
       " 'mozukrom',\n",
       " 'mpatasie',\n",
       " 'mpoase',\n",
       " 'nakaba',\n",
       " 'nalong fong',\n",
       " 'namolgo',\n",
       " 'nanakrom',\n",
       " 'nasalat',\n",
       " 'new abelekuma',\n",
       " 'new achimota',\n",
       " 'new denkyira',\n",
       " 'new gbawe',\n",
       " 'new legon',\n",
       " 'new russia',\n",
       " 'new takoradi',\n",
       " 'new town',\n",
       " 'new weija',\n",
       " 'newtown',\n",
       " 'ngleshie amanfro',\n",
       " 'nhyiaeso',\n",
       " 'nii boi town',\n",
       " 'nima',\n",
       " 'nkroma nkwanta',\n",
       " 'nkwabeng',\n",
       " 'nkwaeso',\n",
       " 'north dzorwolu',\n",
       " 'north industrial area',\n",
       " 'north kaneshie',\n",
       " 'north ridge',\n",
       " 'north suntreso',\n",
       " 'ntoaso',\n",
       " 'nyamekye',\n",
       " 'nyaniba estates',\n",
       " 'nyanshegu',\n",
       " 'nyohini',\n",
       " 'nyorkoko',\n",
       " 'obenyade',\n",
       " 'odorkor',\n",
       " 'odumase',\n",
       " 'oduom',\n",
       " 'ofankor',\n",
       " 'official town',\n",
       " 'oforikrom',\n",
       " 'ohwim',\n",
       " 'ola',\n",
       " 'old fadama',\n",
       " 'old town',\n",
       " 'opetekwe',\n",
       " 'osu',\n",
       " 'otojor',\n",
       " 'paring',\n",
       " 'parkoso',\n",
       " 'patasi',\n",
       " 'pedu',\n",
       " 'pepre point',\n",
       " 'plotso',\n",
       " 'pobiman',\n",
       " 'pokuase',\n",
       " 'quarters',\n",
       " 'race course',\n",
       " 'regimanuel gray estate',\n",
       " 'ringway estates',\n",
       " 'roman hill',\n",
       " 'roman ridge',\n",
       " 'russia',\n",
       " 'sakasaka',\n",
       " 'saki',\n",
       " 'sakote',\n",
       " 'sakumono west cong. territory',\n",
       " 'salamba',\n",
       " 'sambo',\n",
       " 'santasi',\n",
       " 'santoe',\n",
       " 'sarpeiman',\n",
       " 'sawaba',\n",
       " 'sawaliga',\n",
       " 'sebrepor',\n",
       " 'senase',\n",
       " 'sherigu',\n",
       " 'sheshagu',\n",
       " 'shikakope',\n",
       " 'sigameri',\n",
       " 'sofoline',\n",
       " 'sokabissi',\n",
       " 'soli korpe',\n",
       " 'south industrial area',\n",
       " 'south la estates',\n",
       " 'south odorkor estates',\n",
       " 'south suntreso',\n",
       " 'sowutuom',\n",
       " 'spintex',\n",
       " 'ssnit flats',\n",
       " 'suame',\n",
       " 'susanso',\n",
       " 'tabora',\n",
       " 'tafo',\n",
       " 'takofiano',\n",
       " 'tanokrom',\n",
       " 'tanoso',\n",
       " 'tarkwa zongo',\n",
       " 'tarkwa-maakro',\n",
       " 'tengzug',\n",
       " 'tesano',\n",
       " 'teshie nungua estates',\n",
       " 'the point',\n",
       " 'tindongo',\n",
       " 'tindonmolgo',\n",
       " 'tishigu town',\n",
       " 'trasacco valley',\n",
       " 'tua',\n",
       " 'tulaku',\n",
       " 'ussher town',\n",
       " 'valco estades',\n",
       " 'viepe',\n",
       " 'vitin',\n",
       " 'vitin estate',\n",
       " 'warizehi',\n",
       " 'watchman',\n",
       " 'west ridge',\n",
       " 'westland',\n",
       " 'windy ridge',\n",
       " 'yarigabisi',\n",
       " 'yepala',\n",
       " 'yepasi',\n",
       " 'yikene',\n",
       " 'zanlerigo',\n",
       " 'zarre',\n",
       " 'zongo',\n",
       " 'zonno',\n",
       " 'zonno zoore',\n",
       " 'zujung']"
      ]
     },
     "execution_count": 641,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "sorted(dfs[\"Suburb\"].unique())"
   ]
  }
 ],
 "metadata": {
  "interpreter": {
   "hash": "320c1f05b41b6296d6cdeadbc8f37198b22e160db062b16d8b8cc9d95c25d782"
  },
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.10.0"
  },
  "latex_envs": {
   "LaTeX_envs_menu_present": true,
   "autoclose": false,
   "autocomplete": true,
   "bibliofile": "biblio.bib",
   "cite_by": "apalike",
   "current_citInitial": 1,
   "eqLabelWithNumbers": true,
   "eqNumInitial": 1,
   "hotkeys": {
    "equation": "Ctrl-E",
    "itemize": "Ctrl-I"
   },
   "labels_anchors": false,
   "latex_user_defs": false,
   "report_style_numbering": false,
   "user_envs_cfg": false
  },
  "toc": {
   "base_numbering": 1,
   "nav_menu": {},
   "number_sections": true,
   "sideBar": true,
   "skip_h1_title": false,
   "title_cell": "Table of Contents",
   "title_sidebar": "Contents",
   "toc_cell": false,
   "toc_position": {},
   "toc_section_display": true,
   "toc_window_display": false
  },
  "varInspector": {
   "cols": {
    "lenName": 16,
    "lenType": 16,
    "lenVar": 40
   },
   "kernels_config": {
    "python": {
     "delete_cmd_postfix": "",
     "delete_cmd_prefix": "del ",
     "library": "var_list.py",
     "varRefreshCmd": "print(var_dic_list())"
    },
    "r": {
     "delete_cmd_postfix": ") ",
     "delete_cmd_prefix": "rm(",
     "library": "var_list.r",
     "varRefreshCmd": "cat(var_dic_list()) "
    }
   },
   "types_to_exclude": [
    "module",
    "function",
    "builtin_function_or_method",
    "instance",
    "_Feature"
   ],
   "window_display": false
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}