Data this week comes from the Freddie Mac House Price Index at both the State and National level. The original source can be found here.
The House Price Index (HPI) is a broad measure of the movement of single-family house prices. The HPI is a weighted, repeat-sales index, meaning that it measures average price changes in repeat sales or refinancings on the same properties. This information is obtained by reviewing repeat mortgage transactions on single-family properties whose mortgages have been purchased or securitized by Fannie Mae or Freddie Mac since January 1975. - Quote from Federal Housing Finance Agency
If the term House Price Index is unfamiliar to you - check out the technical documents or this Wikipedia article.
Hint: A useful summary statistic could be the 12-month (yearly) percent change in the Price Index (eg is the price index rising or falling?).
We also have mortgage rates for fixed 30, fixed 15, and adjustable 5-1 Hybrids across time. Some of the data was only introduced in the 1990s and late 2000s, and as such some information can only be pulled from more recent data.
Lastly, we have included some recession dates in the US - the Great Recession (2007) had some major effects across many industries and markets. You can read more about some of the recent changes here from Fortune.
House Price Index
Mortgage Rates
Recession Dates
or read the data directly into R!
state_hpi <- readr::read_csv("https://raw.githubusercontent.com/rfordatascience/tidytuesday/master/data/2019/2019-02-05/state_hpi.csv")
mortgage_rates <- readr::read_csv("https://raw.githubusercontent.com/rfordatascience/tidytuesday/master/data/2019/2019-02-05/mortgage.csv")
recession_dates <- readr::read_csv("https://raw.githubusercontent.com/rfordatascience/tidytuesday/master/data/2019/2019-02-05/recessions.csv")
| variable | class | description |
|---|---|---|
| year | date - integer | Year |
| month | date - integer | Month |
| state | character | US State |
| price_index | double | Calculated House Price Index - average price changes in repeat sales or refinancings at state level |
| us_avg | double | Calculated House Price Index - averaged at national level |
- Please notice that 30 year fixed rate data goes back to 1971, while the 15 year data begins in 1991 and the adjustable 5-1 Hybrid begins in 2005.
| variable | class | description |
|---|---|---|
| date | date | Date |
| fixed_rate_30_yr | double | Fixed rate 30 year mortgage (percent) |
| fees_and_pts_30_yr | double | Fees and percentage points of the loan amount |
| fixed_rate_15_yr | double | Fixed rate 15 year mortgage (percent) |
| fees_and_pts_15_yr | double | Fees and percentage points of the loan amount |
| adjustable_rate_5_1_hybrid | double | 5-1 Hybrid Adjustable rate mortgage (5 year fixed, then annual adjustable rate) |
| fees_and_pts_5_1_hybrid | double | Fees and percentage points of the loan amount |
| adjustable_margin_5_1_hybrid | double | A fixed amount added to the underlying index to establish the fully indexed rate for an ARM. |
| spread_30_yr_fixed_and_5_1_adjustable | double | Difference in rate between 30 year fixed and 5-1 adjustable |
- You should probably just go to the Wikipedia article - but this is a small list of recessions in the USA.
| variable | class | description |
|---|---|---|
| name | character | Recession Name |
| period_range | character | Time period range of the recession |
| duration_months | character | How long the recession lasted |
| time_since_previous_recession_months | character | Time since previous recession in months |
| peak_unemploy_ment | character | Peak unemployment (percent) |
| gdp_decline_peak_to_trough | character | GDP decline from peak to trough |
| characteristics | character | Paragraph description of the recession |
R currently contains the following “state” data sets. Note that all data are arranged according to alphabetical order of the state names.
state.abb:
character vector of 2-letter abbreviations for the state names.
state.area:
numeric vector of state areas (in square miles).
state.center:
list with components named x and y giving the approximate geographic center of each state in negative longitude and latitude. Alaska and Hawaii are placed just off the West Coast.
state.division:
factor giving state divisions (New England, Middle Atlantic, South Atlantic, East South Central, West South Central, East North Central, West North Central, Mountain, and Pacific).
state.name:
character vector giving the full state names.
state.region:
factor giving the region (Northeast, South, North Central, West) that each state belongs to.
# Libraries
library(tidyverse)
library(rvest)
library(readxl)
library(janitor)
df <- read_excel("State_and_US_SA.xls", skip = 5) %>%
separate(Month, c("year", "month"), sep = "M") %>%
mutate_at(vars(year, month), as.integer) %>%
filter(!is.na(year)) %>%
gather(state, price_index, AK:WY) %>%
rename(us_avg = `United States seasonally adjusted`) %>%
select(year, month, state, price_index, us_avg) %>%
mutate(price_index = as.numeric(price_index))
df2 <- read_excel("historicalweeklydata.xls", skip = 6, sheet = 2,
col_types = "numeric") %>%
set_names(nm = c("date", "fixed_rate_30_yr", "fees_and_pts_30_yr",
"fixed_rate_15_yr",
"fees_and_pts_15_yr", "adjustable_rate_5_1_hybrid",
"fees_and_pts_5_1_hybrid", "adjustable_margin_5_1_hybrid",
"spread_30_yr_and_fixed_5_1_adjustable", "delete")) %>%
select(-delete) %>%
mutate(date = as.Date(date, origin = "1899-12-30"))
url <- "https://en.wikipedia.org/wiki/List_of_recessions_in_the_United_States"
df3 <- url %>%
read_html() %>%
html_table() %>%
.[[3]] %>%
janitor::clean_names()
df3_clean <- df3 %>%
mutate(duration_months = substring(duration_months, 3),
period_range = substring(period_range, 5),
time_since_previous_recession_months = substring(time_since_previous_recession_months, 4),
period_range = case_when(name == "Great Depression" ~ "Aug 1929-Mar 1933",
name == "Great Recession" ~ "Dec 2007-June 2009",
TRUE ~ period_range))