Course Schedule:

Week Content

 Week 1: Aug 27  

 Week 1: Aug 29

 Week 1: Aug 31

 Week 1 notes

 Mon. Introduction & Course Overview

 Wed. Quiz 1, Mechanics of Bayesian Statistics

 Fri. Philosophy of Bayesian Statistics

 Week 2: Sept 3  

 Week 2: Sept 5

 Week 2: Sept 7

 Week 2 notes

 Mon. No Class (Labor Day)

 Wed.  Quiz 2, Belief, Probability, and Exchangeability

 Fri. Belief, Probability, and Exchangeability

 HW 1 due, (HTML) (R Markdown(Read Gelman's Philosophy and Practice of Bayesian Statistics)  

 Week 3: Sept 10  

 Week 3: Sept 12

 Week 3: Sept 14

 Week 3 notes

 Mon. Quiz 3,  Binomial Models

 Wed. Poisson and Exponential Family Models

 Fri. Priors

 HW 2 due (HTML) (R Markdown)

 Week 4: Sept 17  

 Week 4: Sept 19

 Week 4: Sept 21

Week 4 notes

 Mon. Quiz 4,  Posterior Sampling and Intro to Monte Carlo

 Wed. Normal Model

 Fri. No class: MT ASA Chapter Meeting in Missoula, MT 

 HW 3 due (HTML) (R Markdown)

 Week 5: Sept 24

 Week 5: Sept 26

 Week 5: Sept 28 

 Notes: (PDF) (R Markdown)

    (KEY)

 Mon. Quiz 5,  Normal Model (cont). R code: (MonteCarlo Normal)

 Wed. MCMC with Normal Model. R code: (Gibbs Sampler)

 Fri. MCMC with Normal Model, cont..

  Demo: Intro to MCMC (HTML) (R Markdown)

 HW 4 due (HTML) (R Markdown)

 Week 6: Oct 1

 Week 6: Oct 3

 Week 6: Oct 5

 Notes: (PDF) (R Markdown)

   (KEY)

 Mon. Quiz 6,  Demo: Intro to MCMC, cont..

 MCMC

 Wed. MCMC

 Fri. Demo: MCMC/JAGS/Stan (HTML) (R Markdown)

 HW 5 due (HTML) (R Markdown)

 Week 7: Oct 8

 Week 7: Oct 10

 Week 7: Oct 12

  

 Mon. Quiz 7,  Demo2: MCMC/JAGS/Stan

 Wed. In class exam (2016 in class exam) (2016 take-home exam) (midtermbikes.csv) (bozemanhousing.csv)

 Fri. No class - work on midterm take-home (2017 take-home exam) (BozemanHousing2017exam.csv)

 Week 8: Oct 15

 

 Week 8: Oct 17

 Week 8: Oct 19

 Notes: (PDF) (R Markdown

    (KEY)

 MonMidterm take-home due (2018 MIDTERM HTML) (2018 MIDTERM R MARKDOWN)

 Multivariate Normal Distribution

 Wed. Inverse Wishart Distribution

 Fri. Demo: Gibbs Sampler for Multivariate Normal Data

 Project Proposal Due (Project Rubric)

 Week 9: Oct 22

 Week 9: Oct 24

 Week 9: Oct 26 

 Notes: (PDF) (R Markdown)

  (KEY)

 Mon. Demo: Gibbs Sampler for Multivariate Normal Data +Hierarchical Modeling.

 Wed. Hierarchical Modeling.

 Fri. Lab: Shrinkage and Stein's Paradox 

 HW 6 due (HTML) (R Markdown)

 Week 10: Oct 29

 Week 10: Oct 31

 Week 10: Nov 2

 Notes: (PDF) (R Markdown)

  (KEY)

 Mon. Quiz 8, Lab: Shrinkage and Stein's Paradox, (LaTex) (PDF) (SteinData.csv) 

 Wed.  Point mass priors and Bayes Factors 

 Fri. Bayesian Regression. 

Final Description Due, write 1/2 page summary of data set + proposed methods for paper. 

 Week 11: Nov 5

 Week 11: Nov 7

 Week 11: Nov 9 

 Notes: (PDF) (R Markdown)

 Mon. Quiz 9, Bayesian Regression 

 Wed.  Bayesian Model Selection

 Fri.  Non conjugate priors and Metropolis-Hastings

 Week 12: Nov 12

 Week 12: Nov 14

 Week 12: Nov 16 

 Mon. No Class (Veteran's Day) 

  HW 7 due (HTML) (R Markdown)  (SeattleHousing.csv)

 Wed. Quiz 10, Metropolis-Hastings

 Fri. Demo: Stan (HTML) (R Markdown)

 Week 13: Nov 19

 Week 13: Nov 21

 Week 13: Nov 23

 Notes: (PDF) (R Markdown)

 Mon.  Hierarchical Regression.

  HW 8 due (HTML) (R Markdown) (SeattleBinaryHousing.csv).

 Wed. No Class (Thanksgiving Break)

 Fri. No Class (Thanksgiving Break)

 Week 14: Nov 26

 Week 14: Nov 28

 Week 14: Nov 30 

 Mon. Quiz 11. Hierarchical Regression.

 Wed. Latent Variable Models

 Fri. Generalized Hierarchical Regression 

 Week 15: Dec 3

 Week 15: Dec 5

 Week 15: Dec 7 

 Mon. In Class Final. Take home final due (PDF). 

 Wed. 

 Fri.  

  Finals Week: 

  December 13: 6 - 7:50 PM

 Class Presentations. 

 Project Rubric (PDF)

STAT 532 Overview:

  • Meeting Time: Monday, Wednesday, Friday -  1:10 - 2:00 
  • Classroom: Wilson Hall 1-134
  • Office Hours: Monday/Wednesday 2  -  3 or by appointment

Course Description

This course will introduce the basic ideas of Bayesian statistics with emphasis on both philosophical foundations and practical implementation. The goal of this course is to provide a theoretical overview of Bayesian statistics and relevant computational tools along with the knowledge and experience to use them in a research setting.

Prerequisites

One of: STAT 422 or STAT 502 and STAT 506

Course Objectives

At the completion of this course, students will be able to:

  1. Describe fundamental differences between Bayesian and classical inference,
  2. Select appropriate models and priors, write likelihoods, and derive posterior distributions given a research question and dataset,
  3. Make inferences from posterior distributions,
  4. Implement Markov Chain Monte Carlo (MCMC) algorithms, and 
  5. Read, understand, and explain techniques in scientific journals implementing Bayesian methods.

Textbook:

  1. A First Course in Bayesian Methods, by Peter Hoff.

Course Evaluation:

  • Quizzes: 10% of final grade:
    • There is no formal attendance policy, but there will be weekly quizzes. 

  • Homework: 30% of final grade
    • Homework problems will be assigned every week. Students are allowed and encouraged to work with classmates on homework assignments, but each student is required to write their own homework.
  • Midterm Exam 20% & Final Exam 20%  of final grade
    • Exams will have two components: an in-class exam and a take home portion. The in-class portions will be largely conceptual including some short mathematical derivations. The take home portions will focus on the analysis of data and implementation of Bayesian computational methods.
  • Project 20% of final grade
    • The project will be a case study where students will apply Bayesian methods to a dataset agreed upon by the instructor and student.