NTU Course
NewsHelpOverview

Nonparametric Regression

Offered in 112-2
  • Notes
  • Limits on Course Adding / Dropping
    • Restriction: MA students and beyond and Restriction: within this department (including students taking minor and dual degree program)

  • NTU Enrollment Status

    Loading...
  • Course Description
    This course aims to introduce the nonparametric regression techniques, essentially referring to smoothing procedures for curve estimation, that provide a flexible approach to explore the relationship between a response and a few associated covariates without specifying a parametric model. Those commonly employed techniques (such as kernel smoothing methods and basis-based approaches) along with their statistical properties will be introduced. Some related topics such as dimension reduction and functional data analysis will be covered as well.
  • Course Objective
    Those commonly employed approaches for nonparametric regression will be introduced. After taking the course, students are expected to comprehend the fundamental, utilize the approaches properly and perform sensible data analysis in addition to be familiar with research questions in this domain.
  • Course Requirement
    Calculus, Statistics, and Linear Regression.
  • Expected weekly study hours after class
  • Office Hour
    *This office hour requires an appointment
  • Designated Reading
  • References
    1. Hastie, Tibshirani and Friedman (2016). The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2nd edition. Springer. https://hastie.su.domains/ElemStatLearn/ 2. Scott (2015). Multivariate Density Estimation: Theory, Practice, and Visualization. 2nd Edition. Wiley. 3. Takezawa (2005). Introduction to Nonparametric Regression. Wiley 4. Gyorfi, Kohler, Krzy?ak and Walk (2002). A Distribution-Free Theory of Nonparametric Regression. Springer. 5. Tsybakov (2009). Introduction to Nonparametric Estimation. Springer. 6. Wahba (1990) Spline Models for Observational Data (https://epubs.siam.org/doi/book/10.1137/1.9781611970128)
  • Grading
  • Adjustment methods for students
    Adjustment MethodDescription
    Others

    Negotiated by both teachers and students

  • Course Schedule
    02/19/2024Week 1Introduction
    02/21/2024Week 1Review Empirical CDF Kernel Density Estimator
    02/26/2024Week 2Kernel Density Estimator: bias and variance
    03/04/2024Week 3Kernel Density Estimator: asymptotic normality
    03/06/2024Week 3Kernel Density Estimator: MISE, CV, Derivatives, Optimal Kernel, Equivalent Kernels, and Boundary Kernels.
    03/11/2024Week 4Kernel Density Estimator: Variable Kernels, Multivariate
    03/13/2024Week 4Kernel Density Estimator: Computation and Applications N-W Kernel Estimator: Asymptotic Normality Local Polynomial Regression: Introduction
    03/18/2024Week 5Local Polynomial Regression: Asymptotics
    03/20/2024Week 5Local Polynomial Regression: Asymptotics, CV, GCV, variable bandwidth
    03/25/2024Week 6Multivariate Nonparametric Regression: 1. Local Linear (bias)
    03/27/2024Week 6Multivariate Nonparametric Regression: 1. Local Linear (bias, variance, boundary points) 2. Local Quadratic (bias, variance, boundary points)
    04/01/2024Week 7Multivariate Nonparametric Regression: 1. Higher-degree polynomials (p=1, bias, variance, boundary points) 2. Devriatives
    04/03/2024Week 7Semiparametric Regression: 1. Introduction 2. SLS, WSLS 3. ADE
    04/08/2024Week 8Semiparametric Regression: 4. Density Weighted ADE
    04/10/2024Week 8Semiparametric Regression: 5. Sliced Inverse Regression 6. MAVE
    04/15/2024Week 9Semiparametric Regression: 6. MAVE
    04/17/2024Week 9Midterm Exam
    04/22/2024Week 10Semiparametric Regression: 6. MAVE
    04/24/2024Week 10Semiparametric Regression: 7. Partial Linear Model 8. Projection Pursuit Regression Functional Data Analysis 1. Introduction
    04/29/2024Week 11Functional Data Analysis 2. Functional Principal Component Analysis
    05/01/2024Week 11Functional Data Analysis 2. Functional Principal Component Analysis (Asymptotic Normality)
    05/06/2024Week 12Paper Presentation Functional Data Analysis 2. Functional Principal Component Analysis (Example)
    05/08/2024Week 12Functional Data Analysis 3. Functional Linear Regression Model 4. Functional Varying Coefficient Model
    05/13/2024Week 13Paper Presentation
    05/15/2024Week 13Functional Data Analysis 4. Functional Varying Coefficient Model 5. Functional Dynamics
    05/20/2024Week 14Paper Presentation
    05/22/2024Week 14Functional Data Analysis 6. Application 7. Covariate Adjusted Approaches
    05/27/2024Week 15Paper Presentation
    05/29/2024Week 15Functional Data Analysis 7. Covariate Adjusted Approaches 8. Inverse Regression