The interested student can read section 3.3.2 in Foundations of Agnostic Statistics.
This section presents a formal treatment for how kernel methods can lead to simple, agnostic estimators of the PDF and CDF. This is a really fascinating property that permits an estimation method to flexibly estimate the joint distribution of data.
- Pages 121—124
- Section titled Kernel Estimation