The Living Thing / Notebooks :

Non random sampling

Greasing non-squeaky wheels

Usefulness: 🔧
Novelty: 💡
Uncertainty: 🤪 🤪 🤪
Incompleteness: 🚧 🚧 🚧

Data where your collection process is biased. MRP etc.

Connected to hierarhical models, Survey estimation as applied in psephology etc.

Dan Simpson elucidates, in Multilevel structured (regression) and post-stratification.

🚧

Refs

Bareinboim, Elias, Jin Tian, and Judea Pearl. 2014. “Recovering from Selection Bias in Causal and Statistical Inference.” In AAAI, 2410–6. http://ftp.cs.ucla.edu/pub/stat_ser/r425.pdf.

Broockman, David E., Joshua Kalla, and Jasjeet S. Sekhon. 2016. “The Design of Field Experiments with Survey Outcomes: A Framework for Selecting More Efficient, Robust, and Ethical Designs.” SSRN Scholarly Paper ID 2742869. Rochester, NY: Social Science Research Network. https://papers.ssrn.com/abstract=2742869.

Copas, J. B., and H. G. Li. 1997. “Inference for Non-Random Samples.” Journal of the Royal Statistical Society: Series B (Statistical Methodology) 59 (1): 55–95. https://doi.org/10.1111/1467-9868.00055.

Gao, Yuxiang, Lauren Kennedy, Daniel Simpson, and Andrew Gelman. 2019. “Improving Multilevel Regression and Poststratification with Structured Priors,” August. http://arxiv.org/abs/1908.06716.

Kennedy, Lauren, and Andrew Gelman. 2019. “Know Your Population and Know Your Model: Using Model-Based Regression and Poststratification to Generalize Findings Beyond the Observed Sample,” June. http://arxiv.org/abs/1906.11323.

Kohler, Ulrich, Frauke Kreuter, and Elizabeth A. Stuart. 2019. “Nonprobability Sampling and Causal Analysis.” Annual Review of Statistics and Its Application 6 (1): 149–72. https://doi.org/10.1146/annurev-statistics-030718-104951.

Mohan, Karthika, Judea Pearl, and Jin Tian. 2013. “Graphical Models for Inference with Missing Data.” In Advances in Neural Information Processing Systems, 1277–85. http://papers.nips.cc/paper/4899-gra.

Pfeffermann, Danny. 1993a. “Modeling Survey Data.” International Statistical Review 61 (2): 317–37. http://lib.stat.cmu.edu/~brian/905-2008/papers/Pfeffermann-ISR-1993.pdf.

———. 1993b. “The Role of Sampling Weights When Modeling Survey Data.” International Statistical Review / Revue Internationale de Statistique 61 (2): 317–37. https://doi.org/10.2307/1403631.

Pfeffermann, Danny, Abba M. Krieger, and Yosef Rinott. 1998. “Parametric Distributions of Complex Survey Data Under Informative Probability Sampling.” Statistica Sinica 8 (4): 1087–1114. http://www3.stat.sinica.edu.tw/statistica/oldpdf/A8n45.pdf.

Rao, JNK. 2006. “Interplay Between Sample Survey Theory and Practice: An Appraisal.” Survey Methodology 31 (2): 117–38. https://jpsm.org/sites/jpsm.umd.edu/files/distinguished%20lecture_jnkRaoPaper.pdf.

Rao, J. N. K., and Isabel Molina. 2015. Small Area Estimation. John Wiley & Sons.

Wang, Wei, David Rothschild, Sharad Goel, and Andrew Gelman. 2015. “Forecasting Elections with Non-Representative Polls.” International Journal of Forecasting 31 (3): 980–91. https://doi.org/10.1016/j.ijforecast.2014.06.001.