Overview

My research centers around methodological aspects of Bayesian statistics and its application to large scale complex data. I am particularly focused on developing methodology in a broad range of areas including semi-parametric density regression, shrinkage priors for anisotropic function estimation, variable selection with non-Gaussian errors, massive covariance matrix estimation, surface reconstruction and imaging and modeling shapes of non-Euclidean objects. I enjoy developing methodology that has an immediate motivation and impact to a particular application area, while being broadly applicable and leading to foundational questions. In the Bayes paradigm this often involves developing new classes of flexible prior distributions for densities, conditional densities, functions, sparse vectors, matrices or tensors. It is fascinating to explore the structure of the spaces on which the priors are supported while studying how the posterior concentrates as increasing amounts of data are collected. Studying these spaces becomes more challenging outside of unconstrained Euclidean spaces, such as in studying closed surfaces and other shapes, and when the dimension explodes. While Bayesian hierarchical models offer an unified and coherent framework for structured modeling and inference, two key challenges persist. First, as one moves away from simple parametric models, understanding properties of a posterior distribution poses a stiff challenge. Second, even if the true posterior has desirable properties, sampling from the posterior distribution in large scale problems commonly face scalability issues. This is relevant both for high-dimensional and big data problems. My research aims at addressing these challenges simultaneously, developing new theory to evaluate the associated procedures and developing scalable and highly efficient algorithms for Bayesian computation.


Grant support

1. Office of Naval Research, 2014-2017, PI
2. NSF DMS-1613156 (Statistics), 2016-2020, PI
3. NSF DMS-1854731 (CDSE-MSS), 2019-2022, PI
4. NSF DMS-1916371 (Statistics), 2019-2022, PI
5. NSF CCF-1934904 (HDR Tripods), 2019-2022, co-I
6. Texas A&M Triads for Transformation (T3), 2020-2021, PI
7. Texas A&M STRP, 2020-2021, PI

Preprints and submitted papers

1. Wang L., Tang Y., Sinha D., Pati D., Lipsitz S.R. Bayesian Variable Selection for Skewed Heteroscedastic Response. [link] [code]
2. Karwa V., Pati D., Petrovic S., Solus L. et al. Exact tests for stochastic block models. [link]
3. Yang Y., Pati D. Bayesian model selection consistency and oracle inequality with intractable marginal likelihood. [link]
4. Sabnis G., Pati D., Engelhardt B., Pillai N.S. A divide and conquer strategy for high dimensional Bayesian factor models. [link] [code]
5. Yang Y., Bhattacharya A., Pati D. Frequentist coverage and sup-norm convergence rate in Gaussian process regression. [link]
6. Souris, A., Bhattacharya, A., Pati, D. The Soft Multivariate Truncated Normal Distribution. [link]
7. Acharyya S., Zhang Z., Bhattacharya, A., Pati D. Bayesian Hierarchical Modeling on Covariance Valued Data. [link]
8. Zhou S., Wang T., Pati D., Yang Y., Carroll R.J. Gaussian processes with Error in Variables: Theory and Computation. [link]
9. Zhou S., Ray P., Pati D., Bhattacharya A. Mass-shifting phenomenon of truncated multivariate normal priors. [link]
10. Bhattacharya A., Pati D. Nonasymptotic Laplace approximation under model misspecification. [link]
11. Lee S. Y., Pati D., Mallick B.K. Continuous shrinkage priors revisited: a collapsing behavior and remedy. [link] [pres]
12. Lim Y., Bhattacharya A., Holt J., Pati D. Revisiting constraints on the maximum neutron star mass in light of GW190814. [link]
13. Bhattacharya A., Pati D., Plummer S. Evidence bounds in singular models: probabilistic and variational perspectives. [link]
14. Guha B., Pati D. Adaptive posterior convergence in sparse high dimensional clipped generalized linear models.
15. Guha B., Bhattacharya A., Pati D. Statistical Guarantees and Algorithmic Convergence Issues of Variational Boosting. [link]
16. Ghosh I., Bhattacharya A., Pati D. Statistical optimality and stability of tangent transform algorithms in logit models. [link]

Published or accepted papers

1. Pati, D., Reich, B.J., Dunson, D.B. (2011). Biometrika, 98 (1): 35-48.
   Bayesian geostatistical modeling with informative sampling locations.
   [link]
2. Pati, D., Dunson, D.B., Tokdar, S.T. (2013). Journal of Multivariate Analysis, 116: 456-472.
   Posterior consistency in conditional distribution estimation.
   [link]
3. Pati, D., & Dunson, D.B. (2014). Annals of the Institute for Statistical Mathematics, 66 (1): 1-31.
   Bayesian nonparametric regression with varying residual density.
   [link]
4. Bhattacharya, A., Pati, D., & Dunson, D.B. (2014). Annals of Statistics, 32 (1): 352-381.
   Anisotropic function estimation with multi-bandwidth Gaussian process.
   [link]
5. Pati, D., Bhattacharya, A., Pillai, N.S. & Dunson, D.B. (2014). Annals of Statistics, 42 (3): 1102-1130.
   Posterior contraction in sparse Bayesian factor models for massive covariance matrices.
   [link]
6. Sarkar, A., Mallick, B.K., Staudenmayer, J., Pati, D. & Carroll, R.J. (2014) Journal of Computational and Graphical Statistics , 24 (3): 1101-1125.
   Bayesian Semiparametric Density Deconvolution in the Presence of Conditionally Heteroscedastic Measurement Errors.
   [link]
7. Cervone, D., Pillai, N.S., Pati, D., Berbecko, R., & Lewis, J.H. (2014). Annals of Applied Statistics, 8 (3): 1341-1371.
   A location-mixture autoregressive model for online forecasting of lung-tumor motion.
   [link]
8. Gu, K., Pati, D. & Dunson, D.B. (2014). Journal of the American Statistical Association, 109 (508): 1481-1494.
   Bayesian Multiscale Modeling of Closed Curves in Point Clouds.
   [link]
9. Bhattacharya, A., Pati, D., Pillai, N.S. & Dunson, D.B. (2015). Journal of the American Statistical Association, 110 (512): 1479-1489.
   Dirichlet Laplace priors for optimal shrinkage.
   [link] [code]
10. Tang, Y., Sinha, D., Pati, D., Lipsitz, S. & Lipshultz, S. (2015). Biostatistics, 16 (3): 441-453.
    Bayesian Partial Linear Model for Skewed Longitudinal Data.
    [link]
11. Zhang, Z., Pati, D. & Srivastava, A. (2015). Journal of Statistical Planning and Inference, 166: 171-186.
    Bayesian Clustering of Shapes of Curves.
    [link]
12. Pati, D. & Bhattacharya, A. (2015). Statistics and Probability Letters, 103: 100-104.
    Adaptive Bayesian inference in the Gaussian sequence model using exponential-variance priors.
    [link]
13. Pati, D., Bhattacharya, A. & Cheng G. (2015). Journal of Machine Learning Research, 16: 2837-2851.
    Optimal Bayesian estimation in random covariate design with a rescaled Gaussian process prior.
    [link]
14. Bhattacharya, A., Pati, D., Pillai, N.S. & Dunson, D.B. (2016). Stochastic Processes and their Applications, 26 (12): 3828-3842.
    Sub-optimality of some continuous shrinkage priors.
    [link]
15. Norets, A. & Pati, D. (2017). Econometric Theory, 33 (4): 980-1012.
    Adaptive Bayesian estimation of conditional densities.
    [link]
16. Hanning, L. & Pati, D. (2017). Computational Statistics & Data Analysis, 107: 107-119.
    Variable selection using shrinkage priors.
    [link] [code]
17. Sarkar, A., Pati, D., Chakrabarty, A., Mallick, B., Carroll, R.J. (2017). Journal of the American Statistical Association, 113 (521) 401-416.
    Bayesian semiparametric multivariate density deconvolution.
    [link]
18. Bhattacharya, A., Pati, D. (2017). Information and Inference, 6: 416-440.
    Posterior contraction in Gaussian process regression using Wasserstein approximations.
    [link]
19. Vo, G., Pati, D. (2017) Open Journal of Statistics, 7: 567-588.
    Sparse additive Gaussian process with soft interactions.
    [link]
20. Pati, D., Bhattacharya, A., Yang, Y. (2018). Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics (AISTATS).
    On the Statistical optimality of variational Bayes.
    [link]
21. Geng, J., Bhattacharya, A., Pati, D. (2018). Journal of the American Statistical Association, 114 (526) 893-905.
    Probabilistic community detection with unknown number of communities.
    [link] [code]
22. Dasgupta S., Pati D., Jermyn I, Srivastava S. (2018) 2018 IEEE Statistical Signal Processing Workshop (SSP).
    Shape-Constrained and Unconstrained Density Estimation Using Geometric Exploration.
    [link]
23. Bhingare A., Sinha D., Pati D., Bandyopadhyay, D., Lipsitz S.R. (2018) Biometrics, 75 (2) 528-538.
    Semiparametric Bayesian latent variable regression for skewed multivariate data.
    [link]
24. Sabnis G., Pati D., Bhattacharya A. (2019) Sankhya (Series A), 81 466-481.
    Compressed covariance estimation with automated dimension learning.
    [link]
25. Dasgupta S., Pati D., Srivastava A. (2019) Quarterly of Applied Mathematics, 77 399-422.
    Bayesian Shape-Constrained Density Estimation.
    [link]
26. Dasgupta S., Pati D., Srivastava A. (2019) Statistica Sinica.
    A two-step geometric framework For density modeling.
    [link] [Density-estimation-code] [Density-regression-code]
27. Bhattacharya A., Pati D., Yang Y (2019) The Annals of Statistics, 47 (1): 39-66.
    Bayesian fractional posteriors.
    [link]
28. Zhou, S., Giuliani, P., Piekarewicz, J., Bhattacharya, A., Pati, D. (2019) Physical Review C, 99 (5): 055202.
    Revisiting the proton-radius problem using constrained Gaussian processes.
    [link] [code]
29. Kumar P., Mukherjee T., Pati D., Xu L., Blasch, E. (2019) Big Data Mining and Analytics (IEEE Explore), 2 (4): 319-348.
    Large scale FM signal strength map estimation for passive approximate localization.
    [link]
30. Dhara K., Pati D., Sinha D., Lipsitz S.R. (2019) Bayesian Analysis, 15 (3): 759-780.
    A New Bayesian Single Index Model with or without Covariates Missing at Random.
    [link]
31. Ghosh P., Pati D., Bhattacharya A. (2019) Sankhya (Series A); invited for special volume in honor of Prof. J.K. Ghosh, to appear.
    Posterior Contraction Rates for Stochastic Block Models.
    [link]
32. Ray, P., Pati, D., Bhattacharya, A. (2020) Statistics and Computing, 30: 839–853.
    Efficient Bayesian shape-restricted function estimation with constrained Gaussian process priors.
    [link]
33. Yang Y., Pati D., Bhattacharya A. (2020) The Annals of Statistics, 48 (2): 886–905.
    α-variational inference with statistical guarantees.
    [link]
34. Sarkar A., Pati D., Mallick B., Carroll R.J. (2020) Journal of the American Statistical Association (Applications & Case Studies), to appear.
    Bayesian Copula Density Deconvolution for Zero-Inflated Data with Applications in Nutritional Epidemiology.
    [link]
35. Binette O., Pati D., Dunson D.B. (2020) Journal of Machine Learning Research, 21 (119): 1–26.
    Bayesian fitting of closed surfaces through tensor products.
    [link]
36. Niu Y., Pati D., Mallick, B. (2020) Bernoulli, to appear.
    Bayesian Graph Selection Consistency For Decomposable Graphs.
    [link]
37. Plummer S., Pati D., Bhattacharya A. (2020) Entropy, to appear.
    Dynamics of coordinate ascent variational inference: A case study in 2D Ising models.
    [link]
38. Dasgupta S., Pati D., Jermyn, I. Srivastava A. (2020) Technometrics, to appear.
    Shape-Constrained Univariate Density Estimation.
    [link] [code]
39. Plummer S., Zhou S., Bhattacharya A., Dunson D.B., Pati D. (2021) AISTATS 2021, to appear.
    Statistical Guarantees for Transformation Based Models with applications to Implicit Variational Inference.
    [link]
40. Chuu E., Pati D., Bhattacharya A. (2021) AISTATS 2021, to appear.
    A Hybrid Approximation to the Marginal Likelihood.
    [link]

[Back]