The DHS Program User Forum
Discussions regarding The DHS Program data and results
Home » Topics » Service Provision Assessment (SPA) » Weighted multilevel models using Tanzania SPA
Weighted multilevel models using Tanzania SPA [message #14167] Wed, 28 February 2018 14:51 Go to next message
cmoucheraud is currently offline  cmoucheraud
Messages: 3
Registered: April 2015
Member
Hello,

I am trying to run a multilevel model using Tanzania SPA data (including facility, provider and client levels) -- but I cannot get any of these models to converge when the multiple levels' sampling weights are included. We have isolated the problem as due to the extremely skewed distribution of the facility-level sampling weight (it has a very long right tail with interruptions).

Has anyone found a way to work with multilevel models & multiple levels of survey weights, with the Tanzania SPA dataset or any of the other SPA datasets that have a similarly skewed distribution of facility weights?

Thanks in advance!,
Corrina
Re: Weighted multilevel models using Tanzania SPA [message #14439 is a reply to message #14167] Fri, 06 April 2018 09:18 Go to previous messageGo to next message
Liz-DHS
Messages: 1516
Registered: February 2013
Senior Member
Dear User,
A response from sampling experts, Dr. Ruilin Ren:
Quote:

Firstly, about the multilevel modeling with SPA data, we do not know if other people did the same research or not, this question was never asked before. When talking about the multilevel weights, it needs additional attention because the weights we developed in the SPA data may not be "multilevel" since the provider weights and client weights all use the facility weights as base weights. This means the provider weights and client weights already take the multi-stage selection into account, they do not just reflect the selection of providers and clients in the second stage.
Secondly, about the skewed distribution of the sampling weights, this should be the case for SPA surveys by facility type because the important health facilities such as hospitals and health centers are included with probability one in the sample, so their sampling weight should be small compared with facilities of other types which are sampled. If the skewed weight distribution is a problem for your modeling work, you may need to take the facility type as a co-variable. This may make more sense for your analysis because of the big difference on the role played by different types of facility in the health system.

Re: Weighted multilevel models using Tanzania SPA [message #15822 is a reply to message #14439] Sat, 22 September 2018 17:33 Go to previous messageGo to next message
cmoucheraud is currently offline  cmoucheraud
Messages: 3
Registered: April 2015
Member
Thank you very much!
Re: Weighted multilevel models using Tanzania SPA [message #26820 is a reply to message #14167] Thu, 04 May 2023 09:06 Go to previous messageGo to next message
shakim is currently offline  shakim
Messages: 10
Registered: January 2021
Member
Dear DHS Experts and SPA Users,

I want to know the hierarchical structure of SPA datasets. Can I apply a multilevel modeling approach to SPA datasets? If I can, then what variables will be included in level 1, level 2 and level 3? Will I use facility weights in all stages of multilevel modeling?


Many thanks,
Re: Weighted multilevel models using Tanzania SPA [message #26880 is a reply to message #26820] Mon, 15 May 2023 15:07 Go to previous message
SaraDHS is currently offline  SaraDHS
Messages: 44
Registered: December 2020
Member
As you can see from Dr Ren's answer, the provider and client weights already take into account the multi-stage selection of facilities, so using both the facility weight AND the provider or client weight in the same model is not appropriate.

In the past, we have used facility weight as the first level weight, and assumed equal weight for all clients in the same facility, which may not be true. For some services, like family planning, it is often the case that all clients in a facility on the day of data collection are observed and interviewed, while for others it is not true. You can explore your data and see what is the case and what might make sense. There is no clear cut answer for this question.

Best,
Sara


Sara Riese, PhD Senior Demographic and Health Researcher, DHS Program
Previous Topic: Senegal SPA district and arrondissement information
Next Topic: issue about data merge : senegal 2012-2019
Goto Forum:
  


Current Time: Thu Jun 20 12:02:37 Coordinated Universal Time 2024