The DHS Program User Forum
Discussions regarding The DHS Program data and results
Home » Data » Merging data files » Thoughts on pooling surveys from single country
Thoughts on pooling surveys from single country [message #13590] Fri, 24 November 2017 09:57 Go to next message
dflood011 is currently offline  dflood011
Messages: 7
Registered: October 2017
Member
Hi, I'm conducting an analysis of stunting risk factors in a single country with multiple recent DHS surveys. I'm trying to decide whether to pool surveys, which is a practice I've encountered in similar analyses. (See below for examples.) I'm not as interesting in assessing changes over time for my particular analysis.

What do the analysts/experts here think of this practice?

The advantages I see:
- large sample permits more covariates, more complex models
- ?

Disadvantages
- not an elegant cross-sectional assessment
- covariates may not be the same across years
- recalculating some metrics, such as wealth, made more difficult
- - additional complexity in survey weighting

https://www.ncbi.nlm.nih.gov/pubmed/23678197
https://www.ncbi.nlm.nih.gov/pubmed/27161654
Re: Thoughts on pooling surveys from single country [message #13596 is a reply to message #13590] Sat, 25 November 2017 14:41 Go to previous message
Reduced-For(u)m
Messages: 292
Registered: March 2013
Senior Member
David,

Don't have too much to add to your post, it sounds to me like you have a pretty good handle on the issues related to pooling: trading off power (N) for bias/interpretability (changes over time in outcomes and variable measurement, plus the weighting issues). A couple quick thoughts:

1 - the weighting problem is much less severe within-country...sample sizes are often similar, weighting each survey equally makes sense (divid each weight by the within-round-sum-of-weights so each survey sums to 1), and you lose the whole "population representative" issue where South Africa and Nigeria basically dominate all regressions.

2 - The covariate comparability problem is smaller since a) standardization within countries is really strong; b) wealth might be more easily comparable across time, especially if you use the new comparable wealth index DHS created; and c) a wood roof in Tanzania probably means the same thing across a couple of years/decades...but maybe not across continents.

3 - As usual, it depends on what you want to do. If power is a big problem (why?), then there is little danger in pooling multiple rounds from the same country (little that isn't dangerous using just one survey, and supposing the effect of interest is relatively constant across time). If power isn't a problem - just do it separately within each survey and use a "seemingly unrelated regressions" type of test to see if the coefficient is changing across surveys.

But in general, it just sounded like you understood the trade-offs well and just had a decision to make. Hope this helps at least a little bit.
Previous Topic: Merging the child, household and wealth file for Philippines 1998
Next Topic: Merge CR and IR
Goto Forum:
  


Current Time: Tue Mar 19 07:32:14 Coordinated Universal Time 2024