The DHS Program User Forum
Discussions regarding The DHS Program data and results
Home » Data » Weighting data » AIC and BIC model fit tests on weighted DHS data
AIC and BIC model fit tests on weighted DHS data [message #4089] Sun, 29 March 2015 10:42 Go to next message
nobleman00
Messages: 3
Registered: November 2014
Member
Hello,

I am currently working on DHS household record (HR) datasets for multiple countries using Stata.
The specific variables which I use are hv201 and hv205. For example, I am interested in looking at the proportions of the respondents who answered for each category for hv201 out of total respondents. To get the proportions, I first create dummy variables for each category of the variable and sum them up by collapsing. When collapsing, the DHS sample weight (hv005) is used. The proportions are then calculated by dividing the summed frequency of each dummy variable by the total frequency. These proportions are used as independent variables for a count model.
My question is that for count models in general, it is possible to compare models by using AIC or BIC fit tests. However, for weighted or clustered data, these tests are not recommended, and log-likelihoods are not available when running regression with the "svy" command in Stata. In my case, I do not need to use either the "svy" command or the [weight] option when running regression because the final dataset was already weighted when creating independent variables by collapsing. Thus, I can run regression as if I use a non-weighted dataset (although it was weighted in the previous step) in the software, and I do not have any issues on getting the AIC or BIC test results. However, I am wondering if these model fit tests (AIC, BIC) can be still used as valid tools for the model comparison in this case where the dataset was weighted in the previous step.
Thank you.

Jung
Re: AIC and BIC model fit tests on weighted DHS data [message #4137 is a reply to message #4089] Mon, 06 April 2015 07:25 Go to previous messageGo to next message
Bridgette-DHS is currently offline  Bridgette-DHS
Messages: 1504
Registered: February 2013
Senior Member
You posted the same question on Statlist ( http://www.statalist.org/forums/forum/general-stata-discussi on/general/1229571-aic-and-bic-model-fit-tests-on-weighted-d hs-data) and received an answer from a Statlist member. DHS staff have reviewed that answer. We agree with it and have nothing to add.

Re: AIC and BIC model fit tests on weighted DHS data [message #14806 is a reply to message #4137] Mon, 07 May 2018 07:25 Go to previous message
sadya2018@gmail.com
Messages: 97
Registered: April 2018
Location: Ethiopia, in Africa
Senior Member
Best learning!!

Hassen Ali Hamza (BSc in Public Health,Master of Public Health Candidate)
Previous Topic: Components of ANC
Next Topic: Weighting DRC Domestive Violence Data in Multilevel Analysis
Goto Forum:
  


Current Time: Tue Dec 11 02:44:56 Eastern Standard Time 2018