Hello There, Guest!  

[ODP] The Black White IQ gap in the total sample of the Vietnam Experience Study

#4
Thanks for looking over the paper.

John,


Quote:The application of MGCFA to summary scale scores is methodologically problematic. Also, the summary of results from the unpublished HV meta-analysis is problematic as that analysis itself needs to be refined (for example it combined scholastic achievement composite scores with IQ scores). For these two reasons I can not approve this paper.



I agree that MGCFA applied to summary scales is problematic. However, it is not clear how problematic, at least to me. In the spirit of the p-hacking/non-replication crisis/selective publishing problem, I thought it better to report the failed analysis rather than leave it out. This way readers will know the method was attempted but failed.

I agree that the Fuerst 2013 dataset is problematic. However, it is the largest open dataset of this kind. The dataset is good enough for a preliminary analysis such as the one presented here (no formal meta-analysis with meta-regression etc.). I just emailed Roth to see if he will share his dataset with us and hence the public.

Quote:I suggest instead writing a 1-2 page short communications summarizing the B/W mean difference results for each test - providing code and variables, but do not conduct MCV or MGCFA on these.

As a compromise, I have computed the differences by test and included them. These were all close to 1 d (White norms).

Quote:Alternatively and or additionally conduct a more informative analysis. For example, use the twin data -- if available -- to compute ACE estimates by ethnic groups or attempt to replicate Hartmann et al.'s (2006) MCV analysis using MGCFA.

There are no twins in this dataset or any other known family relationships, so behavioral genetic modeling cannot be done.

It is not fair to criticize a study for not doing something with another dataset. The point of this study is to add a large n datapoint to a future comprehensive meta-analysis of White-Black differences on cognitive tests. In this case it is a little complicated because the sample overlaps partially with other previously published studies, so one would have to choose either to include in the meta-analysis (or maybe average them).



hvc,


Quote:Introduction:

What is d? It should be explained in more detail.

d is a standard term and hardly needs an explanation. https://en.wikipedia.org/wiki/Effect_size#Cohen.27s_d

I have added a quick explanation in the introduction just in case.



Quote:2.1:

What is SIRE?

The term is explained in the introduction.

Quote:2.2:
There are 6 variables in the dataset, but 3 out of the 5 variables are composites? Surely both of these statements cannot be correct.
What is the amount of total variance explained by the factor used?
The standardization was done with the white subsample. Does anything change if standardization is done on the full sample, or blacks+whites?

You are right. I meant 6.

68%, but it is hardly worth reporting for this analysis.

Differences become smaller if one uses a larger sd. The sd is larger if one uses a mixed sample. It is customary to use the White sd/norms for the calculation of group differences.


Quote:3.2:

It is rather unclear what was done and what were the results.

What is unclear to you? I changed the wording slightly.

Paper updated.
 Reply
 
Messages In This Thread
[ODP] The Black White IQ gap in the total sample of the Vietnam Experience Study - by Emil - 2016-Dec-21, 22:49:35
RE: [ODP] The Black White IQ gap in the total sample of the Vietnam Experience Study - by Chuck - 2016-Dec-26, 02:44:48
RE: [ODP] The Black White IQ gap in the total sample of the Vietnam Experience Study - by hvc - 2017-Jan-03, 13:50:21
RE: [ODP] The Black White IQ gap in the total sample of the Vietnam Experience Study - by Emil - 2017-Jan-09, 02:42:49
RE: [ODP] The Black White IQ gap in the total sample of the Vietnam Experience Study - by Emil - 2017-Mar-14, 19:50:57
 
Forum Jump:

Users browsing this thread: 1 Guest(s)