Hello There, Guest!  

[OQSPS] Explaining Terrorism Threat Level Across Western Countries

#7
Thanks to Emil for undertaking a replication of my analyses. I have uploaded a new Stata do file to the OSF page for this paper: https://osf.io/5tv3a/

Emil Wrote:Replicated, except I get a median of 2.52. Typo perhaps.


This was indeed a typo.

Emil Wrote:Correlation replicated, CI differed... Correlation and lower CI replicated, upper CI did not.


I had not applied the Fisher transformation to the raw confidence intervals included in the Stata OLS output. Reported confidence intervals have been changed accordingly, and are the same as Emil's. (They were calculated using the cii2 command, as shown in the new Stata do file.)

Emil Wrote:I get d = .69... I get 1.63...


I calculated d-values by simply taking the regression coefficients from OLS models in which the dependent variable (namely, terrorism threat level) had been standardised. In other words, B1 in the following model was used as an estimate of d:

terrorism_threat_level_z-score = alpha + B1(any_deaths_Iraq_Afghanistan)

When computing Cohen's d directly (using the esize command in Stata), I get the same results as Emil. I presume the discrepancies arise from different methods of calculating the pooled standard deviation. I chose to use the OLS method, rather than calculating Cohen's d directly, because the results are more comparable with the conditional standardised differences obtained from the multivariate models (Tables 1-3). I will report the exact d-values in the paper, if preferred.

Emil Wrote:I'd like to request that you add the main numerical datapoints of interest to the abstract


I will do this once the discussion regarding d-values has been resolved.

Emil Wrote:I'd like to request that you provide exact p values instead of inequalities.


I will include exact p-values for raw estimates in the next version of the paper.

Emil Wrote:It is better to use a proper method than assuming that a clearly non-normal, non-continuous variable is both.


In my experience, logistic and probit regression (binary and ordered) nearly always produce highly similar point estimates (average effects) to OLS, so I prefer to use the latter, given its greater simplicity and ease of interpretation. But I can note in the paper that results were similar when using ordered logistic regression.

Emil Wrote:I'd like that you add the full results to the supplementary materials


I will include an Appendix or file of supplementary analyses with the next version of the paper.

Emil Wrote:I checked, the correlations are not that strong: r's .33, .50, .69.


My mistake. Would you suggest that I tried utilising an additional variable, namely number of major military interventions in the Middle East, ranging from 0-4?
 Reply
 
Messages In This Thread
[OQSPS] Explaining Terrorism Threat Level Across Western Countries - by NoahCarl - 2016-Apr-27, 12:23:00
Review - by Emil - 2016-Apr-27, 14:24:14
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by NoahCarl - 2016-Apr-28, 15:55:00
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by NoahCarl - 2016-Apr-28, 18:17:21
Analytic replication - by Emil - 2016-May-02, 02:05:48
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by NoahCarl - 2016-May-02, 16:00:01
Review #2 - by Emil - 2016-May-02, 02:54:57
Reply to Noah #7 - by Emil - 2016-May-02, 21:51:15
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by NoahCarl - 2016-May-03, 18:52:46
Review #3 - by Emil - 2016-May-03, 19:05:39
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by NoahCarl - 2016-May-03, 21:01:20
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by Chuck - 2016-May-12, 02:54:13
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by NoahCarl - 2016-May-12, 18:59:35
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by Chuck - 2016-May-12, 21:28:17
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by Chuck - 2016-May-25, 01:40:16
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by NoahCarl - 2016-May-25, 15:51:52
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by Emil - 2016-May-03, 21:05:22
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by NoahCarl - 2016-Jun-01, 16:25:52
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by Chuck - 2016-Jun-02, 04:39:35
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by Emil - 2016-Jun-02, 13:17:15
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by NoahCarl - 2016-Jun-02, 15:29:20
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by Emil - 2016-Jun-02, 16:07:09
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by NoahCarl - 2016-Jun-03, 16:03:21
Review #3 - by Emil - 2016-Jun-05, 02:15:22
Analytic replication #2 - by Emil - 2016-Jun-10, 17:59:12
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by NoahCarl - 2016-Jun-10, 20:48:04
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by Emil - 2016-Jun-10, 21:47:25
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by ljzigerell - 2016-Jun-15, 05:27:15
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by NoahCarl - 2016-Jun-17, 18:24:53
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by ljzigerell - 2016-Jun-17, 21:14:31
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by NoahCarl - 2016-Jun-21, 18:37:11
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by Chuck - 2016-Jun-24, 00:55:58
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by Emil - 2016-Jun-24, 08:54:45
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by Emil - 2016-Jun-28, 17:32:01
RE: [OQSPS] Explaining Terrorism Threat Level Across Western Countries - by NoahCarl - 2016-Nov-14, 19:36:01
 
Forum Jump:

Users browsing this thread: 1 Guest(s)