I have an interesting problem (interesting at least for beginners like myself :) ). I have a dependent variable Y (class-variable, 2 possible values 0 and 1). I have multiple variables that all together can predict the value of Y with p-value smaller than 0.05. Logistic regression was used to see which variable will stay, and which should be removed. So, I got final model, after eliminating statistically unsignificant variables from the model, with 3 variables a, b, and c. All those 3 variables have p-values < 0.05 in the final model. Correlation (Pearson) analysis done on the ancestor of the Y (that is correct, Y was created from continuous variable X) shows that variable a is not correlated at all with X (p=0.7), b and c correlate with p < 0.05. In my analysis, I would like to highlight the meaning of variable c and somehow to eliminate or diminish the meaning of the variable b. c variable's correlation is 30% with X, and b variable's correlation is 15% with X
The question is, can be partial correlation analysis used to highlight the meaning of the c variable? Does it even make sense to do something like this?