Out of position CBs and other positions? Is there a penalty?

How much does out of position affect cornerbacks, and other positions that you've used? I want to put SS Derwin James at CB4 because I use Ji'Ayir Brown. Do out of position players like this play the same?