This decision is obviously up to you; therefor, guidance is really the best we can give to your question. Nobody is going to make that choice for you, except for yourself. That being said....
Genetics, molecular biology, physiology, and biochemistry are all courses that seriously require knowledge of chemistry to do well in, or even satisfactory, for that matter. There are also many more courses that require chemistry than those I listed.
The physical and biological science portions of the MCAT require quite a bit of knowledge in chemistry, but thats not to say that scoring well on the verbal section might improve your score, if you know what I mean
The bottom line is, you are going to need to know chemistry throughout your pre-med career in order to well in your biochem course work, as well as the MCAT. Without a good knowledge base of chemical reactions and their mechanisms, you will epically fail at a biological science major!
Now, I am sure there have been exceptions where a person (certainly) has been able to get D's or C's in chemistry courses and still make it into medical school. What concerns me, though, is that you are struggling with what we call "baby chemistry," which is VERY easy compared to the novel, outlandish nature of its predecessor, the dreaded Organic Chemistry.
Hopefully this sheds some light on your situation.
I wish you the best of luck for whatever route you take!