What can i do, i got married w a US citizen, now we aren't living together and i got a conditional residence..?

we aren't together because he lost his job and the apt, now im living with my parents(in NY) and he's living with his(in CT), we have a little girl together so i need to get her health insurance. if i give my address can the immigration department take my green card or not give it to me because we are not living with him? Now we have 3 years married and this happened about 4 months ago, on june of 2010 we have to go to the immigration dep to get my permanent residence and im really scared of what's gonna happend. Does anybody know anything about this?