I've had coed cabins before.....was a CIT/LIT Director a couple of summers ago. Although yeah I was responsible for supervising while they were inside the cabin...I also had a female co-director and never had to sleep in the same cabin as them or anything like that. It was also easier for me because we were never in our cabins besides at night time to sleep....for rest period we would pick a place on camp and relax there as an entire group, including my female co-director and our boys.

In your situation, yeah I would have declined it as well....just seems like too much of an unnecessary risk to put yourself in. Personally, I also don't think I would ever work at an all girls camp either, although I know tons of guys that do. I'm just more of a coed camp person.