The camp I used to own, assigns 10-12 campers to a cabin group with two staff assigned to each group, so that when one is on day off or otherwise removed, one counselor will still be with the group. Most activity areas also have 2 or more staff assigned, so that activities can continue with one person absent.
Another possibility is to have junior counselors or roving counselors who fill in as needed.
Bob Hanson