After Cohen's father abandoned the family, his mother moved him and his sister to Kew Gardens, Queens, and he attended Richmond Hill High School, where he graduated in 1939. To support himself and his family, he delivered groceries and sold newspapers and ice cream at the beach.