Previously documented sexual response patterns of gender-specificity among gynephilic men and gender-nonspecificity among gynephilic women could be explained by women responding more strongly to non-gendered aspects of sexual stimuli. Cues of attractiveness are known determinants of sexual decision-making, yet have not been directly tested as determinants of sexual response. The current study investigated the role of attractiveness cues in explaining gender-based patterns of sexual response. Thirty-one gynephilic men and 60 androphilic women were presented slideshows of images depicting individual nude men and women that were pre-rated in a pilot study as either attractive or unattractive. The men and women were posed with legs spread and aroused genitals displayed prominently. Images were isolated against a white background and included minimal contextual information. Three sexual responses - genital arousal (via photoplethysmographs), self-reported arousal, and visual attention (via eye-tracking) - were recorded continuously. Across all three response modalities, men's and women's responses were stronger for the attractive versus unattractive images and for their preferred versus non-preferred gender. For men's arousal and women's self-reported arousal, the effect of attractiveness was stronger for their preferred versus non-preferred gender. Thus, both men and women demonstrated preference-specific patterns of sexual response. Gender cues had the strongest effect on men's visual attention, whereas attractiveness cues had the strongest effect on women's visual attention. Findings establish the importance of target attractiveness in arousal to sexual stimuli and add to mounting evidence that androphilic women's sexual responses are sensitive to gender, but may be more sensitive to non-gendered features of sexual stimuli.