The prevalence and age of onset of hearing loss differ according to sex. This study aimed to identify associated factors for age-related hearing loss (ARHL) and determine whether there are differences between males and females regarding associated factors for ARHL. This cross-sectional study used data from adults who underwent medical examinations including hearing tests from 2011 to 2021. A total of 2,349 individuals were included. The study conducted sex-specific analyses using both univariate and multiple regression. Univariate analysis employed logistic regression, while multiple regression involved variable selection through the augmented backward elimination method. Separate multiple logistic regression analyses were conducted for each sex. In the univariate analysis, among males, age, underweight, alcohol consumption, weight, and height exhibited statistical significance. Among females, age, hypertension, diabetes, dyslipidemia, obesity, sarcopenia, weight, height, age at menarche, and duration of hormone exposure were found to be significant factors. However, in the multiple logistic regression model for males, underweight, and smoking emerged as significant, while in females, age, weight, obesity, and age at menarche retained their significance. We found that there are different associated factors for ARHL in each sex. Assessment and counseling for smoking, obstetric history, underweight, and obesity may be beneficial in managing patients with ARHL.