Objective This study aims to investigate the relationship between midday nap time, nighttime sleep duration, and mild cognitive impairment (MCI) in Chinese older adults and determine the recommended sleep duration to provide a scientific basis for preventing and managing MCI in this population. Methods Utilizing the 2020 China Health and Retirement Longitudinal Study database, the demographic data, health status, and lifestyle information of the study participants were collected. A total of 5,314 valid samples were included in the analysis. Logistic regression and restricted cubic spline plots were employed to explore the relationship between sleep patterns and MCI. Results In the cross-sectional analysis, a linear relationship was observed between midday nap duration and MCI among Chinese elderly. The probability of MCI was lowest among those who napped for less than 30 min at noon. Compared with individuals who napped for30-90 min, those who did not nap were more likely to have MCI (OR = 1.30, 95% CI: 1.05–1.60). Older adults with napping duration < 30 min (OR = 0.73, 95% CI:0.56–0.95) also exhibited lower probability of MCI when compared those without napping habit, Nighttime sleep duration exhibited a U-shaped relationship with MCI. Individuals with less than approximately 6 h of nighttime sleep showed a gradual decrease in the probability of MCI with increasing sleep duration, whereas those with more than 7.5 h demonstrated an increase in the probability of MCI with longer sleep duration. Older adults who slept less than 6 h at night (OR = 1.22, 95% CI: 1.01 ~ 1.46) or more than 8 h (OR = 1.78, 95% CI: 1.35–2.33) were more likely to develop MCI compared with those who slept 6 to 8 h. Conclusion After controlling for potential confounding variables, both nighttime sleep duration and midday nap duration exhibited a nonlinear “U”-shaped relationship with MCI among the elderly. The probability of depression was lower with a nap duration of approximately 60 min, and the optimal nighttime sleep duration was 6–8 h, with around 7 h providing the greatest cognitive benefits.