Background: Infertility remains an ongoing reproductive problem and about half of infertile couples have a component of male factor infertility. Male factor infertility is seen as an alteration in sperm concentration and/or motility and/or morphology in sperm analysis. A wide variety of etiological factors are involved in the causation of those sperm abnormalities. This study was designed to determine the association between risk factors and different semen parameter abnormalities. Methodology: A descriptive study was conducted amongst the male partners of infertile couples who presented to the Outpatient Department for infertility evaluation. All the men were advised for semen analysis as a part of routine infertility work-up. Those men who had abnormal semen parameters and consented to the study were enrolled. A detailed interview of each subject was conducted focusing on risk factors causing different semen parameter abnormalities. Analysis of data was conducted to evaluate the presence of risk factors and the association of risk factors to specific sperm abnormalities was determined. Results: A total of 50 subjects with abnormal semen analysis reports were included in the study. The mean age was 32.14 years ± 5.95 years, and the mean BMI was 24.38 ± 2.07 kg/m2. The mean duration of infertility was 5.94 ± 3.66 years. The median sperm concentration was calculated to be 6.75 million/ml (IQR 3-12). The mean sperm motility was 26.3% (SD ± 19.00). 30% of the subjects had oligozoospermia and 20% had asthenozoospermia whereas 50% had both oligozoospermia and asthenozoospermia. Men with a sedentary lifestyle and cigarette smokers were twice (OR 2.122) and four times (OR 4.133) more likely to have oligozoospermia respectively. Cigarette smokers were nearly seven times (OR 7.171) more likely to have asthenozoospermia. Similarly, driver men and laborer men were almost six times (OR 5.629) and eight times (OR 8.551) more likely to develop asthenozoospermia respectively. However, these observations were not statistically significant. Conclusion: Cigarette smoking is seen to be associated with both oligozoospermia and asthenozoospermia. Driver and laborer men were more likely to have asthenozoospermia. However, further study with a larger sample size is required to analyze the statistical significance of these associations.