Epigenetic modifications, and methylation of histones in particular, dynamically change during spermatogenesis. Among various methylations of histone H3, methylation of histone H3 lysine 9 (H3K9) and its regulation are essential for spermatogenesis. Trimethytransferases as well as dimethyltransferase are required for meiotic progression. In addition, didemethylase of H3K9 is also critical for spermatogenesis through transcriptional regulation of spermatid-specific genes. However, the requirement for demethylation of trimethylated H3K9 (H3K9me3) during spermatogenesis remains to be elucidated. Here, we report the targeted disruption of KDM4D, a testis-enriched tridemethylase of H3K9. Kdm4d-null mice are viable and fertile and do not show any obvious phenotype. However, H3K9me3 accumulates significantly in Kdm4d-null round spermatids, and the distribution of methylated H3K9 in germ cells is dramatically changed. Nevertheless, the progression of spermatogenesis and the number of spermatozoa are normal, likely secondary to the earlier nuclear localization of another H3K9 tridemethylase, KDM4B, in Kdm4d-null elongating spermatids. These results suggest that demethylation of H3K9me3 in round spermatids is dispensable for spermatogenesis but that possible defects in Kdm4d-null elongating spermatids could be rescued by functional redundancy of the KDM4B demethylase.