Stromal-epithelial interactions are critical to the morphogenesis, differentiation, and homeostasis of the prostate, but the molecular identity and anatomy of discrete stromal cell types is poorly understood. Using single cell RNA-sequencing, we identified and validated the in situ localization of three smooth muscle subtypes (prostate smooth muscle, pericytes, and vascular smooth muscle) and two novel fibroblast subtypes in human prostate. Peri-epithelial fibroblasts (APOD+) wrap around epithelial structures while interstitial fibroblasts (C7+) are interspersed in extracellular matrix. In contrast, the mouse displayed three fibroblast subtypes with distinct proximal-distal and lobe specific distribution patterns. Statistical analysis of mouse and human fibroblasts showed transcriptional correlation between mouse prostate (C3+) and urethral (Lgr5+) fibroblasts and the human interstitial fibroblast subtype. Both urethral fibroblasts (Lgr5+) and ductal fibroblasts (Wnt2+) in the mouse contribute to a proximal Wnt/Tgfb signaling niche that is absent in human prostate. Instead, human peri-epithelial fibroblasts express secreted WNT inhibitors SFRPs and DKK1, which could serve as a buffer against stromal WNT ligands by creating a localized signaling niche around individual prostate glands. We also identified proximal-distal fibroblast density differences in human prostate that could amplify stromal signaling around proximal prostate ducts. In human Benign Prostatic Hyperplasia, fibroblast subtypes upregulate critical immunoregulatory pathways and show distinct distributions in stromal and glandular phenotypes. A detailed taxonomy of leukocytes in BPH reveals an influx of myeloid dendritic cells, T cells and B cells, resembling a mucosal inflammatory disorder. A receptor-ligand interaction analysis of all cell types revealed a central role for fibroblasts in growth factor, morphogen and chemokine signaling to endothelia, epithelia, and leukocytes. These data are foundational to the development of new therapeutic targets in benign prostatic hyperplasia.