Type 1 pili mediate binding, invasion, and biofilm formation of uropathogenic Escherichia coli (UPEC) in the host urothelium during urinary tract infection (UTI) via the adhesin FimH. In this study, we characterized the molecular basis of functional differences between FimH of the UPEC isolate UTI89 and the Klebsiella pneumoniae cystitis isolate TOP52. Type 1 pili characteristically mediate mannose-sensitive hemagglutination of guinea pig erythrocytes. Although the adhesin domain of K. pneumoniae TOP52 FimH (FimH(52)) is highly homologous to that of E. coli, with an identical mannose binding pocket and surrounding hydrophobic ridge, it lacks the ability to agglutinate guinea pig erythrocytes. In addition, FimH-dependent biofilm formation in K. pneumoniae is inhibited by heptyl mannose, but not methyl mannose, suggesting the need for contacts outside of the mannose binding pocket. The binding specificity differences observed for FimH(52) resulted in significant functional differences seen in the pathogenesis of K. pneumoniae UTI compared to E. coli UTI. Infections in a murine model of UTI demonstrated that although the K. pneumoniae strain TOP52 required FimH(52) for invasion and IBC formation in the bladder, FimH(52) was not essential for early colonization. This work reveals that a limited amount of sequence variation between the FimH of E. coli and K. pneumoniae results in significant differences in function and ability to colonize the urinary tract.