We will give a geometric description of the flow of an ideal fluid on a Riemannian manifold M in terms of geodesics on the group of volume-preserving diffeomorphisms of M. Next, we will explore the structure of the singularities of the Riemannian exponential map on this group and describe several normal forms that this map can display near such singularities.