Principal bundles have been studied in their own right and used extensively as tools in differential geometry for at least the last sixty years. It is perhaps not so well-known that their theory originates largely in questions of arithmetic geometry. This talk will recall a bit of this history, and present some recent developments in the application of principal bundles and their moduli to Diophantine geometry, the study of rational solutions to polynomial equations.