According to Joubert's biographical notes, Gazier was born in Paris and studied at the Conservatoire where he got a 1st Prize in harmony in 1876 in the class of Augustin Savard. The following year he was awarded an «accessit» for the fugue course teached by François Bazin. Later, he was organist and choir master in Saint-Alexandre de Javel, then at the Saint-Pierre du Gros Caillou church.