Filming took place during August and September 1975 at locations around Balmain, Sydney. A number of scenes were filmed at the Sir William Wallace Hotel and the Kent Hotel. The Kent Hotel closed in 1976 and later reopened for a time as 'Caddie’s Restaurant’, named for its association with the film. Other scenes were filmed in Edgecliff, where some buildings had scarcely changed since the 1920s.

Studio filming took place at the Cinesound Studios in Rozelle. The limited budget for Caddie meant that some scenes were cut from the script and the bar scenes included actors working as extras but also locals. Caddie’s real life daughter also visited the set. The total shoot was completed in six weeks.