Benny worked compulsively and had only a few friends, although colleagues who knew him closely insist that he was never lonely, but content with his own company. He never married, although he did propose to two women — one the daughter of a British writer — and was rejected by both. He never owned his own home, nor even a car, instead preferring to rent a small flat in Teddington, a convenient walking distance to the studios of Thames Television, where he taped his shows. His mother lived with him until her death shortly before his. Before his move to Teddington, he lived at 22 Westrow Gardens in Southampton. [citations needed]

Travelling was the one luxury he consistently permitted himself. Hill became a first-degree Francophile, enjoying frequent visits to Marseille. Until the 1980s, he could enjoy the anonymity of France's outdoor cafes, public transport, and socialising with local women. Besides mastering French, Benny also could 'get by' speaking German, Dutch and Italian in his travels. Hill's overseas holidays were often gathering missions for comedic material, some newly inspired by foreign surroundings, or borrowed from regional acts.

Hill was a distant relative of the Australian actress and singer Holly Valance (Hill's cousin being Valance's grandfather).