The memorial is a large brick memorial hall, which commemorates those from the district who served in the First World War. The building has a large gabled galvanised roof with a doubled gable front. The façade is dominated by decorative brickwork with stylised cross sections high above the front entrance and the name of the hall written in large letters above the entrance. The building is architecturally balanced with a central doorway and windows on either side. A foundation stone is inset on the front of the hall. There is a half circular window above the doorway, which is representative of the Federation period.
Following the First World War, the Rylstone community formed a Memorial Hall Building Fund. A Grand Ball was held in George's Garage on 26 August 1921, followed by a Juvenile Ball the following evening. Dances were held every alternate Wednesday in the Rylstone School of Arts to raise funds for the building (Mudgee Guardian and North-Western Representative, 16 June 1921). Further fundraising continued throughout the district.
A competition was held to find the best design for the Soldiers' Memorial Hall. Nine competitors entered for the prize of £20, which was won by Mr Basil F Sutton of Sydney (Mudgee Guardian and North-Western Representative, 22 May 1924). The winning design was to measure 40 by 124 feet with concrete foundations and a tallow wood floor. There were to be two dressing rooms at the rear, two cloak rooms at the front, a cinema operating box, a stage and a basement supper room.
Conflicts within the Building Committee resulted in its replacement by a Board of Trustees in February 1925 (Mudgee Guardian and North-Western Representative, 26 November 1925). Progress with the building of the hall was fraught with delays, including fundraising problems, questions regarding the building tender and issues with the planned size of the hall. A report published in the Mudgee Guardian and North-Western Representative, 18 June 1925, revealed that the public had raised £1,100 with the Department of Lands granting land valued at £500, but in order to obtain a larger hall, the plans had been changed three times with a further £1,500 required.
Two months later, a meeting of the Trustees received the amended plans for the hall, which had been requested by the Government. The chosen builder, Mr Kerney, was asked to amend the price. A decision was also taken to approve action on a mortgage. A month later, the plans were approved (Mudgee Guardian and North-Western Representative, 27 August 1925).
The foundation stone was laid on 17 April 1926 by Major General C F Cox, CB, CMG, DSO, who received a salute from a body of Rylstone Light Horsemen and was presented with a silver trowel by Mrs Jamison after the ceremony. Addresses were given by the Shire President, Councillor D Jamison, his colleagues and the clergy (Mudgee Guardian and North-Western Representative, 22 April 1926).
Later that same year on 23 June 1926, the hall was officially opened by Major General Cox at a Grand Opening Ball (Mudgee Guardian and North-Western Representative, 17 June 1926).