The garden can be divided into the eastern and western sections. The main construction in the east is a four-sided hall 15.65 meters wide and 9.50 meters deep. It has a gable and hip roof with single-layered eaves. A rockery was built to the north of the hall, leaning on the wall, and a hexagonal pavilion was built to the east. The winding stone steps in the west lead to a corridor connecting the halls. Located to the south are five halls with corridors on three sides.

The west garden has vast, open area with a big pond at its center. To the north is a building with unevenly distributed roofs. The middle building is shaped like a huge butterfly -- hence its name, Butterfly Hall. A stone bridge was built to the east of the pond connecting the mid-pond pavilion. To the west of the pond is a group of rockeries stretching southward.

A two-storied building three bays wide was built in the west. It occupies a quiet and secluded corner of the garden.

The layout of He Garden is uniquely designed. Due to the jagged hills and continuous rockeries, the halls and pavilions are located near the pond. Hills, pavilions, water and other elements are integrated in harmony, demonstrating the typical characteristics of a garden in Yangzhou City. The designer's originality is also expressed by the garden plants: plum, sweet-scented osmanthus, white pine, peony, red maple, phoenix tree and banana. With such a magnificent design, the garden displays the changes in four seasons and in a day very effectively.