The candi here are unique to Bali, but similar to free-standing candi found in Java. The identity of the builders is not known. Balinese myth tells that the legendary warrior Kebo Iwa carved by them by hand in a single night. It is believed the shrines were constructed in 1080 AD by King Anak Wungsu in honor of his father, the deified King Udayana. There are stories of Gunung Kawi being a tomb, but no evidence of remains has ever been found. The site was absorbed into contemporary Balinese Hinduism beginning in the 16th century.

The candis resemble small buildings with three-tiered roofs, adorned with carvings of fertility symbols. At their base is a small chamber for offerings. Above each candi is a panel with an inscription in an ancient Javanese language. Most of the panels are indecipherable now, except for one reading “Haji Lumahing Jalu," meaning "the king made a temple here." There are five major candis on one side of the river; four minor candis on the other side; and a tenth candi, harder to see, that is set back from the other shrines.

The area holds 34 additional stove carvings. Among these are room-like chambers perhaps designed for meditation and prayer. The closed chambers have resonant acoustics as if designed for musical usage. As the river water passes by the temple, it becomes sanctified, and you can bathe in in the water for a small fee. The path down to the shrines has 270 stone steps, so proper footwear is advised.