At the foot of the Sivagiri, there is a small temple dedicated to the Lord Ganesha. He is called by the name Pada Vinayakar. People go the temple before they visit the main temple of Lord Muruga.
The temple of the Goddess Periyanayaki Amman is quite historical. There are two Pandyan motifs of two fishes in the temple, which shows the existence of their rule in the place. The front of the temple has the architecture of the Nayaka kings of Madurai. The temple is carved out of stone and is said to be among the oldest temples in Palni.
The deity at the temple stands with a baton in his hand. The icon is unique, made by Siddha Bhogar. The icon was made by combining nine poisonous substances. Lord Murugan is considered as the God of beauty and the God of youth. The climb up to the temple involves over 600 steps. There is a rope train or rope car for those who do not choose to do the climb.
This temple dedicated to Shiva as Periya Avudaiyar. This temple is situated on the banks of the Shanmugha Nadi, away from the rush of the town.
This is another temple in the town which is dedicated to goddess Parvathi called as Periyanayaki Amman. The temple is known more commonly by the name Oorkovil. The temple portrays an interesting blend of Pandya and Nayaka architecture. It is said that in the past a subterranean passage was connected to the temple with the Periya Avudaiyar temple.