The temples at Baijnath proper are situated on the left bank of the Gomti. On the way to the main temple, just below the house the Mahanta, is the temple of Bamani (A corrupt form of Sanskrit Brahmani). Tradition of the place says that it was built by Brahmin widow and was dedicated by her to God Shiva. Another story states that a Brahmin woman who was kidnapped by a Kshatriya built the temple in favour of Shiva for the expiation of her sins. There is an idol of Shiva inside the temple. It has no inscriptions. The construction of the temple does not differ from that of the Tailihata group, so it may also be said to belong the same period. The main temple, dedicated to Baijnath or Vaidhyanatha (a name of Shiva), which gives its name to the present village, is situated near the Gomti. The temple is approached from the riverside by a flight of steps made of stones constructed by the orders of Katyuri queen. The place was and is a bathing place of the inhabitants who have now made a Kachha pond near the temple. Baijnath is 19 KMs away from Kausani and 26 kms from Bageshwer. One it used to be the capital of the Katyuri dynasty of kings and the place was then called Kartikyapura.
