The St. Stepanos Church, high above on the edge of a mountainous gorge, watches over the village of Kosh. To get there you must drive north out of Kosh and take a rough dirt road. A 4x4 is recommended but I think you could make it without one. Based on its architecture, the church is dated to the 7th century. It has a centrally planned cruciform design with a dome overtop. There are remnants of wall paintings inside.
There is also a 13th century chapel and cemetery on the hill above the church.