Jamie McCart's early own goal gave bottom-of-the-table Killie something to hold on to.
Stephen Kingsley lashed home a left-footed drive in the 86th minute to level, but Hearts failed to make the most of a weekend when one or both of the Old Firm will drop points.
Celtic host Rangers on Sunday with the pressure on the Scottish champions to respond after a dismal week.
Martin O'Neill's men were well beaten 3-0 by Rangers in the League Cup last weekend and followed that up with a 3-1 home defeat against Ferencvaros to open their Europa League campaign.
But Celtic have won all of their Scottish Premiership games so far to hold a five-point lead over both Hearts and Rangers.
Hibs responded to the sacking of David Gray by bouncing back from a goal down to draw 1-1 with Aberdeen thanks to Martin Boyle's penalty.
Dundee moved up to fourth with a 2-1 win over Motherwell.
Dundee United welcomed back their boss Jim Goodwin following a health issue with a 3-0 win at St. Mirren.