Free State Stars booked their place in the 2016 Telkom Knockout Cup semi-finals after defeating 6-5 on penalties on Sunday afternoon.
Amakhosi and Ea Lla Koto had played to a 2-2 draw at the Moses Mabhida Stadium in the city of Durban.
Ea Lla Koto began the match brightly and they took an early lead just nine minutes into the game through Bokang Thlone whose goal silenced the Chiefs fans.
Stars goalkeeper Thela Ngobeni was then kept busy by Chiefs and on the half-hour mark he brilliantly stopped Erick Mathoho's cross from close range.
Before collecting Chiefs midfielder George Maluleka's dangerous cross in the 38th minute to ensure that the first-half ended 1-0 in favor of Stars.
Amakhosi dominated the second-half and they managed to snatch a late equalizing goal in the 83rd minute through Edmore Chirambadare.
The two sides were unable to find a late winner in the dying minutes of the Cup encounter and extra-time followed.
Thokozani Sekotlong restored Ea Lla Koto's lead in the 98th minute to stun the Chiefs fans inside the Moses Mabhida Stadium.
Erick Mathoho did level matters for Chiefs in the 108th minute with a fantastic header and ultimately, penalty shootouts followed after a 2-2 draw.
However, Chiefs duo Lorenzo Gordinho and William Twala failed to convert their spot-kicks and Stars emerged 6-5 winners on penalties.
Chiefs (0) 2 (Chirambadare 83', Mathoho 108')
FS Stars (1) 2 (Thlone 9', Sekotlong 98')
Chiefs: Khune, Mphahlele (Twala 60'), Gordinho, Cardoso, Mathoho, Masilela (Khumalo 63'), Tshabalala, Katsande, Maluleka, Katsvairo, Parker (Chirambadare 70').
FS Stars: Ngobeni, Mbhele, Masehe (Booysen 46'), Nkausu, Thlone (Ella 90'), Mobbie (Mashego 74'), Dlamini, Vilakazi, Venter, Sekotlong, Sekola.