Liverpool missed out on the chance to book a place in the FA Cup final for the first time since 2012 following a 2-1 loss against Aston Villa.
The Reds took the lead on on 30 minutes thanks to a brilliant finish from Phillip Coutinho.
The Liverpool lead was short lived as Benteke equalised just six minutes later.
Aston Villa took the lead shortly after the half-time break when Delph scored the winner on 54 minutes.
Reds captain Steven Gerrard started after serving a three match suspension.
Liverpool defender Martin Skrtel also returned from suspension featured in defence with Emre Can.
Skrtel, Can and Dejan Lovren started in defence for Liverpool.
Can completed the highest number of tackles (4) and clearances (5) for his side today and was given a Whoscored rating of 6.90.
Aston Villa will face last seasons FA Cup winners Arsenal in the final in May.
Aston Villa 2-1 Liverpool
Kick-Off: 15:00 GMT
Referee: Michael Oliver
Aston Villa’s possible starting lineup:
Given, Bacuna, Baker, Vlaar, Richardson, Westwood, Delph (c), Cleverley, Grealish, N’Zogbia, Benteke
Subs: Guzan, Okore, Sinclair, Weimann, Cole, Lowton, Gil
Manager: Tim Sherwood
Liverpool’s possible starting lineup:
Mignolet, Can, Skrtel, Lovren, Moreno, Allen, Henderson, Gerrard, Markovic, Coutinho, Sterling
Subs: Jones, Johnson, Toure, Lambert, Manquillo, Borini, Balotelli
Manager: Brendan Rodgers
Goals: 30′ Coutinho, 36′ Benteke, 54′ Delph