They resumed on 256-4 and lost Tim Ambrose for 28, before Jon Trott was bowled by Mahmood for 79.
Rikki Clarke made 54 before he and Ant Botha lost their wickets to leave Warwicks on 370-8.
In the Ashes match, Australia, were 156-8 in reply to England's first innings total of 425.