The former coach with Millwall, Palace, Wolves, Preston, Villa and Middlesbrough as well as the England national team under Phil Neal and Graham Taylor has signed a two year deal and replaces Steve Kean.
Chris Coleman said about the appointment: : "He is exactly the right person for me in terms of where my career is now. Steve has a lot of experience in the Premier League and at international level.
"He has spent a long time coaching in the top division, is massively respected in the game and is the right person to help us take Coventry to the next level.
Harrison, known for his dressing room pranks, was at Crystal Palace when Chris Coleman and Andy Thorn both played there and said:
"I was a coach at Crystal Palace when Chris and Andy Thorn were youngsters starting out in the game and I've followed their progress ever since."
"I love the coaching side of the game. I used to be a defender but I love working with attack minded players and the Club has some good youngsters of that mould.
"I'm looking forward to getting started on 1 July and meeting the lads properly. I saw them play several times last season and their potential is clear. I was very impressed with their youthful exuberance.
"This is a fantastic stadium and the training ground is first class, so everything is in place to take this club forward.