In addition to his classical work, Dr. Kevin J. Kelly has been writing and performing music in jazz, rock, and folk contexts since 1992. Some of his album credits include:
- The Ghost of Philadelphia, LP by Homesick Elephant (2007) - Songwriter, Producer, Engineer, Acoustic Guitar, Vocals (tracks 1-9)
- The Search for Colonel Mustard, LP by Cheese on Bread (2007, 2009 on Moorworks-Japan)
- Good Work of the Dead, LP by Michael Nace and the Nace Family (2006 on Ionik Recordings) - Banjo, Vocals, Co-engineer, Co-producer
- Your Meekness Gives Me Hope, LP by Michael Nace (2005 on Mind Walk Records) - Piano, Organ, Vocals
- The Voyage Out, LP by Michael Nace (2002 on Minority Records) - String arrangements, Bass Guitar
- Circle Music, EP by Drill for Absentee (1999 on Mind Walk Records) - Bass Guitar, Vocals, Songwriter (All Tracks)
- Drill for Absentee, EP by Drill for Absentee (1998 on Mind Walk Records) - Bass Guitar, Vocals, Songwriter (All Tracks)