I did find it cool that he mixed solos from his live shows into his songs

IIRC all songs on Joe’s Garage except one have the solos recorded separately (xenochrony). You gotta give Watermelon in Easter Hay a second chance, that’s possibly my favorite Zappa song ever.

Apostrophe is a good one to check out next.