You do get to keep access to books you've purchased but if you're in the audible plus thing and you got any "free" books, you would lose access to those when you end your membership.