Before you jump into that project, let’s make sure you have set yourself up for success and completion. You can do this by reviewing the Six Stages of Getting Organized. These six stages apply to most any organizing project, whether you’re clearing that spare storage room (aka guest bedroom) to create an office, or decluttering the living room, organizing the kitchen shelves, cleaning out the garage, or tackling that pile of papers.
The second stage in getting organized (and working on your organizing project) is to LET GO of what doesn't work for you, what you no longer use or need, and especially what you no longer love. Letting go is not just getting rid of things, it's about creating the space and the time and the energy for what you do want.
If you are finding it hard to open up the space and let go of some of your books, I suggest you take some time to revisit the book (not just the memories) and determine if you still need the book physically on your bookshelf.