First of all lets see what work is; "Work is a force causing an object to move in the same direction as the force."
For work to happen; 1. A force must be applied to an object. 2. The object must move in the same direction as the force.
*Now, for your question; since the book(object) is not moving in the same direction as your force, no work is being done!! Hope that helps! Have a nice day:D