I used to do bookbinding for several years and never had any problems with using bare hands. I only used latex gloves when repairing fragile books and/or paper.
If you are using new, clean and strong paper, I would not hesitate to recommend using bare hands in your bookbinding process. You should not experience any detrimental effects on the paper you use, I never did. I have better grip without gloves and thus more confidence in folding paper by hand. That said it would be prudent to keep your hands free of excessive perspiration and very clean, especially from dirt, ink and glue. Wash your hands as often as required and make sure your hands are definitely dry before recommencing your bookbinding.
Small hint: Do not slide your hands over any ink because it could smear. If you need to make a very crisp fold, I would suggest using a sheet of clear plastic to slide your hands over inked areas. Slide your hands over the plastic and not the ink marked spots.