The small pool forward is adjacent to the Lotus Spa on deck 16, and is a "swim-against-the-current" pool for those swimming for exercise. The Outrigger Bar overlooks the small pool aft is on deck 14, and is usually quiet. This pool area is a great place to watch the sun rise (or set).
The two large swimming pools are surrounded by bars, places to grab a snack, and deck chairs. On our Mediterranean cruise, there seemed to be plenty of deck chairs for sunning, although most people congregated near the pools. However, loud music is played most of the day near the Neptune's Pool, and the large movie screen with videos overlooks the Calypso Pool, so both pool areas can be very noisy during the day. If you want a quiet area to read your trashy novel, find a deck chair away from the two main pools, or splurge on a ticket to the Sanctuary.