Ocean acidification (OA) is expected to drive the transition of coral reef ecosystems from net calcium carbonate (CaCO3) precipitating to net dissolving within the next century. Although permeable sediments represent the largest reservoir of CaCO3 in coral reefs, the dissolution of shallow CaCO3 sands under future pCO2 levels has not been measured under natural conditions. In situ, advective chamber incubations under elevated pCO2 (̃800 µatm) shifted the sediments from net precipitating to net dissolving. Pore water advection more than doubled dissolution rates (1.10 g CaCO3 m−2 d−1) when compared to diffusive conditions (0.42 g CaCO3 m−2 d−1). Sediment dissolution could reduce net ecosystem calcification rates of the Heron Island lagoon by 8% within the next century, which is equivalent to a 25% reduction in the global average calcification rate of coral lagoons. The dissolution of CaCO3 sediments needs to be taken into account in order to address how OA will impact the net accretion of coral reefs under future predicted increases in CO2.