It does sound like slippage rather than an engine problem, either with the clutches in the transmission or at the flange where the prop shaft attaches to the back of the transmission. If the flange hasn't been off the prop shaft in a while, it probably isn't slipping but it's worth a look when this happens. A strange but effective way to test the transmission's performance (inboard installations only) is to try running the engine at (in your case) 1800 rpm in reverse. I know it sounds dumb but virtually all marine transmissions have no reduction in reverse. They run at 1:1 when backing down. The direct drive puts extra strain on the transmission and if it is going to slip, it will do so more readily in reverse.
There is no pressure at the dip stick tube, so don't worry about that.
You also might want to see if the transmission oil cooler is doing its job. The hose or pipe from the cooler output back to the transmission should be warm or only moderately hot to the touch after being underway for some time. If the transmission fluid looks nice and red and doesn't have a burned smell, then the oil cooler is probably OK.