New York State does not require registration for vessels that are manually propelled (doesn't matter if it's oars, pedals, paddles etc).
Vessels under 16 feet in length (this sub has been reported to be 8 feet in length) and manually propelled vessels, are not required to carry daytime visual distress signals in New York State waters and must meet USCG regulations on federally controlled waters. The same exemption from daytime signals is here too.
This guy also had a small inflatable with two people in it, escorting him. He's not moving very fast, chose a relatively traffic-deficient area and had a support boat. Could they have gone somewhere else to ensure safer amounts of traffic? Sure, but I don't think they were criminally negligent in going where they did. Stupid, maybe, but you can't regulate that.
EDIT: Okay, so it appears that they got caught in the current.
Still,
The ONLY thing they can really get them for, is violating the security zone, and IMO, the situation could have easily been taken care of by simply informing the men that they had violated it. If they were argumentative, belligerent, drunk or whatever, fine - arrest them. But, our police state paranoia of the unknown and worries about any little perceivable threat turned this into a way bigger issue than it needed to be - all at the taxpayer's expense.