It needs to cure until hard. Not car tire hard, but not mushy either. Higher temperatures (within reason) will speed the cure. If you leave it in a cool space, it could take a week or more to cure.
If you want a real test, you need to use gasoline. The molecular size of water is larger than gasoline, so a water test may not tell if you've completely fixed the leak.