The water might be coming from the temperature and pressure relief valve (T&P valve), though ... to turn off the water heater ...

Tankless heaters also have cold water and gas supply valves, and pressure relief or purge valves that work similarly to a T&P valve with tank water heaters. They heat water with an element called ...