A hammer-wielding man accused of trying to kill a woman and her daughter saw a “shadowy” figure and became “overwhelmingly frightened”, a court heard.