There were giants in the earth in those days; and also after that, when the sons of God came in unto the daughters of men, and they bare children to them, the same became mighty men which were of old, men of renown.
In the past, there were big people on Earth. Later, when divine beings joined with human women, their children grew up to be famous and powerful.