Five of the party were rescued from the river but at least six were still missing early on Thursday.
Security sources said the search for them had been hampered by the darkness.
The interior ministry said the bodies of four babies had been recovered. Several passengers are still missing.Five people were rescued from the crash scene and the captain of the cargo boat has been arrested.
It is not clear if the couple thought to be celebrating their engagement were among the casualties.
At least two children were killed. Family and friends of a young couple had hired the boat to celebrate their engagement. It was not clear whether the couple were among the dead.
Police said they had arrested the captain of the cargo boat and his deputy after the accident, one of many that happen on the Nile and off Egypt’s coast each year.
In the deadliest such accident in February 2006, an Egyptian ferry sank in the Red Sea, killing more than 1,000 people.