Sorry my friend, your argument is pure speculation. Luke 2:4-5 Joseph also went up from Galilee, out of the city of Nazareth, into Judea, to the city of David, which is called Bethlehem, because he was of the house and lineage of David, to be registered with Mary, his betrothed wife, who was with child.While I agree that there is no evidence to suggest that Mary remained a virgin after giving birth to Yeshua nothing you pointed out actually proves your point. All of the family relationships could be explained by Joseph having additional wives. The family relationships mentioned in Matthew 13 are in the context of "carpenters son" (we understand that he wasn't actually his biological son) but in that context he would be brother to the children of Joseph's other women as well...
There is nothing in the text to indicate Joseph had more than one wife with him. Then, according to Matthew 1:55; and did not know her till she had brought forth her firstborn Son. The word "till" is translated from a particle marking a limit; that limit being till the birth of "her firstborn Son." The text is quite clear, Joseph and Mary did not have a sexual relationship until after the birth of the Christ Child, and Jesus had brothers and sisters later on. If we stick with what is written there is no problem with the understanding. We don't need to speculate when the text is so clear. Cheers