I published the second draft of Summaries for William Lee and John Lee. You can see that James Lee was indeed married twice. I listed the children from both marriages and along with the dates, I think we can list the "party of eight" that left Greenock, Scotland for their Boston arrival in 1811. This list includes David Lee who was "loss at sea". This twice marriage and all the children, confused me for some time (maybe you too), I hope these Summaries help. I wish we knew as much for Mary Lee and James Old, but it will take more research in sites that probably cost more than Ancestry.com and FamilySearch.com. I urge you all to start your own research.
Finally, before I leave for a vacation, I invite you all to check out the history of the 1890 U.S. Census and what happen to it. Just "Google" 1890 Census and discover the fire and water damage and Congress's decision to destroy most of them. It's a interesting story.