I thought I would jot down some info I have in my database in case you don't have it. Let me know if it conflicts with what you have.

1851 Rushen Census
Port St Mary
Mark Watterson head married 37 baker empl 1 man b Rushen
Ann wife married 30 British subject Anna Harley 2nd wife of Mark the baker
Samuel son 8 scholar b Rushen Your Samuel ch 21 Aug 1842 Rushen
Thomas son 7 scholar b Rushen full brother
Ann daughter 1 b Rushen 1/2 sister
Emma daughter 2 mo b Rushen 1/2 sister

Port St Mary
Mary Harley head widow 72 pensioner b England
Jane Harley dau unmarried 27 school mistress b England
Margaret Harley dau unmarried 23 dressmaker b England
Martha Watterson gr dau 2 b Rushen full sister of Samuel mother Jane Keggin died in 1848 ? birth complications

1881 Rushen Census
, 5, 15, 85, WATTERSON, Samuel, Main St, Head, Widower, 38, Master Baker, P.StMary
, 5, 15, , , , , , , Emps 3 men
, 5, 15, 85, WATTERSON, Elizabeth, Main St, Daughter, , 10, Scholar, P.StMary
, 5, 15, 85, WATTERSON, Annie, Main St, Daughter, , 8, Scholar, P.StMary
, 5, 15, 85, WATTERSON, Thomas, Main St, Son, , 7, Scholar, P.StMary
, 5, 15, 85, WATTERSON, Wilfred, Main St, Son, , 3, , P.StMary
, 5, 15, 85, GALE, Anna, Main St, Servant, , 18, Gen Domestic, Rushen
, 5, 15, 85, TURNBULL, John F., Main St, Servant, , 18, Baker, England
, 5, 15, 85, CORRIN, Edward, Main St, Servant, , 16, Baker Appt, Rushen

Samuel's wife Jane Quayle died in 1880. She was ch 19 Feb 1843 Patrick d/o William Quayle of Glen May Patrick & his wife Mary Ann Crellin I have more info re Quayle lineage
1851 Patrick Census
Glen Maye
William Quayle had married 51 Farmer & grocer 36 ac empl 2 labs b Patrick
Mary 44
Mary 22 dressmaker
Elizabeth 19
Margaret 17
William 15
John 12 scholar
Thomas 11 scholar
Jane 8 scholar

Donna

1881 Rushen
, 5, 9, 50, WATTERSON, Mark, High Street, Head, Married, 67, Master Baker emp 3men, Rushen
, 5, 9, 50, WATTERSON, Anne, High Street, Wife, Married, 61, , France
, 5, 9, 50, WATSON, Margaret, High Street, Daughter, Married, 27, , P.StMary
, 5, 9, 50, WATTERSON, Catherine, High Street, Daughter, Unmarried, 24, Shop Girl, P.StMary
, 5, 9, 50, WATTERSON, Mark, High Street, Son, Unmarried, 22, Baker, P.StMary
, 5, 9, 50, WATSON, Maggie, High Street, Granddau, , 2, , Scotland
, 5, 9, 50, SHIMMIN, George, High Street, Appt, , 16, Baker, C.Town