As someone who had spoken out against the Patriots, Swallow might have balked at the idea of pledging allegiance to them. When Newport loyalist Thomas Vernon refused to pledge his allegiance to the Patriots, the Rhode Island legislature exiled him. He kept a diary during the time he was under police supervision in the town of Glocester, Rhode Island, which you can read here. It is unclear what happened to Vernon afterward, but a friend wrote him suggesting that he move to Canada. Like many Loyalists, he could very well have ended up in Nova Scotia after the war.