So, interweb health care advice is tricky. Lots of unknowns. And there are different practice patterns in different parts of the US. And if you are in Canada, things get even more variable, eh? And how do you know that anybody's advice is sound?
But if you are a healthy, active, non smoker, most (all?) of the foot and ankle docs I have worked with in Denver would advise surgery for your injury. Their advice would focus on 3 topics. You mentioned concerns for blood supply. I think this is a rare complication of this fracture that may be decreased with surgery. But it is a rare complication that would likely cause significant arthritis that could be treated with a fusion of that joint in the future if needed.
The biggest concern about this fracture is that it is intra articular/ broken joint surface. I was a bicycle mechanic in a previous life and I describe the joint surfaces like the cups and cones of the old wheel hub. If things aren't smooth, it will wear out early. AKA arthritis. The intention of the surgery is to align the joint surfaces as best as able. Even a 1-2 mm irregularity in the joint surface increases the risks for arthritis. Perhaps earlier and more severe as well. But keep in mind that the injury has already predisposed the joint to arthritis, so surgery is no guarantee of a pain free toe. There is no sure bet, but if it becomes chronically painful, the involved joint could be fused in the future.
Another intention of surgery is to avoid deformity. When we get even older than we already are, plenty of us loose protective sensation in our feet and a deformed toe can cause wounds on the feet that cause infections and potential amputations.
So my advice is to seek another opinion, maybe a few, and keep going until you have met a doc that you feel comfortable with and trust. If surgery is elected, any time within the first 2 weeks or so after the injury should not complicate the surgical repair.
Lastly, that MacGievered thing on your foot is gonna tear your skin off. I prefer Coban or vet tape to that sticky stuff as it sticks to itself, not your skin. Maybe tape the big toe to the long toe and use the post op shoe and loose the outrigger? But you do you.
I hope that this is more helpful than confusing and best of luck with a rapid recovery.