After I got this results I realized my calibration must have been off. So I cut another random circle, measured it, and re-applied the calibration circle. As you can see it's in a different location this time.
After doing more cuts with the center and measure the diameter method I got much closer results than the first time, but consistently get really good cuts by not measuring and just putting the tip of the blade on the edge of the part.