When you’re ready to cook, crank your grill to medium-high direct heat. Grill the swordfish for 3–5 minutes per side until it hits between 130°F