Read more: Plants To Prune In Late Winter For A Stunning Early Spring Display, According To Our Master Gardener Theoretically, burning might feel like the best way to get rid of pesky tree stumps.