ive killed plenty of deer with a head full of antlers, i always throw the antlers in the gut pile.
Of course you did.... I shot a 180 in buck I quartered it up and left the antlers, a squirrel at them the next day when I went back for them. But I did it.