I spent my experience kind of dumb like so I wanted to see if I could give the skill back and get the exp in exchange. So, just for fun, I told the game to spend -20 exp on my fire skill and I now have -20 out of 20 exp required for the next level in fire!