I have a Maple text window open all the time so I can pop it up and type '2+2;' into it. I thought this was ridiculous when I saw someone else doing it, but I've come round to it.

But for algebra I use bits of scrap paper or envelopes -- and then check the results with Maple.