No, you don't need the FPU but since the stock A2630 was shipped with a MC68882RC25 there is no good reason not to keep it (unless you want to try your luck with overclocking).
Also, if you ever want to use any optimized FPU libraries or FPU dependent software then you will certainly need it.