So I ended up buying a dirt cheap headphone amp from China. It seems it has a chip similar to this:
http://www.ti.com/lit/ds/symlink/lm4917.pdf
The problem with this little device is that it has no volume pot. Where would one add the volume pot? According to 8biitbubsy's suggestion, I'd have to pinch the output of audio from teh chip and put the voolume knob between this and the output. Is that correct? And what kind of pot do I need that would take the two signals? Can I add a separation mixer to this?
Teh PCB is real small so I like it. I'd just have to add a voltage regulator and it would work inside the AMiga