For the record: After disassembling the whole machine again I found my suspiscion confirmed. The INT2 wire on the CIA had become lose.
Now the speed is normal again. So it seems that the cybppc.device can even transfer data without interrupts. It will just use a very long timeout and then assume the data is ready.