Your xorg.conf looks very oldschoolish.
Input related configuration is not needed anymore, autodetection works much better in most cases.
Install xserver-xorg-input-evdev, remove the "InputDevice" sections and the 2 InputDevice lines from section "ServerLayout".
Perhaps this fixes your problems.