You are correct. The nylon washers in the EQ35 mount act as spacers to align the worm and ring gear. The washers are also very thin, so it is difficult to find bearings that are thin enough to replace them.
If you were to replace the nylon washers with bearings, it is likely that the worm and ring gear would become misaligned. This would cause the mount to track poorly and could damage the gears.
The proper way to "hypertune" an EQ35 mount is to carefully adjust the nylon washers until the worm and ring gear are properly aligned. This can be a time-consuming process, but it is the only way to ensure that the mount will track accurately.