Study of effect of channel on system with various modulation