Yes, see some hints about how to modify Arduino to work without a crystal here: http://arduino.cc/en/Tutorial/ArduinoToBreadboard
Generally however, I would recommend sticking with the crystal and putting the speaker elsewhere; you only need one output pin to do it.
