You may want to try setting the Optical BD/ DVD settings to Bitstream. Also, change the audio output in the Sound Settings to the Digital Out (Optical Cable).
Finally, you may want to try plugging the optical cable into the PS3 instead of the tv and run that to your reciever.