A virus would have to be written specifically for the PSP in order to affect it- to my knowledge there are none out there other than some places with supposed downgraders that actually brick the system altogether.
It almost sounds like the card reader in your PSP has some damage to it- you may want to contact Sony regarding sending the PSP in for repairs. If it is under a year old the repair will be free of charge.