I had this problem before- you may have some dirt on the contacts of the memory card and the system is having trouble reading it. You may want to try giving it a bit of a wipe with a soft cloth.
If that does not work it may be the card slot itself, in which case you will have to contact Sony about a possible repair job/ replacement. If the PSP is under a year old you are covered under warranty and it won't cost a thing.