It's probably not a problem. How much memory does you system have? How big is your swap space? Are you experiencing actual issues?
The Linux kernel probably though the memory was better used for I/O and moved data that was not used much to swap. Only when the system is reading from swap a lot (thrashing), it indicates that you need more memory.