But what specifically is connecting to mySQL?
Like forums would be a specific answer.
Knowing these specific answers could help people with experience suggest to you what is causing the high server load. (I personally couldn't help, cause I haven't reached the stage of a dedicated server.

)