Samples DO load to ram, if there isn't enough ram they page to the drive...... You need a combo of, fast/lots of memory and good drive for VST's.

If your processor is at 20% your more than ok. I was running VST's on a 10 year old macbook, but it had an SSD and i dropped the sample rate...