audio - Can't hear people unless switched to speaker phone

I cannot hear callers unless my speaker phone is on...how can I fix this? I have gone to all the settings but it does not change anything. The caller can hear me ok but there is only a very faint which is inaudible sound back.