A person may feel the Holy Ghost in many different ways, called the fruits of the spirit and the still small voice. The Holy Ghost enters our mind and heart, which anyone can hear, but one must receive the Gift of the Holy Ghost for it to linger with them always.
Fruits of the Spirit:
In the Bible Paul teaches that, "the fruit of the Spirit is love, joy, peace, longsuffering, gentleness, goodness, faith, meekness, temperance..." (Galations 5:22-23.) We can also feel the Holy Ghost through thoughts, warnings, ideas, and comfort.
Still Small Voice:
The Lord can speak to us through the Holy Ghost as a "still small voice" just as he did with Elijah, "And, behold, the LORD passed by, and a great and strong wind rent the mountains, and brake in pieces the rocks before the LORD; but the LORD was not in the wind: and after the wind an earthquake; but the LORD was not in the earthquake: And after the earthquake a fire; but the LORD was not in the fire: and after the fire a still small voice" (1 Kings 19:11-12.) To me the still small voice is when the Holy Ghost speaks to our spirit and because it's a spiritual sensation we have to "listen" more closely to recognize it.
In Your Mind and Heart:
Often the whisperings from the Holy Ghost come into our mind and/or heart. I think this is how I most often feel or sense the guiding influence of the Spirit. "Yea, behold, I will tell you in your mind and in your heart, by the Holy Ghost, which shall come upon you and which shall dwell in your heart. Now, behold, this is the spirit of revelation; behold, this is the spirit by which Moses brought the children of Israel through the Red Sea on dry ground" (D&C 8:2-3.)
Anyone Can Feel the Holy Ghost:
It doesn't matter who you are, you can feel the guidance of the Holy Ghost. You have probably felt his power without realizing it because our Heavenly Father uses the Holy Ghost to guide us, inspire us, and help us make right choices.
I have Felt the Holy Ghost:
Throughout my life I have felt the influence of the Holy Ghost in many different ways. Feeling the Holy Ghost is different than feeling our own emotions, like watching a sad movie that makes you cry although sometimes feeling the Holy Ghost does make me cry. I often feel peace and joy when touched by the influence of the Holy Ghost and often it just comes as a thought of something I must do, something I hadn't been thinking of. At times I have also felt a warm, tingly sensation come over me and I know that my Heavenly Father loves me.
Gift of the Holy Ghost:
The influence of the Holy Ghost is felt occasionally and does not linger with a person unless they've received the Gift of the Holy Ghost, which you can learn more about by continuing with the article, "Gift of the Holy Ghost"