Milk of magnesia is an over-the-counter (OTC) treatment for constipation. It works by drawing water into the bowel and softening stool, making it easier to pass. It can also soothe indigestion and heartburn.