Three people were rescued Wednesday afternoon in the area of Plum Island after they were swimming off a sand bar in the Merrimack River.