The answer depends on how you define South. George Washington was from Virginia which was the capital of the Confederacy and a slave state and is often thought of as being in the South even though geographically it might be classified as a middle Atlantic state. Andrew Jackson was born in North or South Carolina and lived in Tennessee which is farther south than Virginia. Eisenhower was born in Texas which is farther South yet but is also farther west and may be thought as a western state. Jimmy Carter was born in Georgia which is surely in the South.
Take a look at a map: parts of Virginia are west of the state of West Virginia. When it was removed from Virginia and made a separate state in the Civil War, West Virginia received that name because it was on the western side of the Appalachians.
West Virginia
The state south of Virginia is North Carolina.
West Virginia
South Dakota is farther west than either North Carolina or West Virginia. North Carolina is located on the east coast of the United States. West Virginia is located about 80 miles north of North Carolina.
West Virginia is farther east than both Maryland and Ohio.
Minnesota is both farther north & farther south
minnesota is both farther north & farther south
The question is a bit ambiguous as it depends on what you mean by "farther." If you are asking which state is farther south, Florida is farther south than Ohio. However, if you mean which state is farther from a specific point, that would depend on the location you are measuring from. Overall, Florida is generally considered farther south than Ohio.
West Virginia............... most likely
Virginia