Dolley Payne was born in Guilford County. She became the First Lady in 1809 when James Madison was sworn in as the President of the United States. On August 24, 1814, when British Forces invaded Washington and burned the White House, Dolley Madison famously directed workers to remove the Gilbert Stuart portrait of George Washington to ensure its safety.