No, he just used it for the first Scout camp.

Robert Baden-Powell held his first Boy Scout camp on Brownsea Island on 1 August 1907.

The Brownsea Island Scout camp was a boys camping event on Brownsea Island in Poole Harbour, southern England, organised by Lieutenant-General Baden-Powell to test his ideas for the book Scouting for Boys. Boys from different social backgrounds participated from 1 August to 8 August 1907 in activities around camping, observation, woodcraft, chivalry, lifesaving and patriotism. Recognised as the world's first Scout camp, the event is regarded as the real origin of the worldwide Scout movement. [Source: Wikipedia]

Scouts (UK)

It is not a flower but a fleur-de-lis. The history goes a long way back to Baden Powell and his experimental camp on Brownsea island in 1907.