It usually means to act in an unexpected way, often by becoming obsessive about a new idea, interest or hobby.
The image behind it is that one has dived down into the deep end of the swimming pool, instead of splashing about in the shallow part.
Chat with our AI personalities