Learning to Explore: An In-Context Learning Approach for Pure Exploration