The first option is how "game AI" has been developed by most gaming companies until recently. The second option is how DeepMind, OpenAI, and a few others are now building gaming AI. Only the latter is about building a gaming AI that "learns to play the game like a human does".