AI agent won the Outstanding Datasets and Benchmarks Paper Award at the 2022 NeurIPS (Neural Information Processing Systems) conference. NVIDIA researchers pumped a huge 730,000 videos of Minecraft from YouTube into training the MineDojo framework to play Minecraft. Using this, someone can tell a MineDogo agent to do whatever they want in Minecraft using high-level natural language. This includes things like ‘find a desert pyramid’ or something like ‘build a nether portal and enter it’ After those commands are given, the agent will perform the instructions in a series of steps, inside of Minecraft. The data allowed NVIDIA researchers to create a custom transformer model it calls MineCLIP, which uses video clips with specific in-game Minecraft activities. . . .
Read more at www.tweaktown.com
