18 citations · 53 across the 12 of their papers we have counts for
22 papers
A2C is a special case of PPO
Shengyi Huang, Anssi Kanervisto, Antonin Raffin +3
Advantage Actor-critic (A2C) and Proximal Policy Optimization (PPO) are popular deep reinforcement learning algorithms used for game AI in recent years. A common understanding is t…
GAN-Aimbots: Using Machine Learning for Cheating in First Person Shooters
Anssi Kanervisto, Tomi Kinnunen, Ville Hautamäki
Playing games with cheaters is not fun, and in a multi-billion-dollar video game industry with hundreds of millions of players, game developers aim to improve the security and, con…
Insights From the NeurIPS 2021 NetHack Challenge
Eric Hambro, Sharada Mohanty, Dmitrii Babaev +26
In this report, we summarize the takeaways from the first NeurIPS 2021 NetHack Challenge. Participants were tasked with developing a program or agent that can win (i.e., 'ascend' i…
MineRL Diamond 2021 Competition: Overview, Results, and Lessons Learned
Anssi Kanervisto, Stephanie Milani, Karolis Ramanauskas +19
Reinforcement learning competitions advance the field by providing appropriate scope and support to develop solutions toward a specific problem. To promote the development of more…
Optimizing Tandem Speaker Verification and Anti-Spoofing Systems
Anssi Kanervisto, Ville Hautamäki, Tomi Kinnunen +1
As automatic speaker verification (ASV) systems are vulnerable to spoofing attacks, they are typically used in conjunction with spoofing countermeasure (CM) systems to improve secu…
Agents that Listen: High-Throughput Reinforcement Learning with Multiple Sensory Systems
Shashank Hegde, Anssi Kanervisto, Aleksei Petrenko
Humans and other intelligent animals evolved highly sophisticated perception systems that combine multiple sensory modalities. On the other hand, state-of-the-art artificial agents…