Joo Ho-Taek

AI Researcher - Ph.D. Candidate
  • ureca87@gmail.com
  • +82-10-7768-9420

Current Status

I'm a Ph.D. Candidate at Gwangju Institute of Science and Technology (GIST) since 2019. I mainly focus on researching reinforcement learning (RL), game artificial intelligence (Game AI), explainable artificial intelligence (XAI), continual learning (CL), and object detection. And I am supposed to graduate in August 2023.

Publications

Automatic Observer for Starcraft

SCI (Top 8%)
2022
  • The observer who selects engaging scenes is a vital part of Esports.
  • The paper proposes an automatic observer model based on human observational data.
  • Our proposed method focuses on a spatial area the spectator watches.
  • The proposed model applied an object detection mechanism to find the spatial area.
  • The proposed model has higher performance than the existing event-based method.
  • Learning to automatically spectate games for Esports using object detection mechanism
    [ Ho-Taek Joo* , Sung-Ha Lee*, Cheong-mok Bae, Kyung-Joong Kim]
    Expert Systems with Applications (ESWA), 2022
    [Paper] [Code] [YouTube]

    Technologies used:

    • Docker
    • Pandas
    • Matplot
    • C++

    Data augmentation and Offine RL

    SCI
    2022

    Offline reinforcement learning is an algorithm that makes optimal decisions on a data set collected without exploration. In this paper, data augmentation is applied to the MDP structure of offline RL to improve the performance of the agent in the Atari Game.

    A Swapping Target Q-Value Technique for Data Augmentation in Offline Reinforcement Learning
    [ Ho-Taek Joo* , In-Chang Baek, Kyung-Joong Kim]
    IEEE Access, 2022
    [Paper] [Code]

    Technologies used:

    • Docker
    • Amazone EC2 (Cloud Compute Service)
    • Python

    Explainable AI

    Conference
    2022

    In this work, we propose a simple testing method, Determining the Possibility of Transfer Learning (DPTL), to determine the transferability of models based on Grad-CAM visualization of the CNN layer from the source model.

    Determining the Possibility of Transfer Learning in Deep Reinforcement Learning using GRAD-CAM
    [ Ho-Taek Joo*, Kyung-Joong Kim]
    The Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20) (Student Abstract), 2020
    [Paper]

    Explainable AI

    Conference Demo
    2019

    Explainable AI (XAI) is a visualization tool that shows the decision-making process in a way that humans can understand. In this paper, we propose to use Grad-CAM, one of the XAI techniques, when we visualize the behaviors of AI players trained by deep reinforcement learning (RL). Our experimental results show which part of the input state is focused on when one well-trained agent takes action.

    Visualization of Deep Reinforcement Learning using Grad-CAM: How AI Plays Atari Games?
    [ Ho-Taek Joo*, Kyung-Joong Kim]
    IEEE Conference on Games, 2019
    [Paper] [YouTube]

    Language

    • Korean (Native)
    • English (Intermediate)

    Education

    • Integrated Technology in Ph.D.
      Gwangju Institute of Science and Technology (GIST)
      2019 - current
    • Information Security in M.S.
      Sejong University
      2016 - 2018
    • Control and Instrumentation engineering and in B.S.
      Korea University
      2006 - 2015

    Skills & Tools

    Backend

    • Python
    • Docker
    • Visulization Tool

    Others

    • Git
    • Team Management
    • Linux
    • Docker
    • Amazon

    Interests

    • Foundation
    • Entrepreneurship
    • Webtoon
    • Netflix

    ETC

    • Army in Military
      Army sergent, honorable discharge (육군 병장, 만기제대)
      2009.04.13 - 2011.02.13
    • Research Assistant
      IoT platform research center, Korea Electronics Technology Institute(KETI)
      2017.3 - 2018.2