Works and Publications

Awards Link to heading

  1. Y. Obinata, K. Kawaharazuka, N. Kanazawa, N. Yamaguchi, N. Tsukamoto, I. Yanokura, S. Kitagawa, K. Shinjo, K. Okada, M. Inaba: Semantic Scene Difference Detection in Daily Life Patroling by Mobile Robots using Pre-Trained Large-Scale Vision-Language Model, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp.3228–3233, 2023. IEEE Robotics and Automation Society (RAS) Japan Joint Chapter Young Award (in IROS2023)

  2. Y. Obinata, K. Kawaharazuka, N. Kanazawa, N. Yamaguchi, N. Tsukamoto, I. Yanokura, S. Kitagawa, K. Shinjo, K. Okada, M. Inaba: Semantic Scene Difference Detection in Daily Life Patroling by Mobile Robots using Pre-Trained Large-Scale Vision-Language Model, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp.3228–3233, 2023. SICE International Young Authors Award (SIYA-IROS2023)

  3. Y. Obinata, I. Yanokura, N. Tsukamoto, N. Yamaguchi, S. Kitagawa, K. Okada, M. Inaba: System for Teaching Robot Action Instructions and Responding to Situations Using a Chat Application, The 18th International Conference on Intelligent Autonomous Systems (IAS18), 2023. Finalist of Best Paper Awards

  4. Y. Obinata, N. Kanazawa, K. Kawaharazuka, I. Yanokura, S. Kim: 1st prize at RoboCup@home Japan 2022 General Purpose Service Robot, 2023.

  5. K. Shinjo, S. Kitagawa, N. Yamaguchi, Y. Obinata, K. Okada, M. Inaba: Realization of delivery robot system which ask for delivery tasks while standing by, The 22th SICE System Integration Division Annual Conference, 2021. SI2021 Outstanding Presentation Award

Research Works Link to heading

Journals Link to heading

  1. K. Kawaharazuka, N. Kanazawa, Y. Obinata, K. Okada, M. Inaba: Continuous Object State Recognition for Cooking Robots Using Pre-Trained Vision-Language Models and Black-box Optimization, IEEE Robotics and Automation Letters (RAL), 2024.

  2. K. Kawaharazuka, Y. Obinata, N. Kanazawa, K. Okada, M. Inaba: Robotic State Recognition based on Large-Scale Vision-Language Models and Genetic Algorithm, Journal of the Robotics Society of Japan, (in press), 2023.

  3. N. Kanazawa, K. Kawaharazuka, Y. Obinata, K. Okada, M. Inaba: Cooking Task Execution of Robot based on Food Condition Change Recognition by Recipe Description Analysis and Time-Series Use of Vision-Language Model, Journal of the Robotics Society of Japan, (in press), 2023.

International Conference Proceedings (Peer Reviewed) Link to heading

  1. K. Kawaharazuka, Y. Obinata, N. Kanazawa, K. Okada, M. Inaba: Robotic Applications of Pre-Trained Vision-Language Models to Various Recognition Behaviors, IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp.458–465, 2023.

  2. K. Kawaharazuka, N. Kanazawa, Y. Obinata, K. Okada, M. Inaba: Daily Assistive View Control Learning of Low-Cost Low-Rigidity Robot via Large-Scale Vision-Language Model, IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp.452–457, 2023.

  3. Y. Obinata, K. Kawaharazuka, N. Kanazawa, N. Yamaguchi, N. Tsukamoto, I. Yanokura, S. Kitagawa, K. Shinjo, K. Okada, M. Inaba: Semantic Scene Difference Detection in Daily Life Patroling by Mobile Robots using Pre-Trained Large-Scale Vision-Language Model, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp.3228–3233, 2023. IEEE Robotics and Automation Society (RAS) Japan Joint Chapter Young Award (in IROS2023), SICE International Young Authors Award (SIYA-IROS2023)

  4. A. Ichikura, K. Kawaharazuka, Y. Obinata, K. Okada, M. Inaba: A Method for Selecting Scenes and Emotion-Based Descriptions for a Robot’s Diary, IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2023.

  5. Y. Obinata, I. Yanokura, N. Tsukamoto, N. Yamaguchi, S. Kitagawa, K. Okada, M. Inaba: System for Teaching Robot Action Instructions and Responding to Situations Using a Chat Application, The 18th International Conference on Intelligent Autonomous Systems (IAS18), 2023. Finalist of Best Paper Awards

  6. A. Ichikura, K. Kawaharazuka, Y. Obinata, K. Shinjo, K. Okada, M. Inaba: Automatic Diary Generation System Including Information on Joint Experiences between Humans and Robots, The 18th International Conference on Intelligent Autonomous Systems (IAS18), 2023.

  7. N. Kanazawa, K. Kawaharazuka, Y. Obinata, K. Okada, M. Inaba: Recognition of Heat-Induced Food State Changes by Time-Series Use of Vision-Language Model for Cooking Robot, The 18th International Conference on Intelligent Autonomous Systems (IAS18), 2023.

  8. K. Kawaharazuka, Y. Obinata, N. Kanazawa, K. Okada, M. Inaba: VQA-based Robotic State Recognition Optimized with Genetic Algorithm, IEEE International Conference on Robotics and Automation (ICRA), pp.8306–8311, 2023.

Domestic Conference Proceedings (Peer Reviewed) Link to heading

  1. Y. Obinata, K. Kawaharazuka, N. Kanazawa, N. Yamaguchi, N. Tsukamoto, I. Yanokura, S. Kitagawa, K. Okada, M. Inaba: Situation Classification of Daily Environment Based on Long-Term Memory of a Patrol Robot Using a Pre-Trained Vision and Language Model, The 28th Robotics Symposia, 2023.

  2. K. Kawaharazuka, Y. Obinata, N. Kanazawa, K. Okada, M. Inaba: Robotic Discrete and Continuous State Recognition based on Vision-Language Models and Genetic Algorithm, The 28th Robotics Symposia, 2023.

  3. N. Kanazawa, K. Kawaharazuka, Y. Obinata, K. Okada, M. Inaba: Food State Change Recognition from Recipe Descriptions by Time-Series Use of Vision-Language Model for Cooking Support Robot, The 28th Robotics Symposia, 2023.

  4. N. Tsukamoto, N. Yamaguchi, S. Kitagawa, I. Yanokura, Y. Obinata, K. Shinjo, K. Okada, M. Inaba: Use of Robot-robot Verbal Cooperation System for Daily Patrol Tasks, The 28th Robotics Symposia, 2023.

Domestic Conference Proceedings (Not Reviewed) Link to heading

  1. N. Kanzazawa, K. Kawaharazuka, Y. Obinata, K. Okada, M. Inaba: Real-World Task Execution Robot System for Egg Dishes from Recipes Based on Object State-Centric Cooking Behavior Descriptions, The 24th SICE System Integration Division Annual Conference, 2023.

  2. Y. Obinata, N. Kanazawa, K. Kawaharazuka, I. Yanokura, S. Kim, K. Okada, M. Inaba: Task Execution Manager Generation by Large Language Model and its Application to RoboCup JapanOpen @Home League GPSR, The 41st Annual Conference on Robotics Society of Japan, 2023.

  3. N. Kanzazawa, K. Kawaharazuka, Y. Obinata, K. Okada, M. Inaba: 調理ロボットのための基盤モデル利用によるレシピ記述からの卵料理の食材状態変化認識と動作シーケンス生成, The 41st Annual Conference on Robotics Society of Japan, 2023.

  4. Y. Obinata, K. Kawaharazuka, N. Kanazawa, N. Yamaguchi, N. Tsukamoto, I. Yanokura, S. Kitagawa, K. Okada, M. Inaba: Classification of living environment and robot task mapping system using large-scale visual-language model and chat interface, JSME Conference on Robotics and Mechatronics, 2023.

  5. A. Ichikura, K. Kawaharazuka, Y. Obinata, K. Shinjo, K. Okada, M. Inaba: Robot’s Walk Diary-Comparison of readers’ impressions of differences in descriptions in the diary, JSME Conference on Robotics and Mechatronics, 2023.

  6. K. Kawaharazuka, Y. Obinata, N. Kanazawa, K. Okada, M. Inaba: State Recognition based on Large-Scale Vision-Language Model and Evolutionary Computation for Daily Assistive Robots, The 37th Annual Conference of the Japanese Society for Artificial Intelligence, 2023.

  7. N. Kanazawa, K. Kawaharazuka, Y. Obinata, K. Okada, M. Inaba: Cooking Recognition Planning Action Robot System Considering the Change of Food Condition from the Description of Cooking Recipe Using Large-Scale Foundation Models, The 37th Annual Conference of the Japanese Society for Artificial Intelligence, 2023.

  8. N. Tsukamoto, I. Yanokura, Y. Obinata, N. Yamaguchi, S. Kitagawa, K. Shinjo, K. Okada, M. Inaba: Situation notifier: Notifying High-level task description with environment situations, The 23th SICE System Integration Division Annual Conference, 2022.

  9. Y. Obinata, I. Yanokura, S. Kitagawa, K. Okada, M. Inaba: チャットアプリから指示可能なロボットシステム, The 40th Annual Conference on Robotics Society of Japan, 2022.

  10. K. Shinjo, Y. Obinata, K. Kawaharazuka, K. Okada, M. Inaba: 移動ロボットのフロア間移動のためのマルチセンサ・ IoT スイッチによるエレベータ状態認識・操作システム, The 40th Annual Conference on Robotics Society of Japan, 2022.

  11. Y. Obinata, K. Shinjo, I. Yanokura, N. Tsukamoto, N. Yamaguchi, S. Kitagawa, K. Okada, M. Inaba: Status sharing and action instruction system through remote dialogue with an errand robot, JSME Conference on Robotics and Mechatronics, 2022.

  12. N. Tsukamoto, N. Yamaguchi, K. Shinjo, Y. Obinata, S. Kitagawa, K. Okada, M. Inaba: A daily patrol system for daily life support based on the cooperation for multiple robots using verbal communication, JSME Conference on Robotics and Mechatronics, 2022.

  13. K. Shinjo, S. Kitagawa, N. Yamaguchi, Y. Obinata, K. Okada, M. Inaba: Realization of delivery robot system which ask for delivery tasks while standing by, The 22th SICE System Integration Division Annual Conference, 2021. SI2021 Outstanding Presentation Award

  14. K. Shinjo, Y. Obinata, K. Okada, M. Inaba: Realization of walking support for visually impaired in indoor and outdoor environments with 4-legs robot using topological support behavior graph, LIFE2020-2021, 2021.

  15. Y. Obinata, N. Yamaguchi, S. Kitagawa, K. Okada, M. Inaba: A cooperative system for building facility operation and service robot delivery using smart IoT devices, JSME Conference on Robotics and Mechatronics, 2021.

  16. Y. Obinata, N. Yamaguchi, K. Shinjo, S. Kitagawa, K. Okada, M. Inaba: An indoor and outdoor errand-behavior system based on the coordination of multiple robots, JSME Conference on Robotics and Mechatronics, 2021.

  17. K. Shinjo, Y. Obinata, K. Okada, M. Inaba: Realization of walking navigation system for visually impaired with motion guidance system, JSME Conference on Robotics and Mechatronics, 2021.

Open Source Software Works Link to heading

  1. jsk-ros-pkg/jsk_3rdparty

  2. jsk-ros-pkg/jsk_recognition

Media Link to heading

  1. 生活支援ロボット、ＡＩで変革した現在地と展望, 日刊工業新聞, Nov 30 2023.

  2. Attracted to the robots that are actually used – intern interview, Mujin, Oct 11 2021.

  3. ロボットで生活便利に, 信濃毎日新聞, Jan 29 2021.