Selected Publications


(* equal contribution, † corresponding author.)

Delivering Arbitrary-Modal Semantic Segmentation
J. Zhang*, R. Liu*, S. Hao, K. Yang, S. Reiß, K. Peng, H. Fu, K. Wang, R. Stiefelhagen.
CVPR 2023 Project page Paper Code Dataset

Bending Reality: Distortion-aware Transformers for Adapting to Panoramic Semantic Segmentation
J. Zhang, K. Yang, C. Ma, S. Reiß, K. Peng, R. Stiefelhagen.
CVPR 2022 Paper Code

Delving Deep into One-Shot Skeleton-based Action Recognition with Diverse Occlusions
K. Peng, A. Roitberg, K. Yang, J. Zhang, Rainer Stiefelhagen.
IEEE Transactions on Multimedia (TMM) 2023 Paper Code Dataset

Trans4Map: Revisiting Holistic Bird’s-Eye-View Mapping from Egocentric Images to Allocentric Semantics with Vision Transformers
C. Chen, J. Zhang†, K. Yang, K. Peng, R. Stiefelhagen.
WACV 2023 Paper Code

MatchFormer: Interleaving Attention in Transformers for Feature Matching
Q. Wang*, J. Zhang*, K. Yang, K. Peng, R. Stiefelhagen.
ACCV 2023 Paper Code

TransDARC: Transformer-based Driver Activity Recognition with Latent Space Feature Calibration
K. Peng, A. Roitberg, K. Yang, J. Zhang, R. Stiefelhagen.
IROS 2022 Paper Code

Indoor Navigation Assistance for Visually Impaired People via Dynamic SLAM and Panoptic Segmentation with an RGB-D Sensor
W. Ou, J. Zhang, K. Peng, K. Yang, G. Jaworek, K. Müller, R. Stiefelhagen.
ICCHP-AAATE 2022 Paper Video

Trans4Trans: Efficient Transformer for Transparent Object and Semantic Scene Segmentation in Real-World Navigation Assistance
J. Zhang, K. Yang, A. Constantinescu, K. Peng, K. Müller, R. Stiefelhagen.
IEEE Trans. on Intelligent Transportation Systems (T-ITS) 2022 Paper Code

Exploring Event-Driven Dynamic Context for Accident Scene Segmentation
J. Zhang, K. Yang, R. Stiefelhagen.
IEEE Trans. on Intelligent Transportation Systems (T-ITS) 2021 Paper Code Dataset

Transfer beyond the Field of View: Dense Panoramic Semantic Segmentation via Unsupervised Domain Adaptation
J. Zhang, C. Ma, K. Yang, A. Roitberg, K. Peng, R. Stiefelhagen.
IEEE Trans. on Intelligent Transportation Systems (T-ITS) 2021 Paper Code Dataset

MASS: Multi-Attentional Semantic Segmentation of LiDAR Data for Dense Top-View Understanding
K. Peng, J. Fei, K. Yang, A. Roitberg, J. Zhang, F. Bieder, P. Heidenreich, C. Stiller, R. Stiefelhagen.
IEEE Trans. on Intelligent Transportation Systems (T-ITS) 2021 Paper Code

Flying Guide Dog: Walkable Path Discovery for the Visually Impaired Utilizing Drones and Transformer-based Semantic Segmentation
H. Tan, C. Chen, X. Luo, J. Zhang, C. Seibold, K. Yang, R. Stiefelhagen.
IEEE ROBIO 2021 Paper Code Video

HIDA: Towards Holistic Indoor Understanding for the Visually Impaired via Semantic Instance Segmentation with a Wearable Solid-State LiDAR Sensor
H. Liu, R. Liu, K. Yang, J. Zhang, K. Peng, R. Stiefelhagen
ICCV Workshop on Assistive Computer Vision and Robotics (ACVR) 2021 Paper

Trans4Trans: Efficient Transformer for Transparent Object Segmentation to Help Visually Impaired People Navigate in the Real World
J. Zhang, K. Yang, A. Constantinescu, K. Peng, K. Müller, R. Stiefelhagen
ICCV Workshop on Assistive Computer Vision and Robotics (ACVR) 2021 Paper Code

DensePASS: Dense Panoramic Semantic Segmentation via Unsupervised Domain Adaptation with Attention-Augmented Context Exchange
C. Ma, J. Zhang, K. Yang, A. Roitberg, R. Stiefelhagen
IEEE ITSC 2021 Paper Code Dataset

Pose2Drone: A Skeleton-Pose-based Framework for Human-Drone Interaction
Z. Marinov, S. Vasileva, Q. Wang, C. Seibold, J. Zhang, R. Stiefelhagen
IEEE EUSIPCO 2021 Paper Code

Panoptic Lintention Network: Towards Efficient Navigational Perception for the Visually Impaired
Wei Mao*, J. Zhang*, K. Yang, R. Stiefelhagen
IEEE RCAR 2021 Paper Code

Perception Framework through Real-Time Semantic Segmentation and Scene Recognition on a Wearable System for the Visually Impaired
Y. Zhang, H. Chen, K. Yang, J. Zhang, R. Stiefelhagen
IEEE RCAR 2021 Paper

Capturing Omni-Range Context for Omnidirectional Segmentation
K. Yang, J. Zhang, S. Reiß, X. Hu, R. Stiefelhagen
CVPR 2021 Paper Code

ISSAFE: Improving semantic segmentation in accidents by fusing event-based data
J. Zhang, K. Yang, R. Stiefelhagen
IROS 2021 Paper Code Dataset

Teaching


Teaching Assistant, Deep Learning for Computer Vision II: Advanced Topics, WS 21/22, WS 22/23

Teaching Assistant, Practical Course Computer Vision for Human-Computer Interaction, WS 20/21, SS 2021, SS 2022

  • Flying Guide Dog: Walkable Path Discovery for the Visually Impaired Utilizing Drones and Transformer-based Semantic Segmentation, Paper Code Video
  • Pose2Drone: A Skeleton-Pose-based Framework for Human-Drone Interaction, Paper Code

Teaching Assistant, Seminar Computer Vision for Human-Computer Interaction, WS 20/21, WS 21/22

Supervised Theses

  • Zhifeng Teng. Master Thesis, 360BEV: Panoramic Semantic Mapping for Indoor Bird's-Eye View, Apr. 2023. Paper Code Page
  • Chang Chen. Master Thesis, Transformer-based Mapping from Egocentric Images to Top-view Semantics for Scene Understanding, Sep. 2022. Paper Code Video
  • Qing Wang. Master Thesis, MatchFormer: Interleaving Attention in Transformers for Feature Matching, Mar. 2022. Paper Code
  • Chaoxiang Ma. Master Thesis (co-supervision), Unsupervised Domain Adaptation for Panoramic Semantic Segmentation, Jul. 2021. Paper Code

Awards


  • The best practical course in the summer semester 2021.
  • Services


    Contact