2024

Robust Skin Color Driven Privacy-Preserving Face Recognition via Function Secret Sharing
Dong Han and Yufan Jiang and Yong Li and Ricardo Mendes and Joachim Denzler.
International Conference on Image Processing (ICIP). Pages 3965-3971. 2024.
[bibtex] [web] [doi:10.1109/ICIP51287.2024.10647630] []

Abstract: In this work, we leverage the pure skin color patch from the face image as the additional information to train an auxiliary skin color feature extractor and face recognition model in parallel to improve performance of state-of-the-art (SOTA) privacy-preserving face recognition (PPFR) systems. Our solution is robust against black-box attacking and well-established generative adversarial network (GAN) based image restoration. We analyze the potential risk in previous work, where the proposed cosine similarity computation might directly leak the protected precomputed embedding stored on the server side. We propose a Function Secret Sharing (FSS) based face embedding comparison protocol without any intermediate result leakage. In addition, we show in experiments that the proposed protocol is more efficient compared to the Secret Sharing (SS) based protocol.
How Interpretable Machine Learning Can Benefit Process Understanding in the Geosciences
Shijie Jiang et alShijie Jiang and Lily-belle Sweet and Georgios Blougouras and Alexander Brenning and Wantong Li and Markus Reichstein and Joachim Denzler and Wei Shangguan and Guo Yu and Feini Huang and Jakob Zscheischler .
Earth's Future. 12 (7): pages e2024EF004540. 2024.
[bibtex] [web] [doi:10.1029/2024EF004540] []

Abstract: Abstract Interpretable Machine Learning (IML) has rapidly advanced in recent years, offering new opportunities to improve our understanding of the complex Earth system. IML goes beyond conventional machine learning by not only making predictions but also seeking to elucidate the reasoning behind those predictions. The combination of predictive power and enhanced transparency makes IML a promising approach for uncovering relationships in data that may be overlooked by traditional analysis. Despite its potential, the broader implications for the field have yet to be fully appreciated. Meanwhile, the rapid proliferation of IML, still in its early stages, has been accompanied by instances of careless application. In response to these challenges, this paper focuses on how IML can effectively and appropriately aid geoscientists in advancing process understanding--areas that are often underexplored in more technical discussions of IML. Specifically, we identify pragmatic application scenarios for IML in typical geoscientific studies, such as quantifying relationships in specific contexts, generating hypotheses about potential mechanisms, and evaluating process-based models. Moreover, we present a general and practical workflow for using IML to address specific research questions. In particular, we identify several critical and common pitfalls in the use of IML that can lead to misleading conclusions, and propose corresponding good practices. Our goal is to facilitate a broader, yet more careful and thoughtful integration of IML into Earth science research, positioning it as a valuable data science tool capable of enhancing our current understanding of the Earth system.

2017

Multi-marker tracking for large-scale X-ray stereo video data
Xiaoyan Jiang and Marcel Simon and Yuan Yang and Joachim Denzler.
Signal Processing: Image Communication. 59 (Supplement C): pages 140 - 149. 2017.
[bibtex] [web]

2016

Fully automated tracking of cardiac structures using radiopaque markers and high-frequency videofluoroscopy in an in vivo ovine model: from three-dimensional marker coordinates to quantitative analyses
Wolfgang Bothe and Harald Schubert and Mahmoud Diab and Gloria Faerber and Christoph Bettag and Xiaoyan Jiang and Martin S. Fischer and Joachim Denzler and Torsten Doenst.
SpringerPlus. 5 (1): 2016.
[bibtex] [pdf] [doi:10.1186/s40064-016-1868-3] []

Abstract: Purpose: Recently, algorithms were developed to track radiopaque markers in the heart fully automated. However, the methodology did not allow to assign the exact anatomical location to each marker. In this case study we describe the steps from the generation of three-dimensional marker coordinates to quantitative data analyses in an in vivo ovine model.Methods: In one adult sheep, twenty silver balls were sutured to the right side of the heart: 10 to the tricuspid annulus, one to the anterior tricuspid leaflet and nine to the epicardial surface of the right ventricle. In addition, 13 cylindrical tantalum markers were implanted into the left ventricle. Data were acquired with a biplanar X-ray acquisition system (Neurostar R, Siemens AG, 500 Hz). Radiopaque marker coordinates were determined fully automated using novel tracking algorithms.Results: The anatomical marker locations were identified using a 3-dimensional model of a single frame containing all tracked markers. First, cylindrical markers were manually separated from spherical markers, thus allowing to distinguish right from left heart markers. The fast moving leaflet marker was identified by using video loops constructed of all recorded frames. Rotation of the 3-dimensional model allowed the identification of the precise anatomical position for each marker. Data sets were then analyzed quantitatively using customized software.Conclusions: The method presented in this case study allowed quantitative data analyses of radiopaque cardiac markers that were tracked fully automated with high temporal resolution. However, marker identification still requires substantial manual work. Future improvements including the implication of marker identification algorithms and data analysis software could allow almost real-time quantitative analyses of distinct cardiac structures with high temporal and spatial resolution.

2014

A Graph-based MAP Solution for Multi-Person Tracking Using Multi-Camera Systems
Xiaoyan Jiang and Marco Körner and Daniel Haase and Joachim Denzler.
International Conference on Computer Vision Theory and Applications (VISAPP). Pages 343-350. 2014.
[bibtex] [web]

2013

Accurate 3D Multi-Marker Tracking in X-ray Cardiac Sequences Using a Two-Stage Graph Modeling Approach
Xiaoyan Jiang and Daniel Haase and Marco Körner and Wolfgang Bothe and Joachim Denzler.
Computer Analysis of Images and Patterns. Pages 117-125. 2013.
[bibtex] [pdf]

2012

Data Association for Multi-Object Tracking-by-Detection in Multi-Camera Networks
Michael Bredereck and Xiaoyan Jiang and Marco Körner and Joachim Denzler.
ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC). 2012.
[bibtex] [pdf]
Multi-Person Tracking-by-Detection based on Calibrated Multi-Camera Systems
Xiaoyan Jiang and Erik Rodner and Joachim Denzler.
International Conference on Computer Vision and Graphics. Pages 743-751. 2012.
[bibtex] [pdf]