We conduct theoretical and applied research for wearable computing systems and machine learning algorithms for engineering applications at the intersection of sports and health care. Our motivation is generating a positive impact on human wellbeing, be it through increasing performance, maintaining health, improving rehabilitation, or monitoring disease.
- Several gait analysis projects are concerned with determining disease progression
- Disease classification and fall-risk using wearable IMU-based sensors
- Projects in the biomedical analysis field extract meaning from human body signals like the heart
Empatho-Kinaesthetic Sensor Technology
(Third Party Funds Group – Overall project)Term: 1. July 2021 - 30. June 2025
Funding source: DFG / Sonderforschungsbereich / Transregio (SFB / TRR)
URL: https://empkins.de/The proposed CRC “Empathokinaesthetic Sensor Technology” (EmpkinS) will investigate novel radar, wireless, depth camera, and photonics based sensor technologies as well as body function models and algorithms. The primary objective of EmpkinS is to capture human motion parameters remotely with wave-based sensors to enable the identification and analysis of physiological and behavioural states and body functions. To this end, EmpkinS aims to develop sensor technologies and facilitate the collection of motion data for the human body. Based on this data of hitherto unknown quantity and quality, EmpkinS will lead to unprecedented new insights regarding biomechanical, medical, and psychophysiological body function models and mechanisms of action as well as their interdependencies.The main focus of EmpkinS is on capturing human motion parameters at the macroscopic level (the human body or segments thereof and the cardiopulmonary function) and at the microscopic level (facial expressions and fasciculations). The acquired data are captured remotely in a minimally disturbing and non-invasive manner and with very high resolution. The physiological and behavioural states underlying the motion pattern are then reconstructed algorithmically from this data, using biomechanical, neuromotor, and psychomotor body function models. The sensors, body function models, and the inversion of mechanisms of action establish a link between the internal biomedical body layers and the outer biomedical technology layers. Research into this link is highly innovative, extraordinarily complex, and many of its facets have not been investigated so far.To address the numerous and multifaceted research challenges, the EmpkinS CRC is designed as an interdisciplinary research programme. The research programme is coherently aligned along the sensor chain from the primary sensor technology (Research Area A) over signal and data processing (Research Areas B and C) and the associated modelling of the internal body functions and processes (Research Areas C and D) to the psychological and medical interpretation of the sensor data (Research Area D). Ethics research (Research Area E) is an integral part of the research programme to ensure responsible research and ethical use of EmpkinS technology.The proposed twelve-year EmpkinS research programme will develop novel methodologies and technologies that will generate cutting-edge knowledge to link biomedical processes inside the human body with the information captured outside the body by wireless and microwave sensor technology. With this quantum leap in medical technology, EmpkinS will pave the way for completely new "digital", patient-centred diagnosis and therapeutic options in medicine and psychology.Medical technology is a research focus with flagship character in the greater Erlangen-Nürnberg area. This outstanding background along with the extensive preparatory work of the involved researchers form the basis and backbone of EmpkinS.
Holistic customer-oriented service optimization for fleet availability
(Third Party Funds Single)Term: 1. June 2021 - 31. May 2024
Funding source: Industrie, andere Förderorganisation
Das Okulomotor Test System in der Virtuellen Realität -- Telemedizinische Detektion von Gehirnerschütterungen in VR
(Third Party Funds Single)Term: 1. April 2021 - 31. December 2023
Funding source: Bayerisches Staatsministerium für Wirtschaft, Landesentwicklung und Energie (StMWi) (seit 2018)
The aim of the project is to develop a rapid automated diagnosis (using artificial intelligence) of a fusion disorder in cases of e.g. concussion by measuring the oculomotor function (eye-tracking) for three-dimensional stimuli.
Personalization of muscoskeletal models through AI (PoMMAI)
(Third Party Funds Single)Term: 1. January 2021 - 31. December 2021
Funding source: Fraunhofer-GesellschaftHuman movement is a complex process that depends on many factors such as body constitution, health condition, but also external factors. Joint angles, joint moments and muscle forces are variables quantifying the movement to give valuable insights about these factors. Simulation of musculoskeletal models can be used to perform detailed movement analysis to obtain these variables. The application of simulation is two-fold: Reconstruction of measured motion and prediction of new motion. Motion reconstruction can give valuable insights for example for sports analysis in marathon runners or medical gait assessment of Parkinson’s patients. Simulation can predict changes in human motion in response to environmental changes. This is beneficial to, for instance, support virtual product design of footwear or below-knee prostheses.
However, for accurate and detailed simulations, the personalization of musculoskeletal models is crucial. Precise scaling of segment and muscle parameters can be achieved using magnetic resonance imaging (MRI) which requires time and cost consuming measurements additionally to the movement acquisition and expert knowledge. State-of-the-art methods relying only on movement recordings scale segment parameters and muscle attachment points. But they do not scale muscle parameters like maximum isometric forces.
We will combine optimal control simulation with the application of advanced machine learning methods to personalize segment as well as muscle parameters based on marker and ground reaction force. The goal is to make personalized simulations feasible in healthcare, sports science, and industrial practice. To this end, we aim at developing an approach with three key improvements: First, it can be applied without additional and time-consuming measurements using expensive modalities; Secondly, it can be used without expert knowledge but operates automatically; Thirdly, it is feasible with limited computational re-sources, i.e., computational power and time.
Mobility in atypical parkinsonism: a randomized trial of physiotherapy
(Third Party Funds Single)Term: since 1. November 2020
Funding source: DFG-Einzelförderung / Sachbeihilfe (EIN-SBH)
URL: https://gepris.dfg.de/gepris/projekt/438496663?context=projekt&task=showDetail&id=438496663&Mobility in atypical parkinsonism: effects of physiotherapyWider research context/theoretical frameworkParkinsonian gait disorders and reduced mobility are pivotal symptoms of Parkinson´s disease (PD) and of atypical parkinsonian disorders (APD), including Multiple System Atrophy (MSA) and Progressive Supranuclear Palsy (PSP). Their onset signs the transition towards disability and increased mortality. While several randomized controlled trials investigated efficacy of exercise-based interventions for PD, for APD this area remains thus far widely unexplored. Results of our pilot study investigating efficacy of a physiotherapy program in APD showed improvements of gait parameters as reflected by instrumented gait analysis in lab. Current advances in development of wearable sensor-based technologies now reach clinical applicability also under remote unsupervised conditions (home-monitoring).Hypotheses/research questions /objectivesIn this randomized controlled trial we expect to detect greater improvement of gait performance and mobility in PD and APD patients by gait-focused versus standard physiotherapy and home-training. In particular, we aim to investigate whether:1) Gait-focused versus standard physiotherapy and home-based exercise improve lab and home-based gait parameters, physical activity and clinical rating scales in PD and APD patients.2) PD, MSA and PSP patients differ in their response to gait-focused versus standard physiotherapy and home-based exercise as detected by lab and home-based gait parameters, physical activity and clinical rating scales.Approach/methodsThe trial will be multicentric, randomized, double-blinded and controlled. The intervention to test consists of an inpatient gait-focused physiotherapy followed by an unsupervised gait-focused home-based training program. The control group receives a standard physiotherapy/home-based training, which addresses parkinsonian features without focusing on gait. Lab gait analysis is performed by shoe-insole-sensors to retrieve objective gait parameters (e.g. gait velocity, stride length etc.). Home-monitoring is performed using similar shoe-sensors and one sensor at low-back position allowing for the analysis of routine activities such as sitting, lying, standing and walking.Level of originality/innovationImproving gait disorders in PD and APD patients by gait focused PT and home-based exercise increases patients´ independence and forestalls the risk of falls representing a great achievement for patients. This study lays the foundation for the development of a telemedical approach by which patient groups can be included in clinical trials remote from expert centers.Primary researchers involvedGregor Wenning (lead-PI), Cecilia Raccagni (study coordinator), Jochen Klucken (Erlangen-PI), David Benninger (Lausanne-PI) and Bas Bloem (Nijmegen-PI).Björn Eskofier (Erlangen) and Kamiar Aminian (Lausanne) will be responsible for the technical part concerning the sensor system.
Integratives Konzept zur personalisierten Präzisionsmedizin in Prävention, Früh-Erkennung, Therapie undRückfallvermeidung am Beispiel von Brustkrebs - DigiOnko
(Third Party Funds Single)Term: 1. October 2020 - 30. September 2024
Funding source: Bayerisches Staatsministerium für Gesundheit und Pflege, StMGP (seit 2018)
Integratives Konzept zur personalisierten Präzisionsmedizin in Prävention, Früh-Erkennung, Therapie und Rückfallvermeidung am Beispiel von Brustkrebs
(Third Party Funds Single)Term: 1. October 2020 - 30. September 2024
Funding source: Bayerisches Staatsministerium für Gesundheit und Pflege, StMGP (seit 2018)
Breast cancer is one of the leading causes of death in the field of oncology in Germany. For the successful care and treatment of patients with breast cancer, a high level of information for those affected is essential in order to achieve a high level of compliance with the established structures and therapies. On the one hand, the digitalisation of medicine offers the opportunity to develop new technologies that increase the efficiency of medical care. On the other hand, it can also strengthen patient compliance by improving information and patient integration through electronic health applications. Thus, a reduction in mortality and an improvement in quality of life can be achieved. Within the framework of this project, digital health programmes are going to be created that support and complement health care. The project aims to provide better and faster access to new diagnostic and therapeutic procedures in mainstream oncology care, to implement eHealth models for more efficient and effective cancer care, and to improve capacity for patients in oncologcal therapy in times of crisis (such as the SARS-CoV-2 pandemic). The Chair of Health Management is conducting the health economic evaluation and analysing the extent to which digitalisation can contribute to a reduction in the costs of treatment and care as well as to an improvement in the quality of life of breast cancer patients.
Activity Recognition using IMU Sensors integrated in Hearing Aids
(Third Party Funds Single)Term: 1. October 2020 - 31. March 2024
Funding source: Industrie
The hearing aid of the future will be more than just an amplifying device. It may be used as fitness tracker to capture the user’s movements and activity level. Furthermore, it may be used as home monitoring device assessing the user’s vital parameters, tracking the user’s activity status or detecting falls. Hearing aids are becoming more complex and most modern hearing aids are already equipped with additional sensors such as inertial sensors. Acceleration signals are analyzed with signal processing algorithms to enhance speech intelligibility and audio quality. Furthermore, inertial sensors may be used to analyze the user’s movements and physical activity. Hearing aid amplification settings may be adapted according to the current activity. Moreover, given the user's explicit consent, activity recognition enables a long-term tracking of the user’s daily activity status.
The objective of this project is to investigate automatic activity recognition based on inertial sensor data. Therefore, data of different activities will be recorded using the IMU sensor integrated in the hearing aids. The hearing aids are provided by the cooperation partner WS Audiology. Machine learning algorithms will be developed to automatically classify different activity patterns.
Federated Machine Learning for Patient-Centered Electronic Health Records
(Third Party Funds Single)Term: 1. April 2020 - 30. September 2022
Funding source: Deutscher Akademischer Austauschdienst (DAAD)
Electronic health records (EHR) are commonly institution-specific, provided by hospitals, insurance companies, or other institutions to fulfill their own objectives, thus, causing stored health information to be isolated, fragmented and duplicated across providers. Consequently, patients may lack complete access to their medical histories. As a solution, countries such as Denmark and Israel have long adopted nationwide EHR for their health care systemsa, in which the health information is well managed and digitally connected to avoid duplicate records and improve the quality and co-effectiveness of medical care as well as patient safety. In Germany, the “Appointment Service and Supply Act” adopted on 14th March 2019, requires the German statutory health insurance to provide EHR for all insured persons from 1st January 2021 onwardsb. As specified by German Health Care Information Technology Infrastructure in accordance with section 291a SGB V, the new EHR should store complete medical histories of patients such as previous diagnoses, therapeutic decisions, treatment reports and self-measurement values. Among other benefits, patients should have power to select freely between providers, hold data sovereignty for their EHR, and withdraw access rights at any time.
In line with those guidelines, OnePatientc is a patient-centered EHR system that stores data locally under the sovereignty of individual device owners, thereby enabling patients to take control of their health information, provide offline access to medical data, ensure privacy management and to avoid a single point of failure. The OnePatient EHR system can be provisioned on any of the patients’ devices; therefore, patients technically own their medical data while the device and software manage it. On the one hand, these developments simplify the technical and organizational challenges to implement data regulations such as the General Data Protection Regulation (GDPR) of the European Union. On the other hand, the data will not only be in isolated, heterogeneous and distributed environments but also pose a new challenge to the conventional data transaction procedures employed in machine learning (ML) today . The traditional procedures for acquiring big data in ML involve several parties from collecting the data, transferring it to a central data repository and fusing it to build a model, whereas the data owners may be unclear about these procedures and the model future use cases, for that reason, may violate laws such as GDPR.
Therefore, to address these challenges, federated learning (FL) approaches can be leveraged to build ML models that can be sent to train locally–where the data is located. In this manner, only the model updates that contain anonymous results which cannot be reverse-engineered are returned to the central data repository. Leveraging FL and the account of the FL existing studies [1; 2; 3], although not focusing on the emerging EHR systems’ architecture like OnePatient, we aim to attain four objectives. The first is to investigate and design novel FL frameworks that enable local systems to collaboratively train a ML model that patients can benefit from without divulging their medical information to a central entity; moreover, medical practitioners will be able to access the training process of the FL frameworks to adjust the diagnostic criteria of the model, and therefore increase trust and accuracy of the model outcome. Secondly, we aim to investigate and compare the accuracy and performance of the model trained in a centralized way and the FL frameworks that will be proposed. Thirdly, to protect the data during training from potentially malicious models and participants, we aim to use countermeasures such as differential privacy and multi-party computation to ensure privacy guarantees. Finally, for proof of concept, we aim to demonstrate the effectiveness of FL frameworks using existing databases and suitable ML tasks with the data.
1. Brisimi, T. S., Chen, R., Mela, T., Olshevsky, A., Paschalidis, I. C., & Shi, W. Federated learning of predictive models from federated electronic health records. Int.J.Med.Inf. 2018; 112: 59-67.
2. Roy, A. G., Siddiqui, S., Pölsterl, S., Navab, N., & Wachinger, C. Braintorrent: A peer-to-peer environment for decentralized federated learning. arXiv preprint arXiv:1905.06731 2019;
3. Xu, J., & Wang, F. Federated learning for healthcare informatics. arXiv preprint arXiv:1911.06270 2019;
4. Yang, Q., Liu, Y., Chen, T., & Tong, Y. Federated machine learning: Concept and applications. ACM Transactions on Intelligent Systems and Technology (TIST) 2019; 10: 1-19.
SMART Start: Smarte Sensorik in der Schwangerschaft - Ein integratives Konzept zur digitalen, präventiven Versorgung schwangerer Frauen
(Third Party Funds Single)Term: 1. March 2020 - 31. August 2022
Funding source: Bundesministerium für Gesundheit (BMG)
Heisenberg-Förderung / Verlängerung - 2. Phase
(Third Party Funds Single)Term: 1. March 2020 - 28. February 2022
Funding source: DFG-Einzelförderung / Sachbeihilfe (EIN-SBH)
Biomarkers for immunotherapy in multiple sclerosis patients
(Third Party Funds Single)Term: 1. October 2019 - 30. September 2023
Funding source: andere Förderorganisation
Multiple sclerosis (MS) is a chronic inflammatory disease of the central nervous system (CNS) that is most common in young adult. The disease is due to an autoimmune reaction in which immune cells, which attack foreign pathogens, damage the body's own tissue. This project aims at identifying biomarkers in the form of gait characteristics in patients with multiple sclerosis which can be used both for the assessment of the current state of the disease and for the prediction of the further course of the disease in the form of relapses.
Development of neural networks and machine learning algorithms for online handwriting recognition
(Third Party Funds Group – Sub project)Overall project: Development of neural networks and machine learning algorithms for online handwriting recognition
Term: 2. September 2019 - 30. April 2022
Funding source: Bayerisches Staatsministerium für Wirtschaft und Medien, Energie und Technologie (StMWIVT) (ab 10/2013), Bayerisches Staatsministerium für Wirtschaft, Landesentwicklung und Energie (StMWi) (seit 2018)
The aim of this project is the development of a toolkit that is able to identify handwriting in real time. Using Stabilo Digipen with internal sensors that provides pen motion data in real time, machine learning algorithms are applied to track the pen movement on regular paper and digitize written sentences in real time.
Entwicklung intelligenter neuronaler Netze zur Schrifterkennung
(Third Party Funds Group – Sub project)Overall project: Entwicklung intelligenter neuronaler Netze zur Schrifterkennung
Term: 1. May 2019 - 30. April 2022
Funding source: Bayerisches Staatsministerium für Wirtschaft und Medien, Energie und Technologie (StMWIVT) (ab 10/2013)
Connecting digital mobility assessment to clinical outcomes for regulatory and clinical endorsement
(Third Party Funds Single)Term: 1. April 2019 - 31. March 2024
Funding source: Europäische Union (EU)
Optimal treatment of the impaired mobility resulting from ageing and chronic disease is one of the 21st century's greatest challenges facing patients, society, governments, healthcare services, and science. New interventions are a key focus. However, to accelerate their development, we need better ways to detect and measure mobility loss. Digital technology, including body worn sensors, has the potential to revolutionise mobility assessment. The overarching objectives of MOBILISE-D are threefold: to deliver a valid solution (consisting of sensor, algorithms, data analytics, outcomes) for real-world digital mobility assessment; to validate digital outcomes in predicting clinical outcome in chronic obstructive pulmonary disease, Parkinson’s disease, multiple sclerosis, proximal femoral fracture recovery and congestive heart failure; and, to obtain key regulatory and health stakeholder approval for digital mobility assessment. The objectives address the call directly by linking digital assessment of mobility to clinical endpoints to support regulatory acceptance and clinical practice. MOBILISE-D consists of 35 partners from 13 countries with long, successful collaboration, combining the requisite expertise to address the technical and clinical challenges. To achieve the objectives, partners will jointly develop and implement a digital mobility assessment solution to demonstrate that real-world digital mobility outcomes can successfully predict relevant clinical outcomes and provide a better, safer and quicker way to arrive at the development of innovative medicines. MOBILISE-D's results will directly facilitate drug development, and establish the roadmap for clinical implementation of new, complementary tools to identify, stratify and monitor disability, so enabling widespread, cost-effective access to optimal clinical mobility management through personalised healthcare.
Digital Twin – Novel data fusion algorithms and immersive interaction concepts for the holistic description and evaluation of athletes through self-learning systems
(Third Party Funds Single)Overall project: Digital Twin - holistische Beschreibung und Bewertung von Athleten
Term: 1. December 2018 - 31. December 2021
Funding source: Bayerisches Staatsministerium für Wirtschaft und Medien, Energie und Technologie (StMWIVT) (ab 10/2013)
The aim of the project is to design and implement a system that is able to holistically assess athletes. Therefore, novel individualised digital services, products and tools to enable a holistic mental and physiological performance optimisation will be developed. This is an improvement compared to current state of the art methods, since these approaches only consider physiological data for optimising performance.
- Abdullahi, I., Dehling, T., Kluge, F., Eskofier, B., & Sunyaev, A. (2021). Online at Will: A Novel Protocol for Mutual Authentication in Peer-to-Peer Networks for Patient-Centered Health Care Information Systems. In 54th Hawaii International Conference on Systems Sciences (HICSS-54). Kauai, Hawaii, USA, US: ScholarSpace.
- Dumbach, P., Liu, R., Jalowski, M., & Eskofier, B. (2021). The Adoption Of Artificial Intelligence In SMEs - A Cross-National Comparison In German And Chinese Healthcare. In BIR 2021 Workshops and Doctoral Consortium co-located with 20th International Conference on Perspectives in Business Information Research (BIR 2021). Vienna, Austria (fully-virtual conference), AT: CEUR Workshop Proceedings, Sun SITE Central Europe (CEUR), RWTH Aachen University.
- Dörflinger, L., Nissen, M., Jäger, K., Wirth, M., Titzmann, A., Pontones, C.,... Eskofier, B. (2021). Digital Maternity Records: Motivation, Acceptance, Requirements, Usability and Prototype Evaluation of an Interface for Physicians and Midwives. In Mensch und Computer 2021. Ingolstadt, DE.
- Hagengruber, A., Leipscher, U., Eskofier, B., & Vogel, J. (2021). Electromyography for Teleoperated Tasks in Weightlessness. IEEE Transactions on Human-Machine Systems. https://dx.doi.org/10.1109/THMS.2020.3047975
- Kluge, F., Del Din, S., Cereatti, A., Gaßner, H., Hansen, C., Helbostad, J.L.,... Mazza, C. (2021). Consensus based framework for digital mobility monitoring. PLoS ONE, 16(8). https://dx.doi.org/10.1371/journal.pone.0256541
- Maier, J., Maier, A., Eskofier, B., Fahrig, R., & Choi, J.-H. (2021). 3D Non-Rigid Alignment of Low-Dose Scans Allows to Correct for Saturation in Lower Extremity Cone-Beam CT. IEEE Access, 9, 71821-71831. https://dx.doi.org/10.1109/ACCESS.2021.3079368
- Maier, J., Nitschke, M., Choi, J.H., Gold, G., Fahrig, R., Eskofier, B., & Maier, A. (2021). Inertial Measurements for Motion Compensation in Weight-bearing Cone-beam CT of the Knee. In Christoph Palm, Heinz Handels, Klaus Maier-Hein, Thomas M. Deserno, Andreas Maier, Thomas Tolxdorff (Eds.), Informatik aktuell (pp. 336-). Regensburg, DE: Springer Science and Business Media Deutschland GmbH.
- Martindale, C., Christlein, V., Klumpp, P., & Eskofier, B. (2021). Wearables-based multi-task gait and activity segmentation using recurrent neural networks. Neurocomputing, 432, 250-261. https://dx.doi.org/10.1016/j.neucom.2020.08.079
- Nann, M., Haslacher, D., Colucci, A., Eskofier, B., Von Tscharner, V., & Soekadar, S.R. (2021). Heart rate variability predicts decline in sensorimotor rhythm control. Journal of Neural Engineering, 18(4). https://dx.doi.org/10.1088/1741-2552/ac1177
- Nitschke, M., Dorschky, E., Eskofier, B., Koelewijn, A., & van den Bogert, A.J. (2021, July). Trajectory Optimization of a 3D Musculoskeletal Model with Inertial Sensors. Paper presentation at XXVIII Congress of the International Society of Biomechanics (ISB), Online.
- Pasluosta, C.F., Popovic, M.R., Eskofier, B., & Stieglitz, T. (2021). Editorial: Wearable and Implantable Technologies in the Rehabilitation of Patients With Sensory Impairments. Frontiers in Neuroscience, 15. https://dx.doi.org/10.3389/fnins.2021.740263
- Richer, R., Küderle, A., Dörr, J., Rohleder, N., & Eskofier, B. (2021). Assessing the Influence of the Inner Clock on the Cortisol Awakening Response and Pre-Awakening Movement. In IEEE (Eds.), 2021 IEEE EMBS International Conference on Biomedical and Health Informatics (BHI) (pp. 1-4). Athens, GR.
- Richer, R., Küderle, A., Ullrich, M., Rohleder, N., & Eskofier, B. (2021). BioPsyKit: A Python package for the analysis of biopsychological data. Journal of Open Source Software, 6, 3702. https://dx.doi.org/10.21105/joss.03702
- Roth, N., Küderle, A., Ullrich, M., Gladow, T., Marxreiter, F., Klucken, J.,... Kluge, F. (2021). Hidden Markov Model based stride segmentation on unsupervised free-living gait data in Parkinson’s disease patients. Journal of neuroEngineering and rehabilitation, 18(1). https://dx.doi.org/10.1186/s12984-021-00883-7
- Schleicher, R., Nitschke, M., Martschinke, J., Stamminger, M., Eskofier, B., Klucken, J., & Koelewijn, A. (2021). BASH: Biomechanical Animated Skinned Human for Visualization of Kinematics and Muscle Activity. In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP (pp. 25-36). Online.
- Schwinn, L., Nguyen, A., Raab, R., Zanca, D., Eskofier, B., Tenbrinck, D., & Burger, M. (2021). Dynamically Sampled Nonlocal Gradients for Stronger Adversarial Attacks. In Proceedings of the International Joint Conference on Neural Networks (IJCNN). Online.
- Schwinn, L., Nguyen, A.T., Raab, R., Bungert, L., Tenbrinck, D., Zanca, D.,... Eskofier, B. (2021). Identifying untrustworthy predictions in neural networks by geometric gradient analysis. In Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI). Online.
- Schwinn, L., Raab, R., Nguyen, A., Zanca, D., & Eskofier, B. (2021). Exploring Misclassifications of Robust Neural Networks to Enhance Adversarial Attacks.
- Stöve, M., Schuldhaus, D., Gamp, A., Zwick, C., & Eskofier, B. (2021). From the Laboratory to the Field: IMU-Based Shot and Pass Detection in Football Training and Game Scenarios Using Deep Learning. Sensors, 21, 3071. https://dx.doi.org/10.3390/s21093071
- Timotius, I., Bieler, L., Couillard-Despres, S., Sandner, B., Garcia-Ovejero, D., Labombarda, F.,... Puttagunta, R. (2021). Combination of defined catwalk gait parameters for predictive locomotion recovery in experimental spinal cord injury rat models. eNeuro, 8(2), 1-14. https://dx.doi.org/10.1523/ENEURO.0497-20.2021
- Wehbi, M., Hamann, T., Barth, J., Kaempf, P., Zanca, D., & Eskofier, B. (2021). Towards an IMU-based Pen Online Handwriting Recognizer. In Proceedings of the International Conference on Document Analysis and Recognition ICDAR 2021 (pp. 289-303). Lausanne, CH: Springer Link.
- Wirth, M., Gradl, S., Prosinger, G., Kluge, F., Roth, D., & Eskofier, B. (2021). The impact of avatar appearance, perspective and context on gait variability and user experience in virtual reality. In Proceedings - 2021 IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2021 (pp. 326-335). Virtual, Lisboa, PRT: Institute of Electrical and Electronics Engineers Inc..
- Wirth, M., Kohl, S., Gradl, S., Farlock, R., Roth, D., & Eskofier, B. (2021). Assessing visual exploratory activity of athletes in virtual reality using head motion characteristics. Sensors, 21(11). https://dx.doi.org/10.3390/s21113728
- Zrenner, M., Heyde, C., Duemler, B., Dykman, S., Roecker, K., & Eskofier, B. (2021). Retrospective Analysis of Training and Its Response in Marathon Finishers Based on Fitness App Data. Frontiers in Physiology, 12. https://dx.doi.org/10.3389/fphys.2021.669884
- da Silva, D.B., Schmidt, D., da Costa, C.A., da Rosa Righi, R., & Eskofier, B. (2021). DeepSigns: A predictive model based on Deep Learning for the early detection of patient health deterioration. Expert Systems With Applications, 165. https://dx.doi.org/10.1016/j.eswa.2020.113905
- Auferoth, F., Eskofier, B., Gerber, L., Grimm, V., Richer, R., & Rohleder, N. (2020). Tracking and Teamwork Performance.
- Bazo, R., Reis, E., Adams Seewald, L., Facco Rodrigues, V., Andre da Costa, C., Gonzaga, L.,... Horz, T. (2020). Baptizo: a sensor fusion based model for tracking the identity of human poses. Information Fusion. https://dx.doi.org/10.1016/j.inffus.2020.03.011
- Ceron, J.D., Kluge, F., Küderle, A., Eskofier, B., & López, D.M. (2020). Simultaneous indoor pedestrian localization and house mapping based on inertial measurement unit and bluetooth low-energy beacon data. Sensors, 20(17), 1-21. https://dx.doi.org/10.3390/s20174742
- Ceron, J.D., Martindale, C., López, D.M., Kluge, F., & Eskofier, B. (2020). Indoor Trajectory Reconstruction of Walking, Jogging, and Running Activities Based on a Foot-Mounted Inertial Pedestrian Dead-Reckoning System. Sensors, 20(3), 651. https://dx.doi.org/10.3390/s20030651
- Dorschky, E., Nitschke, M., Martindale, C., van den Bogert, A.J., Koelewijn, A., & Eskofier, B. (2020). CNN-Based Estimation of Sagittal Plane Walking and Running Biomechanics From Measured and Simulated Inertial Sensor Data. Frontiers in Bioengineering and Biotechnology, 8(604), 1-14. https://dx.doi.org/10.3389/fbioe.2020.00604
- Dumbach, P., Aly, A., Zrenner, M., & Eskofier, B. (2020). Exploration of Process Mining Opportunities In Educational Software Engineering - The GitLab Analyser. In Anna N. Rafferty, Jacob Whitehill, Cristobal Romero, Violetta Cavalli-Sforza (Eds.), Proceedings of the 13th International Conference on Educational Data Mining (pp. 601 - 604). Ifrane, Morocco (Fully Virtual Conference), MA.
- Fischer, S., Ullrich, M., Küderle, A., Gaßner, H., Klucken, J., Eskofier, B., & Kluge, F. (2020). Automatic clinical gait test detection from inertial sensor data. In Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) (pp. 789 - 792). Montreal, CA.
- Flachenecker, F., Gaßner, H., Hannik, J., Lee, D.-H., Flachenecker, P., Winkler, J.,... Klucken, J. (2020). Objective sensor-based gait measures reflect motor impairment in multiple sclerosis patients: Reliability and clinical validation of a wearable sensor device. Multiple Sclerosis and Related Disorders, 39. https://dx.doi.org/10.1016/j.msard.2019.101903
- Gaßner, H., Jensen, D., Marxreiter, F., Kletsch, A., Bohlen, S., Schubert, R.,... Kohl, Z. (2020). Correction to: Gait variability as digital biomarker of disease severity in Huntington’s disease (Journal of Neurology, (2020), 10.1007/s00415-020-09725-3). Journal of Neurology. https://dx.doi.org/10.1007/s00415-020-09789-1
- Gaßner, H., Jensen, D., Marxreiter, F., Kletsch, A., Bohlen, S., Schubert, R.,... Kohl, Z. (2020). Gait variability as digital biomarker of disease severity in Huntington’s disease. Journal of Neurology, 267(6), 1594-1601. https://dx.doi.org/10.1007/s00415-020-09725-3
- Gaßner, H., Sanders, P., Dietrich, A., Marxreiter, F., Eskofier, B., Winkler, J., & Klucken, J. (2020). Clinical Relevance of Standardized Mobile Gait Tests. Reliability Analysis Between Gait Recordings at Hospital and Home in Parkinson's Disease: A Pilot Study. Journal of Parkinson's Disease, 10(4), 1763-1773. https://dx.doi.org/10.3233/JPD-202129
- Ibrahim, A., Küderle, A., Gaßner, H., Klucken, J., Eskofier, B., & Kluge, F. (2020). Inertial sensor-based gait parameters reflect patient-reported fatigue in multiple sclerosis. Journal of neuroEngineering and rehabilitation, 17(1). https://dx.doi.org/10.1186/s12984-020-00798-9
- Ivanović, M.D., Hannink, J., Ring, M., Baronio, F., Vukčević, V., Hadžievski, L., & Eskofier, B. (2020). Predicting defibrillation success in out-of-hospital cardiac arrested patients: Moving beyond feature design. Artificial Intelligence in Medicine, 110. https://dx.doi.org/10.1016/j.artmed.2020.101963
- Kaieski, N., da Costa, C.A., da Rosa Righi, R., Lora, P.S., & Eskofier, B. (2020). Application of artificial intelligence methods in vital signs analysis of hospitalized patients: A systematic literature review. Applied Soft Computing, 96. https://dx.doi.org/10.1016/j.asoc.2020.106612
- Köferl, F., Link, J., & Eskofier, B. (2020). Application of SORT on Multi-Object Tracking and Segmentation. In Proceedings of the Conference on Computer Vision and Pattern Recognition; 5th BMTT MOTChallenge Workshop: Multi-Object Tracking and Segmentation. Seattle, WA, USA (Virtual).
- Maier, J., Nitschke, M., Choi, J.-H., Gold, G., Fahrig, R., Eskofier, B., & Maier, A. (2020). Inertial Measurements for Motion Compensation in Weight-Bearing Cone-Beam CT of the Knee. In Anne L. Martel, Purang Abolmaesumi, Danail Stoyanov, Diana Mateus, Maria A. Zuluaga, S. Kevin Zhou, Daniel Racoceanu, Leo Joskowicz (Eds.), Medical Image Computing and Computer Assisted Intervention – MICCAI 2020. (pp. 14-23).
- Marxreiter, F., Buttler, U., Gaßner, H., Gandor, F., Gladow, T., Eskofier, B.,... Klucken, J. (2020). The Use of Digital Technology and Media in German Parkinson's Disease Patients. Journal of Parkinson's Disease, 10(2), 717-727. https://dx.doi.org/10.3233/JPD-191698
- Mehringer, W., Wirth, M., Gradl, S., Durner, L., Ring, M., Laudanski, A.F.,... Michelson, G. (2020). An Image-Based Method for Measuring Strabismus in Virtual Reality. In IEEE (Eds.), 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (pp. 5-12). Recife, BR.
- Nguyen, A., Chatterjee, S., Weinzierl, S., Schwinn, L., Matzner, M., & Eskofier, B. (2020). Time Matters: Time-Aware LSTMs for Predictive Business Process Monitoring. In Proceedings of the 1st International Workshop on Leveraging Machine Learning in Process Mining (pp. 1-12). Padua, IT.
- Nitschke, M., Dorschky, E., Heinrich, D., Schlarb, H., Eskofier, B., Koelewijn, A., & van den Bogert, A.J. (2020). Efficient trajectory optimization for curved running using a 3D musculoskeletal model with implicit dynamics. Scientific Reports. https://dx.doi.org/10.1038/s41598-020-73856-w
- Orozco-Arroyave, J.R., Vasquez Correa, J., Klumpp, P., Pérez Toro, P.A., Escobar-Grisales, D., Roth, N.,... Nöth, E. (2020). Apkinson: the smartphone application for telemonitoring Parkinson's patients through speech, gait and hands movement. Neurodegenerative Disease Management. https://dx.doi.org/10.2217/nmt-2019-0037
- Ott, F., Wehbi, M., Hamann, T., Barth, J., Eskofier, B., & Mutschler, C. (2020). The OnHW Dataset: Online Handwriting Recognition from IMU-Enhanced Ballpoint Pens with Machine Learning. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 4, 1-20. https://dx.doi.org/10.1145/3411842
- Raccagni, C., Sidoroff, V., Goebel, G., Granata, R., Leys, F., Klucken, J.,... Fanciulli, A. (2020). The footprint of orthostatic hypotension in parkinsonian syndromes. Parkinsonism & Related Disorders. https://dx.doi.org/10.1016/j.parkreldis.2020.06.029
- Richer, R., Zhao, N., Eskofier, B., & Paradiso, J.A. (2020). Exploring Smart Agents for the Interaction with Multimodal Mediated Environments. Multimodal Technologies and Interaction, 4(2). https://dx.doi.org/10.3390/mti4020027
- Rico-Olarte, C., López, D.M., Becker, L., & Eskofier, B. (2020). Towards Classifying Cognitive Performance by Sensing Electrodermal Activity in Children With Specific Learning Disorders. IEEE Access, 8, 196187-196196. https://dx.doi.org/10.1109/ACCESS.2020.3033769
- Rüthlein, M., Köferl, F., Mehringer, W., & Eskofier, B. (2020). Interactive Segmentation of RGB-D Indoor Scenes using Deep Learning. In Proceedings of the International Conference on Machine Learning; 2nd ICML 2020 Workshop on Human in the Loop Learning. Virtual Conference.
- Sidoroff, V., Raccagni, C., Kaindlstorfer, C., Eschlboeck, S., Fanciulli, A., Granata, R.,... Gaßner, H. (2020). Characterization of gait variability in multiple system atrophy and Parkinson's disease. Journal of Neurology. https://dx.doi.org/10.1007/s00415-020-10355-y
- Sternemann, U., Suchantke, I., Schmidt, K.-G., Höfner, P., Wagner, D., Ollenschläger, M.,... Steigleder, T. (2020, August). Entwicklung einer Applikation zum Home-Monitoring des Gesundheitszustandes von Palliativpatienten - eine Proof-of-Concept-Studie. Poster presentation at 13. DGP Kongress Deutsche Gesellschaft für Palliativmedizin, Wiesbaden, DE.
- Tietsch, M., Muaremi, A., Clay, I., Kluge, F., Hoefling, H., Ullrich, M.,... Müller, A. (2020). Robust Step Detection from Different Waist-Worn Sensor Positions: Implications for Clinical Studies. Digital Biomarkers, 4(1), 50-58. https://dx.doi.org/10.1159/000511611
- Ullrich, M., Küderle, A., Hannink, J., Del Din, S., Gaßner, H., Marxreiter, F.,... Kluge, F. (2020). Detection of Gait From Continuous Inertial Sensor Data Using Harmonic Frequencies. IEEE Journal of Biomedical and Health Informatics, 24(7), 1869 - 1878. https://dx.doi.org/10.1109/JBHI.2020.2975361
- Wanner, P., Hamacher, D., Schmautz, T., Eskofier, B., Pfeifer, K., & Steib, S. (2020). Dynamische Laufstabilität des Fußes bei Sportlern mit und ohne chronischer Sprunggelenksinstabilität nach Sprunggelenksdistorsion unter Berücksichtigung des Lauftempos und neuromuskulärer Ermüdung. In Tagungsband 3. Gamma-Kongress (S. 77-78). München, DE.
- Wehbi, M., Hamann, T., Barth, J., & Eskofier, B. (2020). Digitizing Handwriting with a Sensor Pen: A Writer-Independent Recognizer. In IEEE (Eds.), Proceedings of the 17th International Conference on Frontiers in Handwriting Recognition (ICFHR). Dortmund, DE.
- Wirth, M., Gradl, S., Mehringer, W., Kulpa, R., Rupprecht, H., Poimann, D.,... Eskofier, B. (2020). Assessing Personality Traits of Team Athletes in Virtual Reality. In Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020 (pp. 101-108). Atlanta, GA, US: Institute of Electrical and Electronics Engineers Inc..
- Wittenberg, T., Koch, R., Pfeiffer, N., Lang, N., Struck, M., Amft, O., & Eskofier, B. (2020). Evaluation of HRV estimation algorithms from PPG data using neural networks. Current Directions in Biomedical Engineering, 6(3). https://dx.doi.org/10.1515/cdbme-2020-3130
- Zrenner, M., Küderle, A., Roth, N., Jensen, U., Dümler, B., & Eskofier, B. (2020). Does the Position of Foot-Mounted IMU Sensors Influence the Accuracy of Spatio-Temporal Parameters in Endurance Running? Sensors, 20(19). https://dx.doi.org/10.3390/s20195705