Publications
Our research contributions spanning computational neuroscience, artificial intelligence, and computer vision. For a complete list, visit our Google Scholar page.
2026
Towards Embodied AI with MuscleMimic: Unlocking full-body musculoskeletal motor learning at scale
C Li*, C Wang*, B Ziliotto, M Simos, J Kovecses, G Durandau, A Mathis
LLaVAction: evaluating and training multi-modal large language models for action recognition
S Ye*, H Qi*, A Mathis**, MW Mathis**
Reinforcement learning-based motion imitation for physiologically plausible musculoskeletal motor control
M Simos, AS Chiappa, A Mathis
The behavior biopsy: Interpreting animal behavior as embodied, situated, and hierarchical
A Bonnetto*, S Mamooler*, C Li*, A Mathis
MyoChallenge 2025: A New Benchmark for Human Athletic Intelligence
C Wang, ..., C Li, M Simos, B Ziliotto, A Mathis, ..., V Caggiano
AdaptToken: Entropy-based Adaptive Token Selection for MLLM Long Video Understanding
H Qi, K Qu, M Rad, R Wang, A Mathis, M Pollefeys
Closed-loop imitation learning reveals muscle-centric and latent-goal codes in primate sensorimotor cortex
AM Vargas, AP Rotondo, AS Chiappa, MW Mathis, A Mathis
Individual identification of brown bears using pose-aware metric learning
B Rosenberg, M Zhou, N Wolf, MW Mathis, BP Harris, A Mathis
2025
Arnold: a generalist muscle transformer policy
AS Chiappa, B An, M Simos, C Li, A Mathis
DLC2Action: A Deep Learning-based Toolbox for Automated Behavior Segmentation
E Kozlova, A Bonnetto, A Mathis
EPFL-Smart-Kitchen: An Ego-Exo Multi-Modal Dataset for Challenging Action and Motion Understanding in Video-Language Models
A Bonnetto*, H Qi*, F Leong, M Tashkovska, M Rad, S Shokur, F Hummel, S Micera, M Pollefeys, A Mathis
MammAlps: A multi-view video behavior monitoring dataset of wild mammals in the Swiss Alps
V Gabeff, H Qi, B Flaherty, G Sumbül, A Mathis*, D Tuia*
Imitation learning of dexterous hand control uncovers muscle-level representations in primate sensorimotor cortex
AM Vargas, AP Rotondo, AS Chiappa, MW Mathis, A Mathis
Deep‐learning models of the ascending proprioceptive pathway are subject to illusions
A Perez Rotondo, M Simos, F David, S Pigeon, O Blanke, A Mathis
Climbing out of the lab: studying motor planning and coarticulation in the climbing gym
A Bonnetto, A Mathis
Fine-tuning Vision-Language Models for Animal Behavior Analysis
S Mamooler, H Qi, V Gabeff, S Montariol, A Bosselut, A Mathis
PICLe: Pseudo-Annotations for In-Context Learning in Low-Resource Named Entity Detection
S Mamooler, S Montariol, A Mathis, A Bosselut
2024
Acquiring musculoskeletal skills with curriculum-based reinforcement learning
AS Chiappa, P Tano, N Patel, A Ingster, A Pouget, A Mathis
Decoding the brain: From neural representations to mechanistic models
MW Mathis, AP Rotondo, EF Chang, AS Tolias, A Mathis
Elucidating the Hierarchical Nature of Behavior with Masked Autoencoders
L Stoffl, A Bonnetto, S d'Ascoli, A Mathis
Task-driven neural network models predict neural dynamics of proprioception
A Marin Vargas*, A Bisi*, AS Chiappa, C Versteeg, LE Miller, A Mathis
SuperAnimal models pretrained for plug-and-play analysis of animal behavior
S Ye, A Filippova, J Lauer, M Vidal, St Schneider, T Qiu, A Mathis, MW Mathis
WildCLIP: Scene and animal attribute retrieval from camera trap data with domain-adapted vision-language models
V Gabeff, M Russwurm, D Tuia, A Mathis
Could ChatGPT get an engineering degree? Evaluating higher education vulnerability to AI assistants
Beatriz Borges, Negar Foroutan, Deniz Bayazit, Anna Sotnikova, Syrielle Montariol, Tanya Nazaretsky, Mohammadreza Banaei, Alireza Sakhaeirad, Philippe Servant, Seyed Parsa Neshaei, Jibril Frej, Angelika Romanou, Gail Weiss, Sepideh Mamooler, Zeming Chen, Simin Fan, Silin Gao, Mete Ismayilzada, Debjit Paul, Philippe Schwaller, Sacha Friedli, Patrick Jermann, Tanja Käser, Antoine Bosselut, EPFL Grader Consortium, EPFL Data Consortium
MyoChallenge 2023: Towards human-level dexterity and agility
Vittorio Caggiano, Guillaume Durandau, Huiyi Wang, Chun Kwang Tan, Pierre Schumacher, Huawei Wang, Alberto Silvio Chiappa, Alessandro Marin Vargas, Alexander Mathis, Jungdam Won, Jungnam Park, Gunwoo Park, Beomsoo Shin, Minseung Kim, Seungbum Koo, Zhuo Yang, Wei Dang, Heng Cai, Jianfei Song, Seungmoon Song, Massimo Sartori, Vikash Kumar
HOISDF: Constraining 3D hand-object pose estimation with global signed distance fields
H Qi, C Zhao, M Salzmann, A Mathis
Modeling Sensorimotor Processing with Physics-Informed Neural Networks
A Perez Rotondo, A Marin Vargas, M Dimitriou, A Mathis
2023
Rethinking pose estimation in crowds: overcoming the detection information-bottleneck and ambiguity
M Zhou*, L Stoffl*, MW Mathis, A Mathis
AmadeusGPT: a natural language interface for interactive animal behavioral analysis
S Ye, J Lauer, M Zhou, A Mathis, MW Mathis
Contrasting action and posture coding with hierarchical deep neural network models of proprioception
Kai J. Sandbrink*, Pranav Mamidanna*, Claudio Michaelis, Matthias Bethge*, Mackenzie W. Mathis*, Alexander Mathis*
MyoChallenge 2022: Learning contact-rich manipulation using a musculoskeletal hand
Vittorio Caggiano, ..., Alberto Chiappa, Alexander Mathis, ..., Vikash Kumar
2022
DMAP: a Distributed Morphological Attention Policy for Learning to Locomote with a Changing Body
Alberto Silvio Chiappa, Alessandro Marin Vargas, Alexander Mathis
Multi-animal pose estimation, identification and tracking with DeepLabCut
Jessy Lauer, Mu Zhou, Shaokai Ye, et al., Mackenzie W Mathis*, Alexander Mathis*
2021
Seeing biodiversity: perspectives in artificial intelligence for wildlife conservation
Devis Tuia, Benjamin Kellenberger, Sara Beery, et al., Alexander Mathis, Mackenzie W Mathis, et al.
Out-of-distribution generalization of internal models is correlated with reward
MWM Khushdeep S.* Mann, Steffen* Schneider, Alberto Chiappa, Jin H. Lee ...
End-to-End Trainable Multi-Instance Pose Estimation with Transformers
L Stoffl, M Vidal, A Mathis
2020
A Primer on Motion Capture with Deep Learning: Principles, Pitfalls and Perspectives
Alexander Mathis, Steffen Schneider, Jessy Lauer, Mackenzie W. Mathis
2019
Using DeepLabCut for 3D markerless pose estimation across species and behaviors
Tanmay Nath*, Alexander Mathis*, An Chi Chen, Amir Patel, Matthias Bethge, Mackenzie W. Mathis
2018
DeepLabCut: Markerless tracking of user-defined features with deep learning
Alexander Mathis, Pranav Mamidanna, Kevin M. Cury, Taiga Abe, Venkatesh N. Murthy, Mackenzie W. Mathis*, Matthias Bethge*