Aller au contenu

Jean Rouat

Professeur associé, Faculté de génie
FAC. GÉNIE Électrique et informatique

Présentation

Sujet de recherche

Neuronal Modeling, Neuronal Systems, Computer Science and Statistics, Auditory System, Visual System

Disciplines de recherche

Computer Engineering and Software Engineering, Neurosciences

Mots-clés

Neuromorphic Computing, spiking NN for dynamical systems, deep learning, machine learning, Sensory substitution, Neural Engineering, Computational Neuroscience, Perceptive Signal Processing, Digital Signal Processing for human interactions

Intérêts de recherche

Neuromorphic computing for Artificial Intelligence AI, Deep Learning, Machine Learning, Signal Processing and Neuroscience

Langues parlées et écrites

Anglais, Français

Diplômes

(1996). Étude de la physiologie du système auditif (Post-doctorate, NA). Université de Lausanne.

(1995). Modélisation du système auditif (Post-doctorate, NA). Cambridge Life Sciences.

(1988). Analyse et reconnaissance de consonnes nasales, fricatives et liquides à l'aide de modèles statistiques et de réseaux procéduraux (Doctorate, Electrical Eng.).

(1984). Utilisation de la quantification vectorielle sur un système de reconnaissance de parole continue à approche globale (Master's Thesis, Electrical Eng.). Université de Sherbrooke.

(1981). Modélisation de la propagation de la marée dans un estuaire. (Bachelor's Equivalent, Maîtrise es science Physique). Université de Bretagne Occidentale.

Titres de compétence

(2004) Board of the technical IEEE committee on Machine Learning for Signal Processing.

Elected Senior Member.

Ing.

Expérience académique

Adjunct Professor / Professeur associé. (2022-). Université de Sherbrooke. Canada.

Appartenance Complémentaire. (2019-). Université de Sherbrooke. Canada.

Professeur titulaire. (2002-2022). Université de Sherbrooke. Canada.

Prix et distinctions

  • (2100) Elected Senior Member IEEE. IEEE- Institute of Electrical & Electronics Engineers. (Distinction).
  • (2018) Adjunct researcher INO. National Optics Institute. (Distinction).

Financement

  • Grant. (Awarded). Principal Applicant. Algorithms and Evaluation for Neuromorphic Multimodal Assistive Systems. Natural Sciences and Engineering Research Council of Canada (NSERC). Discovery. 205 000 $. (2023-2028)
  • Grant. (Awarded). Co-applicant. PROMPT IA - Volet Propulsion des Universités. PROMPT-Québec. IA-Propulsion des universités. 500 000 $. (2022-2025)
  • Grant. (Awarded). Co-applicant. Hardware implementation of spiking neural networks based on hybrid CMOS-memristors circuits for ultralow-power artificial intelligence at the edge. Fonds de recherche du Québec - Nature et technologies (FRQNT). FRQNT-Équipe. 199 620 $. (2021-2024)
  • Grant. (Awarded). Co-applicant. Observatoire international sur les impacts sociétaux de l’intelligence artificielle et du numérique. Fonds de recherche du Québec - Société et culture (FRQSC). Observatoire international sur les impacts sociétaux de l’IA et du numérique. 7 500 000 $. (2018-2023)
  • Grant. (Awarded). Principal Applicant. Scene interpretation for sensory substitution and intelligent agents: a neurocomputational approach. Natural Sciences and Engineering Research Council of Canada (NSERC). Discovery. 144 000 $. (2017-2023)
  • Grant. (Awarded). Co-applicant. Unsupervised spiking neural networks with analog memristive devices for edge computing. European Coordinated Research on Long-term Challenges in Information & Comm Sciences & Technologies. CHIST-ERA. 1 355 350 $. (2020-2023)
  • Grant. (Completed). Co-applicant. Développement et renforcement de stimulations électriques pour implants auditifs. Fonds de recherche du Québec - Nature et technologies (FRQNT). Équipe. 162 000 $. (2018-2022)
  • Grant. (Completed). Co-applicant. Centre Interdisciplinaire de recherche en musique, médias et technologie, CIRMMT. Fonds Québécois de la Recherche sur la Nature et les Technologies (FQRNT). Regroupements Stratégiques. 3 000 $. (2021-2022)
  • Grant. (Completed). Co-applicant. Neuromorphic Circuits for Large-Scale Quantum Systems. Canada First Research Excellence Fund. 237 000 $. (2019-2021)
  • Grant. (Completed). Principal Applicant. Fonds d'innovation pédagogique de l'université de Sherbrooke: Médiatisation et formation à distance en apprentissage machine et génie neuronal. University of Sherbrooke. FIP. 20 000 $. (2018-2020)
  • Grant. (Completed). Principal Applicant. INTEL Neuromorphic Research Community: Unsupervised regulation for the self-organized CRITICAL recurrent neural network project on LOIHI & Audio-Visual Scene Analysis with spike-based representations for SNN. Intel (USA). travel and INRC for Loihi implementations.. 3 800 $. (2019-2019)
  • Grant. (Completed). Co-applicant. Équipement pour le projet développement et renforcement de stimulations électriques pour implants auditifs. Fonds de recherche du Québec - Nature et technologies (FRQNT). Recherche en équipe. 49 620 $. (2018-2019)
  • Grant. (Completed). Principal Applicant. IGLU: Interactive Grounded Language Understanding. (2015-2018)
  • Grant. (Completed). Principal Applicant. GPU for spiking neural networks and deep learning. Nvidia. Donation for research. 5 000 $. (2018)
  • Grant. (Completed). Co-investigator. Multichannel neural signal recording instrumentation for the central auditory system. Canada Foundation for Innovation (CFI). John R. Evans Leaders Funds. 179 038 $. (2016-2017)
  • Grant. (Completed). Principal Applicant. Analyse et traitement objet des signaux pour des applications en interfaces homme/machine. (2012-2017)
  • Grant. (Completed). Principal Applicant. Perception polysensorielle des objets : Applications pour les prothèses de substitution sensorielle. (2013-2017)
  • Contract. (Completed). Principal Applicant. Novel Neural-based Sparse Representations of Audio Signals for a Variety of Applications Including Audio Coding (and Related Audio Object Identification). (2010-2013)
  • Grant. (Completed). Principal Applicant. Modélisation et réalisation de systèmes de substitution sensorielle audition/vision et vision/audition. (2010-2013)
  • Grant. (Completed). Co-applicant. Mild cognitive impairment, inflammations and slow wave sleep. (2011-2012)
  • Grant. (Completed). Principal Applicant. Intégration sur FPGA d'un système de séparation de sources sonores à base de réseaux de neurones à impulsions. (2010-2011)
  • Grant. (Completed). Principal Applicant. Représentation, fusion d'objets (sonores et/ou visuels) avec applications en traitement du signal et interfaces homme-machines. (2009-2011)
  • Grant. (Completed). Principal Applicant. Robust signal analysis and recognition techiques for man-machine interaction. (2006-2011)
  • Contract. (Completed). Principal Applicant. Audio Object Recognition and Classification based on Sparse Representations of Audio Signals. (2011)
  • Grant. (Completed). Principal Applicant. Image Processing with a neuro-computational dynamic link matcher. (2006-2008)
  • Grant. (Completed). Principal Applicant. Traitement d'images avec un système neuro-computationnel. (2006-2008)
  • Grant. (Completed). Co-investigator. Développement et expérimentation d'un détecteur acoustique intelligent de baleines. (2004-2006)
  • Grant. (Completed). Principal Investigator. Robust speech analysis and recognition technics for man-machine interaction. (2001-2006)
  • Grant. (Completed). Principal Investigator. Auditory signal & image processing, Control and Robotics, with a neuro-computational dynamic link matcher. (2004-2005)
  • Grant. (Completed). Co-investigator. Activation corticale du flot cognitif. (2004-2004)
  • Grant. (Completed). Principal Investigator. Trait. auto info bruitée via une approche neurale : détection automatique de décharges nerveuses. (2003-2004)
  • Grant. (Completed). Principal Investigator. Développement de projet pour FP6. (2002-2004)
  • (Completed). Co-investigator. Indexation par contenu de documents multimédias français en vue de recherche automatisée sur INTERNET. (2001-2002)
  • (Completed). Principal Investigator. Analyse et reconnaissance de parole en milieu difficile. (1997-2001)
  • (Completed). Principal Investigator. Caractérisation de locuteurs pour la reconnaissance de parole impliquant plusieurs locuteurs. (2000-2001)
  • (Completed). Principal Investigator. Nouveaux algorithmes en vue de caractériser le locuteur. (1997-1999)

Publications

Articles de revue

  • Lavoie, Jacob; Besrour, Marwan; Lemaire, William; Rouat, Jean; Fontaine, Réjean and Plourde, Eric. (2024). Learning to see via epiretinal implant stimulation in silico with model-based deep reinforcement learning. Biomedical Physics & Engineering Express 10 (2), 5006. DOI. (Published).
  • Calvet*, Emmanuel; Reulet, Bertrand and Rouat, Jean. (2024). The connectivity degree controls the difficulty in reservoir design of random boolean networks. Frontiers in Computational Neuroscience 18 DOI. (Published).
  • El Ferdaoussi*, Ahmad; Rouat, Jean; Plourde, Eric. (2023). Efficiency metrics for auditory neuromorphic spike encoding techniques using information theory. Neuromorphic Computing and Engineering 3 (2), DOI. (Published).
  • Commère*, Louis; Rouat, Jean. (2023). Evaluation of Short Range Depth Sonifications for Visual-to-Auditory Sensory Substitution. IEEE Transactions on Human-Machine Systems 53 (3), 479-489. DOI. (Published).
  • Calvet*, Emmannuel; Rouat, Jean; Reulet Bertrand. (2023). Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics. Frontiers in Computational Neuroscience 17:1223258 DOI. (Published).
  • Abdelnour*, J.; Rouat, J.; Salvi, G. (2023). NAAQA: A Neural Architecture for Acoustic Question Answering. IEEE Tr. on Pattern Analysis and Machine Intelligence 45 (4), 4997-5009. DOI. (Published).
  • Janzakova, Kamila; Balafrej*, Ismaël; Kumar, Ankush; Garg, Nikhil; Scholaert, Corentin; Rouat, Jean; Drouin, Dominique; Coffinier, Yannick; Pecqueur, Sébastien; Alibart, Fabien. (2023). Structural plasticity for neuromorphic networks with electropolymerized dendritic PEDOT connections. Nature Communication 14 (8143), DOI. (Published).
  • Brousmiche*, Mathilde; Rouat, Jean; Dupont, Stéphane. (2022). Multimodal Attentive Fusion Network for Audio-visual Event Recognition. Information Fusion 85 52-59. DOI. (Published).
  • Balafrej*, Ismaël; Alibart, Fabien; Rouat, Jean. (2022). P-CRITICAL: A Reservoir Autoregulation Plasticity Rule for Neuromorphic Hardware. Neuromorphic Computing and Engineering 2 (2), DOI. (Published).
  • Commère*, Louis; Rouat, Jean. (2022). Sonified distance in sensory substitution does not always improve localization: comparison with a 2D and 3D handheld device. IEEE Transactions on Human-Machine Systems 53 (1), 154-163. DOI. (Published).
  • Garg, Nikhil; Balafrej*, Ismael; Stewart, Terrence C; Portal, Jean-Michel; Bocquet, Marc; Querlioz, Damien; Drouin, Dominique; Rouat, Jean; Beilliard, Yann; Alibart, Fabien. (2022). Voltage-Dependent Synaptic Plasticity (VDSP): Unsupervised probabilistic Hebbian plasticity rule based on neurons membrane potential. Frontiers in Neuroscience 16 DOI. (Published).
  • Celotti* L, Brodeur* S, Rouat J. (2021). AriEL: volume coding for sentence generation. Neural Information Processing Systems (NeurIPS) 2021 arXiv:2003.13600 (Submitted).
  • Brousmiche* M., Dupont S., Rouat J. (2020). AVECL-UMONS database for audio-visual event classification and localization. arXiv preprint arXiv:2011.01018 (Published).
  • Moinnereau M-A, Rouat J, Whittingstall K, Plourde E. (2020). A frequency-band coupling model of EEG signals can capture features from an input audio stimulus. Hearing Research 107994. DOI. (Published).
  • Richan* E, Rouat J. (2020). A proposal and evaluation of new timbre visualization methods for audio sample browsers. Personal and Ubiquitous Computing DOI. (Published).
  • Commère* L., Rouat J. (2020). Evaluation of a Vision-to-Audition Substitution System that Provides 2D WHERE Information and Fast User Learning. arXiv Preprint, arXiv:2010.09041 (Published).
  • Brousmiche*, M.; Rouat, J.; Dupont, S. (2020). Multi-level Attention Fusion Network for Audio-visual Event Recognition. arXiv:2106.06736 DOI. (Published).
  • Jérôme Abdelnour* and Giampiero Salvi and Jean Rouat. (2019). CLEAR: A Dataset for Compositional Language and Elementary Acoustic Reasoning. IEEE DataPort, http://dx.doi.org/10.21227/7x26-a025 [Online] DOI. (Published).
  • Abdelnour* J., Salvi G., Rouat J. (2019). From Visual to Acoustic Question Answering. arXiv:1902.11280v1 (Published).
  • Chanauria* N, Bharmauria V, Bachatène L, Cattan S, Rouat J, Molotchnikoff S. (2019). Sound induces change in orientation preference of V1 neurons: Audio-visual cross-influence. Neuroscience 404 (15 April), 48 - 61. DOI. (Published).
  • Sean UN Wood* and Jean Rouat. (2019). Unsupervised Low Latency Speech Enhancement with RT-GCC-NMF. IEEE Journal of Selected Topics In Signal Processing 13 (2), 332 - 346. DOI. (Published).
  • Belgoum*, Zakaria; Abdelnour* Jérôme , Brodeur* Simon , Rouat Jean. (2018). Audio dataset for Household Multimodal Environment (HoME). IEEE Dataport, http://dx.doi.org/10.21227/w77r-4902 [Online] DOI. (Published).
  • Brodeur*, Simon; Carrier*, Simon; Rouat, Jean. (2018). CREATE: Multimodal Dataset for Unsupervised Learning, Generative Modeling and Prediction of Sensory Data from a Mobile Robot in Indoor Environments. IEEE Dataport, doi: https://dx.doi.org/10.21227/H2M94J. (Published).
  • Moinnereau, Marc-Antoine; Brienne, Thomas; Brodeur*, Simon; Rouat, Jean; Whittingstall Kevin, Plourde Eric. (2018). Classification of auditory stimuli from EEG signals with a regulated recurrent neural network reservoir. arXiv:1804.10322 [eess.SP] (Published).
  • Brodeur* S., Perez E., Anand A., Golemo F., Celotti* L, Strub F., Rouat J., Larochelle H., Courville A. (2018). HoME: a Household Multimodal Environment. arXiv:1711.11017 [cs.AI], published at ICLR (Published).
  • Erfani* Y, Pichevar R, Rouat J. (2017). Audio watermarking using spikegram and a two-dictionary approach. IEEE Transactions on Information Forensics and Security 12 (4), 840 - 852. (Published).
  • Wood* S, Rouat J, Dupont S, Pironkov* G. (2017). Blind Speech Separation and Enhancement with GCC-NMF. IEEE/ACM Transactions on Audio, Speech and Language Processing 25 (4), 3329-3341. (Published).
  • M. Adeli* M, Rouat J, Wood* S, Molotchnikoff S, Plourde E. (2016). A Flexible Bio-inspired Hierarchical Model for Analyzing Musical Timbre. IEEE/ACM Transactions on Audio, Speech, and Language Processing PP (99), 875-889. (Published).
  • Chanauria* N, Bharmauria* V, Bachatene L, Cattan S, Rouat J, Molotchnikoff S. (2016). Comparative effects of adaptation on layer II?III and layer V?VI neurons in cat V1. European Journal of Neuroscience 44 (12), 3094-3104. DOI. (Published).
  • Bharmauria*, Bachatene L, Cattan S, Chanauria* N, Rouat J, Molotchnikoff S. (2016). High noise correlation between the functionally connected neurons in emergent V1 microcircuits. Exp Brain Res 234 (2), 523-532. (Published).
  • Bharmauria* V, Bachatene L, Ouelhazi A, Cattan S, Chanauria* N, Etindele-Sosso F, Rouat J, Molotchnikoff S. (2016). Interplay of orientation selectivity and the power of low- and high-gamma bands in the cat primary visual cortex. Neuroscience Letters 620 14-19. DOI. (Published).
  • Bharmauria* V, Bachatene L, Cattan S, Brodeur* S, Chanauria* N, Rouat J, Molotchnikoff S. (2016). Network?selectivity and stimulus?discrimination in the primary visual cortex: cell?assembly dynamics. European Journal of Neuroscience 43 (2), 204-219. (Published).
  • Bachatene L, Bharmauria* V, Cattan S, Chanauria* N, Rouat J, Molotchnikoff S. (2015). Electrophysiological and firing properties of neurons: Categorizing soloists and choristers in primary visual cortex. Neuroscience Letters 604 103-108. (Published).
  • Bachatene L, Bharmauria* V, Cattan S, Rouat J, Molotchnikoff S. (2015). Modulation of functional connectivity following visual adaptation: Homeostasis in V1. Brain Research 1594 136-153. (Published).
  • Bachatene L, Bharmauria* V, Cattan S, Rouat J, Molotchnikoff S. (2015). Reprogramming of orientation columns in visual cortex: a domino effect. Nature Science Report 5 9436. (Published).
  • Bharmauria* V, Bachatene L, Cattan, S, Chanauria* N, Rouat J, Molotchnikoff S. (2015). Stimulus-dependant augmented gamma oscillatory activity between the functionally connected cortical neurons in V1. European Journal of Neuroscience 41 (12), 1587–1596. (Published).
  • Bachatene L, Bharmauria* V, Cattan S, Chanauria* N, Rouat J, Molotchnikoff S. (2015). Summation of connectivity strengths in the visual cortex reveals stability of neuronal microcircuits after plasticity. BMC Neuroscience 16 (1), (Published).
  • Adeli* M, Rouat J, Molotchnikoff S. (2014). Audiovisual correspondence between musical timbre and visual shapes. Frontiers in Human Neuroscience 8 (352), (Published).
  • Rouat J, Brodeur* S, Plourde E. (2014). Auditory object feature maps with a hierarchical network of independent components?. BMC Neuroscience 15 (Suppl 1), P66. (Published).
  • Bharmauria* V, Bachatene L, Cattan S, Rouat J, Molotchnikoff S. (2014). Synergistic activity between primary visual neurons. Neuroscience 268 255-264. (Published).
  • Brodeur* S, Rouat J. (2013). Auditory Objects: A Bio-Inspired, Hierarchical and Sparse High Dimensional Representation for use in Recognition. Objets Sonores: Une Représentation Bio-Inspirée, Hiérarchique, Parcimonieuse à Très Grandes Dimensions Utilisable En Reconnaissance. Canadian Acoustics / Acoustique Canadienne, arXiv:1311.5924 41 (2), 37-52. (Published).
  • Caron* L-C, D’Haene M, Mailhot F, Schrauwen B, Rouat J. (2013). Event management for large scale event-driven digital hardware spiking neural networks. Neural Networks 45 83-93. (Published).
  • de Ladurantaye*, V.; Lavoie*, J.; Bergeron*, J.; Parenteau*, M.; Lu, Huizhong; Pichevar, R.; Rouat, J. (2012). A Parallel Supercomputer Implementation of a Biological Inspired Neural Network and its use for Pattern Recognition. Journal of Physics: Conference Series 341 (1), 012024. DOI. (Published).
  • Bachatene L, Bharmauria*, Rouat J, Molotchnikoff S. (2012). Adaptation-induced plasticity and spike-waveforms in cat visual cortex. NeuroReport 23 88--92. (Published).
  • Molotchnikoff S and Rouat J. (2012). Brain at work: Time, Sparseness and Superposition Principles. Frontiers in Bioscience (Landmark Edition) 17 (1), 583-606. (Published).

Livres

  • Stéphane Molotchnikoff and Jean Rouat. (2012). Visual Cortex - Current Status and Perspectives. (ISBN: 978-953-51-076). Intech. (Published).

Chapitres de livre

  • deLadurantaye* V and Rouat J and Vanden-Abeele J. (2012). Models of information processing in the visual cortex. Molotchnikoff S and Rouat J. Visual Cortex (1, 1, 1 - 15). Canada : INTECH. (Published).

Rapports

  • Herranz-Celotti*, Luca and Rouat, Jean. (2024). Stabilizing RNN Gradients through Pre-training. Université de Sherbrooke. DOI.
  • Herranz-Celotti*, Luca and Rouat, Jean. (2024). Stabilizing Spiking Neuron Training. Université de Sherbrooke. DOI.
  • Balafrej*, Ismaël; Alibart, Fabien and Rouat, Jean. (2023). Expanding memory in recurrent spiking networks. Université de Sherbrooke. DOI.
  • Luca Herranz-Celotti*, Luca; Rouat, Jean. (2022). Surrogate Gradients Design. Université de Sherbrooke. 23 p. DOI.
  • N. Garg, I. Balafrej*, T. C. Stewart, J-M. Portal, M. Bocquet, D. Querlioz, D. Drouin, J. Rouat, Y. Beilliard, F. Alibart. (2022). Voltage-Dependent Synaptic Plasticity (VDSP): Unsupervised probabilistic Hebbian plasticity rule based on neurons membrane potential. Université de Sherbrooke. 19 p. DOI.
  • Celotti*,Luca; Brodeur*, Simon; Rouat, Jean. (2021). AriEL: volume coding for sentence generation comparisons, https://openreview.net/forum?id=qTTccuW4dja. Université de Sherbrooke. 21 p.
  • Brousmiche*, Mathilde; Rouat, Jean; Dupont, Stéphane. (2021). Multi-level Attention Fusion Network for Audio-visual Event Recognition, arXiv:2106.06736. Université de Sherbrooke. 10 p.
  • Brousmiche*, Mathilde; Dupont, Stéphane; Rouat, Jean. (2020). AVECL-UMONS database for audio-visual event classification and localization, arXiv:2011.01018. Université de Sherbrooke. 5 p.
  • Celotti*, Luca; Brodeur*, Simon; Rouat, Jean. (2020). AriEL: volume coding for sentence generation, https://arxiv.org/abs/2003.13600. Université de Sherbrooke. 16 p.
  • Commère*, Louis, Rouat, Jean. (2020). Evaluation of a Vision-to-Audition Substitution System that Provides 2D WHERE Information and Fast User Learning, https://arxiv.org/abs/2010.09041. Université de Sherbrooke. 15 p.
  • Rouat, Jean. (2019). IGLU, Interactive Grounded Language Understanding, Last year and dissemination activities report. Université de Sherbrooke. 190 p.
  • Brodeur*, Simon; Carrier*, Simon; Rouat, Jean. (2018). CREATE: Multimodal Dataset for Unsupervised Learning, Generative Modeling and Prediction of Sensory Data from a Mobile Robot in Indoor Environments, https://arxiv.org/pdf/1801.10214.pdf. Université de Sherbrooke. 35 p.
  • Moinnereau, Marc-Antoine; Brienne, Thomas; Brodeur*, Simon; Rouat, Jean; Whittingstall Kevin, Plourde Eric. (2018). Classification of auditory stimuli from EEG signals with a regulated recurrent neural network reservoir, arXiv:1804.10322 [eess.SP]. Université de Sherbrooke. 4 p.
  • Rouat, Jean. (2018). IGLU, Interactive Grounded Language Understanding, Second year and dissemination activities report. Université de Sherbrooke. 249 p.
  • Rouat, Jean. (2017). IGLU, Interactive Grounded Language Understanding, First year and dissemination activities report. Université de Sherbrooke. 123 p.

Documents de travail

  • Abdelnour, Jérôme; Rouat, Jean; Salvi, Giampiero. (2021). NAAQA: A Neural Architecture for Acoustic Question Answering. 12 p. DOI.
  • Balafrej*, Ismaël; Rouat, Jean. (2020). P-CRITICAL: A Reservoir Autoregulation Plasticity Rule for Neuromorphic Hardware. 10 p. DOI.

Ressources en ligne

  • Zakaria Belgoum; Jérôme Abdelnour; Simon Brodeur; Jean Rouat. (2018). Audio dataset for Household Multimodal Environment (HoME). Site Web. DOI.
  • Brodeur, Simon ; Carrier, Simon ; Rouat, Jean. (2018). CREATE: Multimodal Dataset for Unsupervised Learning, Generative Modeling and Prediction of Sensory Data from a Mobile Robot in Indoor Environments. Site Web. DOI.
  • Brodeur, Simon; Perez, Ethan; Anand, Ankesh; Golemo, Florian; Celotti, Luca ; Strub, Florian; Rouat, Jean; Larochelle, Hugo ; Courville, Aaron. (2017). HoME: a Household Multimodal Environment. Site Web.

Articles de conférence

  • El Ferdaoussi*, Ahmad; Rouat, Jean; Plourde Éric. (2023). Optimizing Neuromorphic Spike Encoding of Dynamic Stimulus Signals Using Information Theory. Proceedings, DOI. (Published).
  • Yarga*, Sidi Yaya Arnaud; Rouat, Jean; Wood, Sean. (2022). Efficient spike encoding algorithms for neuromorphic speech recognition. Proc. International Conference on Neuromorphic Systems (ICONS), DOI. (Published).
  • El Ferdaoussi*, Ahmad; Plourde, Éric; Rouat, Jean. (2022). Optimizing Spike Encoding of Speech Using Information Theory for Neuromorphic Systems. Proc. of ICONS 2022, (Accepted).
  • Bahadi* S., Rouat J., Plourde E. (2021). Adaptive Approach for Sparse Representations Using the Locally Competitive Algorithm for Audio. proceedings of the IWMLSP, 1-6. DOI. (Published).
  • Garg*, Nikhil; Balafrej*, Ismael; Beilliard, Yann; Drouin, Dominique; Alibart, Fabien; Rouat, Jean. (2021). Signals to Spikes for Neuromorphic Regulated Reservoir Computing and EMG Hand Gesture Recognition. International Conference on Neuromorphic Systems. (Published).
  • Brousmiche*, Mathilde; Dupont, Stéphane; Rouat, Jean. (2020). Intra and Inter-modality Interactions for Audio-visual Event Detection. ACM First International Workshop on Human-centric Multimedia Analysis. 5-11. DOI. (Published).
  • Brousmiche*, Mathilde; Rouat, Jean; Dupont, Stéphane. (2020). SECL-UMons Database for Sound Event Classification and Localization. Proc., 756-760. DOI. (Published).
  • Richan*, E.; Rouat, J. (2019). A study comparing shape, colour and texture as visual labels in audio sample browsers. Proceedings, 223 -. DOI. (Published).
  • Brousmiche* M, Rouat J, Dupont S,. (2019). Audio-Visual Fusion And Conditioning With Neural Networks For Event Recognition. IEEE, Int. Workshop on Machine Learning for Signal Processing. DOI. (Published).
  • Prince-Tremblay*, Jordan; Balafrej*, Ismaël; Labelle, Félix; Martel-Denis, Félix; Matte, Éric; Chouinard-Beaupré, Julien; Letourneau, Adam; Mercier-Nicol, Antoine; Brodeur, Simon; Ferland, François; Rouat, Jean. (2018). A Cooperative Visually Grounded Dialogue Game with a Humanoid Robot. https://nips.cc/Conferences/2018/Schedule?showEvent=12165, (Published).
  • Abdelnour* J, Salvi G, Rouat J. (2018). CLEAR: A Dataset for Compositional Language and Elementary Acoustic Reasoning. https://nips2018vigil.github.io/static/papers/accepted/16.pdf, (Published).
  • Moinnereau* M-A, Brienne T, Brodeur* S, Rouat J, Whittingstall K, Plourde E. (2018). Classification Of Auditory Stimuli From EEG Signals with a Regulated Recurrent Neural Network Reservoir. IEEE Proceedings of the MLSP workshop, (Submitted).
  • Brodeur* S, Perez E, Anand A, Golemo F, Celotti* L, Strub F, Rouat J, Larochelle H, Courville A. (2018). HoME: a Household Multimodal Environment. OpenReview.net, [Online]. (Published).
  • Celotti*, Luca; Brodeur*, Simon; Rouat, Jean. (2018). Language coverage and generalization in RNN-based continuous sentence embeddings for interacting agents. https://nips2018vigil.github.io, (Published).
  • Commère*, Louis; Wood*, Sean; Rouat, Jean. (2018). Sensory substitution of vision by audition for the visually impaired. Neurosymposium 2018. Canada, (Accepted).
  • Commère*, Louis; Grond, Florian; Côté, François; Rouat, Jean. (2018). Sonification Of 3D Point Clouds For Substitution Of Vision By Audition For Blind Users. Proceedings of the 24th int. conf. on Auditory display, United States of America, 256-258. DOI. (Published).
  • El Ferdaoussi*, A.; Brodeur*, S., Calvet*, E.; Abdelnour*, J.; Richan*, E.; Bharmauria*, V.; Bachatène, L.; Charnauria*, N.; Molotchnikoff, S.; Rouat, J. (2018). Study of the emergence of cortical maps in large-scale simulation of the primary visual cortex. NeuroSymposium 2018. Canada, (Published).
  • Richan*, Etienne; Rouat, Jean. (2018). Towards translating perceptual distance from hearing to vision using neural networks. TIMBRE 2018: timbre is a many splendored thing proceedings, Canada, 59-60. DOI. (Accepted).
  • J. Abdelnour*, S. Brodeur*, M. Brousmiche*, L. Celotti*, J. Civera, A. Courville, J.-B. Delbrouck, H. de Vries, S. Dupont, F. Golemo, O. Mastropietro, P. Azagra, A. C. Murillo, P.Y. Oudeyer, O. Pietquin, B. Piot, G. Pironkov, J. Rouat, G. Salvi, O. Seddati, F. Strub, S. Wood*. (2018). Year 2 of Interactive Grounded Language Understanding. CHIST-ERA Projects Seminar 2018. France, (Published).
  • Wood* S, Rouat J. (2017). Blind Speech Separation with GCC-NMF. Proceedings of INTERSPEECH, (Published).
  • Chanauria* N, Bharmauria V, Bachatene L, Etindele Sosso F, Rouat J, Molotchnikoff S. (2017). Co-ordinated adaptive changes of layer 2/3 and layer 5/6 multiunit activity (MUA) orientation tuning in the cat visual cortex. Abstract's book of the society of Neuroscience, 227.21 / CC15. (Published).
  • Brodeur* S, Perez E, Anand A, Golemo F, Celotti* L, Strub F, Rouat J, Larochelle H, Courville A. (2017). HoME: a Household Multimodal Environment. NIPS 2017 workshop, (Published).
  • Brodeur* S, Rouat J. (2017). Optimality of Inference in Hierarchical Coding for Distributed Object-Based Representations. 15th. IEEE Canadian Workshop on Information Theory (CIWT), 1 -- 5. (Published).
  • Brodeur* S, Celotti* L, Rouat J. (2017). Proposal of a Generative Model of Event-based Representations for Grounded Language Understanding. proceedings of first int. workshop on Grounding Language Understanding, 81 -- 86. (Published).
  • Wood* S, Rouat J. (2017). Real-Time Speech Enhancement with GCC-NMF. ISCA Proceedings, 2665--2669. (Published).
  • Wood* S, Rouat J. (2017). Real-Time Speech Enhancement with GCC-NMF: Demonstration on the Raspberry Pi and NVIDIA Jetson. proceedings of INTERSPEECH, 2048--2049. (Published).
  • Wood* S, Rouat J. (2017). Towards GCC-NMF Speech Enhancement for Hearing Assistive Devices: Reducing Latency with Asymmetric Windows. Proceedings of the CHAT conf., 83 -- 88. (Published).
  • Chanauria* N, Bharmauria* V, Bachatène L, Cattan S, Etindele-Sosso F, Rouat J, Molotchnikoff S. (2016). Intriguing! Auditory stimulus shifts orientation selectivitity of visual neurons in cat V1. Society for Neuroscience Meeting, 434.08 / SS16. (Published).
  • Séguin-Godin* G, Mailhot F, Rouat J. (2015). Efficient event-driven approach using synchrony processing for hardware spiking neural networks. Proceedings of IEEE-ISCAS, 2696-2699. (Published).
  • Siahpoush* S, Erfani* Y, Rode T, Lim H, Rouat J, Plourde E. (2015). Improving neural decoding in the central auditory system using bio-inspired spectro-temporal representations and a generalized bilinear model. proceedings of the IEEE EMBS, 5146-5150. (Published).
  • Rouat J, Brodeur* S, Plourde E. (2014). Auditory object feature maps with a hierarchical network of independent components?. BMC Neuroscience, BioMed Central Ltd, 2014, 15, 66. (Published).
  • Rouat J, Lescal* D, Wood* S. (2014). Handheld device for substitution from vision to audition. Proceedings ICAD, (Published).
  • Adeli* M, Rouat J, Molotchnikoff S. (2014). On the importance of correspondence between shapes and timbre. Proceedings of ICAD, (Published).
  • Erfani* Y, Pichevar R, Rouat, J. (2013). Audio tampering localization using modified iss watermarking in sparse-domain. Proceedings of the IEEE GlobalSIP, 249 - 252. (Published).
  • Lescal* D, Rouat J, Voix J. (2013). Sensorial substitution system from vision to audition using transparent digital earplugs. Proceedings of Meetings on Acoustics, Journal of the Acoustical Society of America, Vol. 19, nb 1, 1.4799670. (Published).
  • Seyedin* S, Pichevar R, Rouat J. (2012). Discriminative sparse-based Feature extraction and Dictionary Learning for Sound Classification Applications. Proceedings of ISSPA, 1330 - 1335. (Published).
  • Lescal* D, Caron* L-C, Rouat J. (2012). Neural Visual Objects Enhancement For Sensorial Substitution from Vision to Audition. IEEE Conf. Proceedings of ISSPA, 1074 - 1079. (Published).
  • Brodeur* S, Rouat J. (2012). Regulation toward Self-Organized Criticality in a Recurrent Spiking Neural Reservoir. Artificial Neural Networks and Machine Learning - ICANN2012, Volume 7552 of the Springer series LNCS, 547-554. (Published).
  • de Ladurantaye* V, Lavoie* J, Parenteau* M, Bergeron* J, Lu* H, Pichevar R, Rouat J. (2011). A Parallel Supercomputer Implementation of a Biological Inspired Neural Network and its use for Pattern Recognition. Journal of Physics: Conference Series 341 (2012) 012024, IOP Publishing, (Published).
  • Caron* L-C, Mailhot F, Rouat J. (2011). FPGA implementation of a spiking neural network for pattern matching. Proceedings of ISCAS, 649 - 652. (Published).
  • Rouat J, Loiselle* S, Molotchnikoff S. (2011). Variable Frame Rate Hierarchical Analysis for Robust Speech Recognition. Proceedings IROS, 518 - 523. (Published).

Propriétés intellectuelles

Patents

  • Rouat J, Pichevar* R, Loiselle* S, Le* T, Hoang* A, Lavoie*J, Bergeron* J. (2018). Spatio-Temporal Pattern Recognition Using A Spiking Neural Network And Processing Thereof On A Portable And/Or Distributed Computer. 8,346,692. United States of America. (Granted/Issued).
  • Rouat, J.; Caron*, L.-C; de Ladurantaye*, V., Mailhot, F.; Bergeron*, J. (2017). Method, system and aggregation engine for providing structural representations of physical entities. 2,835,701. Canada. (Granted/Issued).
  • Rouat J, Bergeron* J, Caron* LC, de Ladurantaye* V, Mailhot F. (2016). Method, system and aggregation engine for providing structural representations of physical entities. 9,317,540. United States of America. (Granted/Issued).
  • Rouat J, Pichevar* R, Loiselle* S, Le* T, Hoang* A, Lavoie*J, Bergeron* J. (2013). Spatio-Temporal Pattern Recognition Using A Spiking Neural Network And Processing Thereof On A Portable And/Or Distributed Computer. 2,642,041. Canada. (Granted/Issued).
  • Mailhot F, Séguin-Godin* G, Rouat J. Method and System for event based neural networks. PCT/CA2016/050579. United States of America. (Lapsed).

Autres contributions

Cours enseignés

  • Intelligence artificielle bio-inspirée. GEI792.
  • Intelligence artificielle probabiliste. GEI791. (2CR).
  • Neurosciences computationnelles et applications en traitement de l'information. GEI723. (3CR).
  • Sensation et Perception. GIF480. (2CR).
  • Techniques avancées en analyse, représentation et filtrage des signaux. GEI787.

Gestion d'évènements

  • Co-organizer. (2011-2022) Bi-annual NECOTIS research workshops on bridging neuroscience and engineering. (Workshop).
  • Coordinator. (2015-2018) Bi-annual workshops of the CHIST-ERA IGLU consortium. They were held 2 times/year in Europe . The first was in Lille, France in Nov. 2015, the second was in Mons, Belgium in June 2016, the next in Barcelona, Spain in December 2016, etc. (Workshop).
  • Co-organizer. (2018) Interactive Learning for Multimodal Communicative Robots, IROS 2018, Workshop, Madrid. (Workshop).
  • Coordinator. (2018) CHIST-ERA HLU, Human Language Understanding and Grounding, "Summer school" ANR Paris, France. (Seminar).
  • co-organizer. (2017) International Workshop on Grounding Language Understanding (GLU2017), KTH, Stockholm, Sweden. (Conference).
  • Co-organizer. (2014-2017) Workshops on Sonification and Sensory Substitution organized on regular bases at CIRMMT (Centre for Interdisciplinary Research in Music Media and Technology). (Seminar).

Activités de collaboration internationale

  • Director & Coordinator. Sweden. I was the coordinator and leader of the CHIST-ERA IGLU (Interactive Grounded Language Understanding) consortium that comprises 7 research teams with international reputations from 5 countries (MILA lab - UdeM; NECOTIS - UdeS; KTH, Sweden; MONS Univ., Belgium; Lille1 Univ. & INRIA Bordeaux, France; Zaragoza Univ., Spain & Sheffield Univ, UK). I am in charge of the administration, of the legal aspects, of the organization and of the academic and scientific orientations of the consortium. I am still collaborating with these partners.