Mohammad Ali Zamani

Mohammad Ali Zamani

Senior Machine Learning Applied Scientist

HITeC

Biography

I am a Senior Machine Learning Applied Scientist at Hamburg Informatics Technology Center (HITeC) and a Research Associate at University of Hamburg. I am passionate to find scalable solutions based on deep learning for industrial problems. My research focus has been on deep (reinforcement) learning including explainability and its applications in robotics, dialogue management systems, and planning. I am also interested in AutoML as a path to reach a scalable artificial intelligence solution.

Interests
  • Deep Reinforcement Learning
  • Computer Vision
  • Natural Language Processing
  • Explainable AI
  • AutoML
Education
  • Ph.D. Fellow in Computer Science

    University of Hamburg, Germany

  • M.Sc. in Computer Science, 2015

    Ozyegin University, Istanbul, Turkey

  • B.Sc. in Electrical Engineering (Major of Control Engineering), 2009

    University of Tehran, Iran

Experience

 
 
 
 
 
Senior Machine Learning Applied Scientist
Jul 2021 – Present Hamburg, Germany
  • Project lead on depth estimation from monocular and 360 images using deep learning.
  • Deep learning consultant for our partner companies.
  • Developing explainable AI approaches to emergency-landing for drones.
 
 
 
 
 
Machine Learning Applied Scientist
Jul 2019 – Jun 2021 Hamburg, Germany
  • Developed deep learning models to estimate device measurements from images.
  • Developed deep learning models to detect defects on products from images.
  • Developed depth estimation models from monocular images using deep learning.
  • Presenting workshops and tutorials about deep learning and AutoML.
 
 
 
 
 
Research Associate
May 2016 – Apr 2019 Hamburg, Germany
  • Developing state representation for DRL in action planning.
  • Developed DRL for visuomotor and dynamics in robots.
  • Developed low-latency continuous emotion recognition using DRL.
  • Improved robustness of emotion recognition on robots by incorporating spoken language and data augmentation.
  • Worked on personalized dialogue systems with dynamic preference using deep reinforcement learning.
 
 
 
 
 
PhD internship
Oct 2018 – Nov 2018 Stuttgart, Germany
Developed a simulation compatible with deep reinforcement learning (DRL) for the rob@work robot in the Gazebo simulator.
 
 
 
 
 
Research Assistant
Sep 2012 – Sep 2015 Istanbul, Turkey
Introduced a new framework for real-time learning-by-demonstration. A robot in coupled dynamical systems with the human demonstrator learns to perform the task in real-time.
 
 
 
 
 
Research Assistant
University of Tehran
Jul 2009 – Aug 2012 Tehran, Iran

In cooperation with the Greater Tehran Electrical Distribution Company:

  • Developed expert system to adjust the level of automation using machine learning algorithms (especially, neural network).
  • Proposed decision-making approach for IT infrastructure selection in the smart grid.
  • Implemented a fault diagnosis in smart grids using neural networks.

Recent Publications

Quickly discover relevant content by filtering publications.
Deep reinforcement learning using compositional representations for performing instructions
Incorporating End-to-End Speech Recognition Models for Sentiment Analysis
Neural End-to-End Learning of Reach for Grasp Ability with a 6-DoF Robot Arm
On the Robustness of Speech Emotion Recognition for Human-Robot Interaction with Deep Neural Networks
Language-modulated Actions using Deep Reinforcement Learning for Safer Human-Robot Interaction
Learning Spatial Representation for Safe Human-Robot Collaboration in Joint Manual Tasks
EmoRL: Real-time Acoustic Emotion Classification using Deep Reinforcement Learning

Teaching and Advising

Advisor

  • MSc Thesis: Explaining Deep Reinforcement Learning policies via Reward Decomposition
  • MSc Thesis: Adapting to User Context in a Reinforcement Learning-based Dialogue System
  • MSc Thesis: Reinforcement Learning for Incremental Dialogue Management
  • MSc Thesis: Knowledge Extraction from API Reference Documentation Using Deep Learning
  • Seminar Project: Deep Reinforcement Learning for Playing Games
  • Seminar Project: Playing Text-based games with Deep Reinforcement Learning
  • Seminar Project: Helping a Deep Reinforcement Learning Agent with Natural Language Instructions to Play a Video Game

TAship

  • Introduction to Machine Learning & Artificial Neural Networks, Ozyegin University, Spring 2013, Spring 2014, and Spring 2015.
  • Introduction to Programming (Matlab), Fall 2014
  • Discrete Mathematics, Ozyegin University, Fall 2014
  • Computer Programming (Java),Ozyegin University ,Spring 2014
  • Data Acquisition and Digital Control, Ozyegin University, Fall 2013,
  • Introduction to Robot Programming, Ozyegin University, Spring 2013
  • Physics Lab, Ozyegin University, Fall 2012, Fall 2014 Spring 2015
  • Electrical Machine laboratory, University of Tehran, Spring 2009-10
  • Programming for Mathematics and Statistics, Spring 2009
  • Electrical Machine I, University of Tehran, Fall 2009

Trainings and Summer Schools

  • Gaussian Process Summer Schools: Gaussian Process, Bayesian Optimization, Kernel Design, Deep GP, Sheffield, UK Sep. 2019

  • ACAI Summer School on Reinforcement Learning: Temporal Abstraction, Deep RL, Multi-Agent, Off Policy RLs, Nieuwpoort, Belgium Oct. 2017

  • Winter School on Humanoid Robot Programming: ROS, YARP, Kinematics, Dynamics, Vision, Santa Margherita Ligure, Italy Feb. 2017

  • Robot Workshop: ROS, LBR iiwa KUKA and Care-O-Bot programming, Stuttgart, Germany Dec. 2016

  • KUKA robot Training: KUKA Simulation Software, Istanbul, Turkey Jan. 2014

Awards

  • Gaussian Process Summer Schools Travel grant - MCAA EU Commission Sep. 2019
  • Marie SkIodowska-Curie Fellowship - SECURE Project 2016-2019
  • ICRA 2018 PhD forum travel grant award May 2018
  • Accepted project to “Science is Wonder-ful! - European Researchers’ Night” event Sep. 2018

Recent Talks and Workshops

Contact