Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction