This paper examines the effect of physiological asymmetry on affective stimuli. Particularly, this study aims to investigate the efficacy of inter-hemispheric asymmetry for recognizing human emotions while walking in a building. Causal and temporal asymmetry over the frontal cortex are analyzed empirically. The results suggest that the temporal asymmetry of causal dependence at shorter time scale keeps its asymmetry under contamination of motion artifacts. Further, information asymmetry in motion affects the relationship between hemispheric activation and emotional reactivity. The key contribution of this work is to provide an empirical study of how brain asymmetry is influenced by motion artifacts generated in real-life experiments.