To represent complex human emotional expressions Various Dimensional models has been used. Activation and valence are two common dimensions in such models. They can be used to describe certain emotions. This project proposes to recognise emotion of humans. Using multitask learning frame work which uses Thermal images. Thermal imaging is an efficient technology to detect the deception of the person (subject) during the enquiry or interview and it saves time. Dimensional models have been proposed in psychology studies to represent complex human emotional expressions. Two common dimensions in such models are Activation and valence. They can be used to describe certain emotions. This project proposes to recognize emotion of humans. Using multitask learning frame work which uses Thermal images [5]. We report an 87% ability to predict the lie/truth responses based on a within-person methodology and fivefold cross validation. Our results also show that the between person approach for modelling deception does not generalize very well across the training data. © 2017 Elsevier B.V., All rights reserved.