{"id":78,"date":"2014-11-13T22:28:21","date_gmt":"2014-11-13T21:28:21","guid":{"rendered":"https:\/\/project.inria.fr\/seempad\/?p=78"},"modified":"2014-11-13T22:28:21","modified_gmt":"2014-11-13T21:28:21","slug":"first-experimental-setting-protocol","status":"publish","type":"post","link":"https:\/\/project.inria.fr\/seempad\/first-experimental-setting-protocol\/","title":{"rendered":"First Experimental Setting &#8211; Protocol"},"content":{"rendered":"<p><\/p>\n<div id=\"magicdomid5\" style=\"text-align: center;\"><b>AN<\/b><b> EXPERIMENT<\/b><b> <\/b><b>FOR STUDYING THE FEASIBILITY OF THE ANNOTATION\u00a0<\/b><b>OF A CORPUS OF N<\/b><b>ATURAL <\/b><b>L<\/b><b>ANGUAGE<\/b><b> ARGUMENTS WITH EMOTIONS<\/b><\/div>\n<div id=\"magicdomid7\"><\/div>\n<div id=\"magicdomid8\" style=\"text-align: center;\"><em><b>PROTOCOL &#8211; First experimental setting (<\/b><b>November<\/b><b> 2014)<\/b><\/em><\/div>\n<div id=\"magicdomid9\"><\/div>\n<div><\/div>\n<div id=\"magicdomid10\"><span style=\"text-decoration: underline;\">General goal of the first set of experiments<\/span>: Feasibility study of the annotation of a corpus of natural language arguments with emotions.<\/div>\n<div id=\"magicdomid11\"><\/div>\n<div id=\"magicdomid12\"><b><span style=\"text-decoration: underline;\">EXPERIMENT #1<\/span><\/b><b><span style=\"text-decoration: underline;\"> (<\/span><\/b>Associating arguments to workload\/engagement emotional states detected by an <i>EEG headset<\/i><i> <\/i>and facial emotions detected by a <i>Face Emotion Recognition tool<\/i>)<\/div>\n<div id=\"magicdomid13\"><\/div>\n<div id=\"magicdomid14\"><span style=\"text-decoration: underline;\">Goal:<\/span><\/div>\n<div id=\"magicdomid15\">Starting from an issue to be discussed provided by the animators, the aim of the experiment is to collect the arguments proposed by the participants and to associate such arguments to the workload\/engagement emotional states and to the facial emotions of the participants. During a post-processing phase on the collected data, we will synchronize the arguments put forward at instant <i>t <\/i>with the emotional indexes we retrieved. We will build the resulting argumentation graph for each discussion addressed by the discussion groups. These argumentation graphs will connect arguments to each others by a <i>support<\/i> or an <i>attack<\/i> relation. Finally, argumentation graphs will be labelled with the source who has proposed the argument, and the emotional state of the source itself and of the other participants at the time of the introduction of the argument in the discussion.<\/div>\n<div id=\"magicdomid16\"><\/div>\n<div id=\"magicdomid17\">Terminology:<\/div>\n<div id=\"magicdomid18\">\n<ul>\n<li>Argument: an argument is the piece of text that is proposed by the participants of the debate. Typically, arguments have the goal to promote the opinion of the debater in the debate.<\/li>\n<li>Opinion: it is the overall opinion of the debater about the issue to be debated, i.e., &#8220;Ban animal testing&#8221;. The opinion is promoted in the debate through arguments, that will support or attack the arguments proposed in the debate by the other participants (if the opinions converge then there will be a support, if the opinions diverge then there will be an attack).<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid20\"><\/div>\n<div id=\"magicdomid21\"><span style=\"text-decoration: underline;\">Topics of discussion:<\/span><\/div>\n<div id=\"magicdomid22\">Source of the issues to be debated: <a href=\"http:\/\/idebate.org\/debatabase\">http:\/\/idebate.org\/debatabase<\/a><\/div>\n<div id=\"magicdomid24\">\n<ul>\n<li>Ban animal testing [<a href=\"http:\/\/idebate.org\/debatabase\/debates\/animal-research-debate\/ban-animal-testing-junior]\">http:\/\/idebate.org\/debatabase\/debates\/animal-research-debate\/ban-animal-testing-junior<\/a>\u00a0]<\/li>\n<li>Go nuclear [<a href=\"http:\/\/idebate.org\/debatabase\/debates\/environment\/house-would-go-nuclear]\">http:\/\/idebate.org\/debatabase\/debates\/environment\/house-would-go-nuclear<\/a>\u00a0]<\/li>\n<li>Housewives should be paid for their work [<a href=\"http:\/\/idebate.org\/debatabase\/debates\/economy\/house-believes-housewives-should-be-paid-their-work]\">http:\/\/idebate.org\/debatabase\/debates\/economy\/house-believes-housewives-should-be-paid-their-work<\/a>\u00a0]<\/li>\n<li>Religion does more harm than good [<a href=\"http:\/\/idebate.org\/debatabase\/debates\/religion\/house-believes-religion-does-more-harm-good]\">http:\/\/idebate.org\/debatabase\/debates\/religion\/house-believes-religion-does-more-harm-good<\/a>\u00a0]<\/li>\n<li>Advertising is harmful [<a href=\"http:\/\/idebate.org\/debatabase\/debates\/culture\/house-believes-advertising-harmful]\">http:\/\/idebate.org\/debatabase\/debates\/culture\/house-believes-advertising-harmful<\/a>\u00a0]<\/li>\n<li>Hold students legally responsible for bullying if it resulted in the victim&#8217;s death [<a href=\"http:\/\/idebate.org\/debatabase\/debates\/law-crime\/house-would-hold-students-legally-responsible-bullying-if-it-resulted-victims-death]\">http:\/\/idebate.org\/debatabase\/debates\/law-crime\/house-would-hold-students-legally-responsible-bullying-if-it-resulted-victims-death<\/a>\u00a0]<\/li>\n<li>Distribute condoms in schools [<a href=\"http:\/\/idebate.org\/debatabase\/debates\/health\/house-would-distribute-condoms-schools-junior]\">http:\/\/idebate.org\/debatabase\/debates\/health\/house-would-distribute-condoms-schools-junior<\/a>\u00a0]<\/li>\n<li>Encourage fewer people to go to university [<a href=\"http:\/\/idebate.org\/debatabase\/debates\/education\/education-general\/house-would-encourage-fewer-people-go-university]\">http:\/\/idebate.org\/debatabase\/debates\/education\/education-general\/house-would-encourage-fewer-people-go-university<\/a>\u00a0]<\/li>\n<li>Fear the power of government over the Internet [<a href=\"http:\/\/idebate.org\/debatabase\/debates\/politics\/should-we-fear-power-government-over-internet]\">http:\/\/idebate.org\/debatabase\/debates\/politics\/should-we-fear-power-government-over-internet<\/a>\u00a0]<\/li>\n<li>Ban partial birth abortions [<a href=\"http:\/\/idebate.org\/debatabase\/debates\/health\/house-would-ban-partial-birth-abortions]\">http:\/\/idebate.org\/debatabase\/debates\/health\/house-would-ban-partial-birth-abortions<\/a>\u00a0]<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid34\"><\/div>\n<div id=\"magicdomid35\"><span style=\"text-decoration: underline;\">Roles:<\/span><\/div>\n<div id=\"magicdomid36\">\n<ul>\n<li>Participant: he is expected to provide his own opinion about the issue of the debate proposed by the animators, and to argue with the other participants in order to convince them (in case of initial disagreement) about the goodness of his viewpoint.<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid37\">\n<ul>\n<li>Animator: he is expected to propose to the participants of the debate the initial issue to be discussed. In case of lack of active argumentation among the participants, the animator will propose pro and con arguments (with respect to the main issue) to reactivate the discussion. These pro\/con arguments are selected from a fixed set of arguments extracted from the iDebate platform.<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid38\"><\/div>\n<div id=\"magicdomid39\"><span style=\"text-decoration: underline;\">Involved people<\/span><span style=\"text-decoration: underline;\"> and location<\/span><span style=\"text-decoration: underline;\">:<\/span><\/div>\n<div id=\"magicdomid40\">\n<ul>\n<li>Participants: 4 participants for each discussion group (each participant will be placed far from the other participants, two participants will be in a room and two others in another one).<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid41\">\n<ul>\n<li>Animators: 1 animator for each discussion group (the animator will be placed in a room alone too). The moderator will interact with the participants through the debate platform.<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid42\"><\/div>\n<div id=\"magicdomid43\"><span style=\"text-decoration: underline;\">Debate platform<\/span><span style=\"text-decoration: underline;\">:\u00a0<\/span><\/div>\n<div id=\"magicdomid44\">The debate platform is available at <a href=\"http:\/\/webchat.freenode.net\/\">http:\/\/webchat.freenode.net\/<\/a> (IRC network). It is sufficient to connect to that webpage, select the nickname (participant1, participant2, etc), select channel #seempadDebate1.<\/div>\n<div id=\"magicdomid45\"><em>If a user interface is preferred, we suggest to use Pidgin (<a href=\"https:\/\/www.pidgin.im\/\">https:\/\/www.pidgin.im\/<\/a> ). Instructions to use Pidgin on the network Freenode: <a href=\"https:\/\/freenode.net\/irc_servers.shtml\">https:\/\/freenode.net\/irc_servers.shtml<\/a><\/em><\/div>\n<div id=\"magicdomid46\"><\/div>\n<div id=\"magicdomid47\"><span style=\"text-decoration: underline;\">Devices for participants:<\/span><\/div>\n<div id=\"magicdomid48\">\n<ul>\n<li>1 laptop or 1 desktop device equipped with internet access and camera to detect facial emotions.<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid49\">\n<ul>\n<li>1 EEG headset (associated to engagement\/workload indexes detection system).<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid50\"><\/div>\n<div id=\"magicdomid51\"><span style=\"text-decoration: underline;\">Devices for animatiors:<\/span><span style=\"text-decoration: underline;\">\u00a0<\/span><\/div>\n<div id=\"magicdomid52\">\n<ul>\n<li>1 laptop or 1 desktop device equipped with internet access<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid53\"><\/div>\n<div id=\"magicdomid54\"><span style=\"text-decoration: underline;\">Procedure:<\/span><\/div>\n<div id=\"magicdomid55\">\n<ul>\n<li><strong>Phase 1<\/strong>:\u00a0 Familiarization of the participants with the debate platform;<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid56\">\n<ul>\n<li><strong>Phase 2<\/strong>: Debate &#8211; participants will be submitted to two debates for a maximum of 30 minutes<\/li>\n<li>The animator provides the debaters with the topic to be discussed;<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid58\">\n<ul>\n<li>The animator asks each participant to provide a general statement about his\/her opinion concerning the topic;<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid59\">\n<ul>\n<li>Each participant expose his\/her opinion to the others;<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid60\">\n<ul>\n<li>Participants are asked to comment on the expressed opinions;<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid61\">\n<ul>\n<li>If needed (no debate among the participants), the animator posts an argument to be commented;<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid62\">\n<ul>\n<li><strong>Phase 3<\/strong>: Debriefing<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid63\">\n<ul>\n<li>Each participant is asked to complete a short questionnaire about his experience in the debate<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid64\">\n<ul>\n<li>What was your starting opinion about the discussed topic before entering into the debate?<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid65\">\n<ul>\n<li>What is your final opinion about the discussed topic after the debate?<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid66\">\n<ul>\n<li>If so, why did you change your mind (i.e., which was the argument(s) that has made you change your mind)?<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid67\"><\/div>\n<div id=\"magicdomid68\"><span style=\"text-decoration: underline;\">Duration of a debate:<\/span> about 15 minutes.<\/div>\n<div id=\"magicdomid69\"><\/div>\n<div id=\"magicdomid70\"><span style=\"text-decoration: underline;\">Measured variables:<\/span><\/div>\n<div id=\"magicdomid89\">\n<ul>\n<li>engagement (measurement tool: EEG headset)<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid90\">\n<ul>\n<li>workload (measurement tool: EEG headset)<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid91\">\n<ul>\n<li>positive\/negative attitude with respect to the issue of the debate (technique: argumentation)<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid92\">\n<ul>\n<li>positive\/negative attitude with respect to a particular argument proposed in the discussion (technique: argumentation)<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid93\">\n<ul>\n<li>positive\/negative attitude with respect to a particular participant of the discussion (technique: argumentation)<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid95\">\n<ul>\n<li>emotions: (Neutral, Happy, Sad, Angry, Surprised, Scared and Disgusted) (measurement tool: FaceReader software Emotion Recognition from facial expression)<\/li>\n<\/ul>\n<\/div>\n<div id=\"magicdomid77\"><\/div>\n<div id=\"magicdomid78\"><i><span style=\"text-decoration: underline;\">Post-processing phase:<\/span><\/i><\/div>\n<div id=\"magicdomid79\">\n<ol start=\"1\">\n<li>Synchronize the argumentation (i.e., the arguments proposed at time <i>t<\/i>) with the emotional indexes retrieved using the EEG headset and the Facial Emotion Recognition.<\/li>\n<\/ol>\n<\/div>\n<div id=\"magicdomid80\">\n<ol start=\"2\">\n<li>Build the argumentation graph detecting support and attack relations among the arguments proposed in each discussion (using methodology defined in [Cabrio&amp;Villata, Argument&amp;Computation 2013]);<\/li>\n<\/ol>\n<\/div>\n<div id=\"magicdomid81\">\n<ol start=\"3\">\n<li>Associate each argument to the participant who proposed it in the discussion;<\/li>\n<\/ol>\n<\/div>\n<div id=\"magicdomid82\">\n<ol start=\"4\">\n<li>Build a data set of argumentation graphs labelled with the emotional indexes of the participants (each argument is associated to the indexes of the four participants of the debate);<\/li>\n<\/ol>\n<\/div>\n<div id=\"magicdomid83\">\n<ol start=\"5\">\n<li>Compute the &#8220;winning&#8221; opinions in each debate.<\/li>\n<\/ol>\n<\/div>\n<p><\/p>","protected":false},"excerpt":{"rendered":"<p>AN EXPERIMENT FOR STUDYING THE FEASIBILITY OF THE ANNOTATION\u00a0OF A CORPUS OF NATURAL LANGUAGE ARGUMENTS WITH EMOTIONS PROTOCOL &#8211; First experimental setting (November 2014) General goal of the first set of experiments: Feasibility study of the annotation of a corpus of natural language arguments with emotions. EXPERIMENT #1 (Associating arguments to workload\/engagement emotional states detected &hellip; <\/p>\n<p><a class=\"more-link btn\" href=\"https:\/\/project.inria.fr\/seempad\/first-experimental-setting-protocol\/\">Continue reading<\/a><\/p>\n","protected":false},"author":22,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5,7],"tags":[],"class_list":["post-78","post","type-post","status-publish","format-standard","hentry","category-devices","category-experiment","item-wrap"],"_links":{"self":[{"href":"https:\/\/project.inria.fr\/seempad\/wp-json\/wp\/v2\/posts\/78","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/project.inria.fr\/seempad\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/project.inria.fr\/seempad\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/project.inria.fr\/seempad\/wp-json\/wp\/v2\/users\/22"}],"replies":[{"embeddable":true,"href":"https:\/\/project.inria.fr\/seempad\/wp-json\/wp\/v2\/comments?post=78"}],"version-history":[{"count":3,"href":"https:\/\/project.inria.fr\/seempad\/wp-json\/wp\/v2\/posts\/78\/revisions"}],"predecessor-version":[{"id":81,"href":"https:\/\/project.inria.fr\/seempad\/wp-json\/wp\/v2\/posts\/78\/revisions\/81"}],"wp:attachment":[{"href":"https:\/\/project.inria.fr\/seempad\/wp-json\/wp\/v2\/media?parent=78"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/project.inria.fr\/seempad\/wp-json\/wp\/v2\/categories?post=78"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/project.inria.fr\/seempad\/wp-json\/wp\/v2\/tags?post=78"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}