Ubiquitous emotionaware computing.docx

Ubiquitous emotionaware computing.docx

《Ubiquitous emotionaware computing.docx》由会员分享，可在线阅读，更多相关《Ubiquitous emotionaware computing.docx（34页珍藏版）》请在冰豆网上搜索。

Ubiquitousemotionawarecomputing

Ubiquitousemotion-awarecomputing

Egon L. vanden Broek1,2,3  

（1）

Human-CenteredComputingConsultancy,Vienna,Austria

（2）

HumanMediaInteraction（HMI）,FacultyofElectricalEngineering,Mathematics,andComputerScience,UniversityofTwente,P.O.Box217,7500AE Enschede,TheNetherlands

（3）

KarakterUniversityCenter,RadboudUniversityMedicalCenter（UMC）Nijmegen,P.O.Box9101,6500HB Nijmegen,TheNetherlands

Egon L. vanden Broek

Email:

vandenbroek@acm.org

URL:

http:

//www.human-

Received:

25 February 2011Accepted:

17 August 2011Publishedonline:

15 October 2011

© TheAuthor（s） 2011

Abstract

Emotionsareacrucialelementforpersonalandubiquitouscomputing.Whattosenseandhowtosenseit,however,remainachallenge.Thisstudyexplorestherarecombinationofspeech,electrocardiogram,andarevisedSelf-AssessmentMannequintoassesspeople’semotions.40peoplewatched30InternationalAffectivePictureSystempicturesineitheranofficeoraliving-roomenvironment.Additionally,theirpersonalitytraitsneuroticismandextroversionanddemographicinformation（i.e.,gender,nationality,andlevelofeducation）wererecorded.Theresultingdatawereanalyzedusingbothbasicemotioncategoriesandthevalence--arousalmodel,whichenabledacomparisonbetweenbothrepresentations.Thecombinationofheartratevariabilityandthreespeechmeasures（i.e.,variabilityofthefundamentalfrequencyofpitch（F0）,intensity,andenergy）explained90%（p<.001）oftheparticipants’experiencedvalence--arousal,with88%forvalenceand99%forarousal（ps<.001）.Thesixbasicemotionscouldalsobediscriminated（p<.001）,althoughtheexplainedvariancewasmuchlower:

18–20%.Environment（orcontext）,thepersonalitytraitneuroticism,andgenderprovedtobeusefulwhenanuancedassessmentofpeople’semotionswasneeded.Takentogether,thisstudyprovidesasignificantleaptowardrobust,generic,andubiquitousemotion-awarecomputing.

Keywords

UbiquitouscomputingEmotionUnobtrusivesensingSpeechfeaturesHeartratevariabilityPersonality

1Introduction

Ithasbeen40yearssinceSkinner[88]said:

Theapplicationofthephysicalandbiologicalsciencesalonewillnotsolveourproblemsbecausethesolutionslieinanotherfield.…Itisnotenoughto“usetechnologywithadeeperunderstandingofhumanissues,”orto“dedicatetechnologytoman’sspiritualneeds,”orto“encouragetechnologiststolookathumanproblems.”…Whatweneedisatechnologyofbehavior.…Butabehavioraltechnologycomparableinpowerandprecisiontophysicalandbiologicaltechnologyislacking…（p.4–5）.

SinceSkinner’swords[88],muchhaschanged,butevenmorehasnot.Ontheonehand,phenomenaofprivateexperience,whethertheybecharacterizedasmentaloremotional,consciousorunconscious,areinaccessibletodirectpublicobservation;theactionsoflivingorganisms,ontheotherhand,canbeobserveddirectlyandstudiedinrelationtoantecedentconditionsinthesamewayasthephenomenatreatedinothersciences（p.3）[72].Thiswasthecasefourdecadesago,andstillisthecase,despitetheimpressiveprogressofcognitivesciencesandneuroscience[85]（e.g.,brainimagingtechniques[60,104]andbrain--computerinterfaces[8,17,91]）.Ontheotherhand,technologiesrangingfrombiosensorstorobotshavebecomesmaller,evenminiaturized[70],andcanbeintegratedintovirtuallyallproducts（e.g.,clothes[89]orourhomes[101]）.Consequently,newbranchesofscienceandengineeringhaveemerged,suchaspersonalandubiquitouscomputing（UbiComp）[50],ambientintelligence（AmI）[20],pervasivecomputing[12]）,wearablecomputing[2],andtheInternetofThings[34,48]（alsoknownasphysicalcomputing,hapticcomputing,andthingsthatthink）.

ThetruepotentialoftheemergingbranchesofsciencesuchasUbiCompandAmIismorethananengineeringparadigm.Theenvisionedsystemscanonlyberealizedifhumanbehaviorcanalsobeanalyzedautomatically.Subsequently,theresultingknowledgecanbeutilizedfortheintegrationofhumans’inputsandoutputswiththoseoftheirmedia.Thisyieldsintuitivecomputingandbringsustooneofitscorenotions:

（human）emotions.Thishaslongbeenacceptedbypsychologistsbuthasonlybeenembracedbyscienceandengineering,sincePicard’sbookAffectiveComputingin1997[79].Asaresult,ambientsensingofemotions[97],emotion-awareconsumerproducts[96],andaffectiveinteraction[31]havebeenproposed.Thisiswhatthisarticlewillbeabout.

Emotionscanbetransmittedeitherovertly（e.g.,bytheface,thebody,orthevoice）,covertly（e.g.,biosignals）,orinacombinationofboth[26].Ontheonehand,thecomplexnatureofemotionisillustratedbytheabsenceofanintegralmodelof（human）emotions（cf.[26]）.S