外文翻译 《回归测试研究》李建国.docx
《外文翻译 《回归测试研究》李建国.docx》由会员分享,可在线阅读,更多相关《外文翻译 《回归测试研究》李建国.docx(9页珍藏版)》请在冰豆网上搜索。
![外文翻译 《回归测试研究》李建国.docx](https://file1.bdocx.com/fileroot1/2022-12/7/06e4b9c9-4799-41e5-a08f-2a5aacf4a217/06e4b9c9-4799-41e5-a08f-2a5aacf4a2171.gif)
外文翻译《回归测试研究》李建国
STUDYPAPERONTESTCASEGENERATIONFORGUIBASEDTESTING
Sourceby:
PGResearchScholar,SoftwareEngineeringGroup,SchoolofComputerScienceandtechnology,karunyauniversity,coimbatore,Indiaaisabella20@
Head-ComputertechnologyCentre,KarunyaUniversity,Coimbatore,India
emiretna@
ABSTRACT
WiththeadventofWWWandoutburstintechnologyandsoftwaredevelopment,testingthesoftwarebecameamajorconcern.Duetotheimportanceofthetestingphaseinasoftwaredevelopmentlifecycle,testinghasbeendividedintographicaluserinterface(GUI)basedtesting,logicaltesting,integrationtesting,etc.GUITestinghasbecomeveryimportantasitprovidesmoresophisticatedwaytointeractwiththesoftware.ThecomplexityoftestingGUIincreasedovertime.Thetestingneedstobeperformedinawaythatitprovideseffectiveness,efficiency,increasedfaultdetectionrateandgoodpathcoverage.Tocoverallusecasesandtoprovidetestingforallpossible(success/failure)scenariosthelengthofthetestsequenceisconsideredimportant.IntentofthispaperistostudysometechniquesusedfortestcasegenerationandprocessforvariousGUIbasedsoftwareapplications.
KEYWORDS
GUITesting,Model-BasedTesting,TestCase,AutomatedTesting,EventTesting.
1.INTRODUCTION
GraphicalUserInterface(GUI)isaprograminterfacethattakesadvantageofthecomputer'sgraphicscapabilitiestomaketheprogrameasiertouse.GraphicalUserInterface(GUI)providesuseranimmensewaytointeractwiththesoftware[1].ThemosteminentandessentialpartsofthesoftwarethatisbeingusedtodayareGraphicalUserInterfaces(GUIs)[8],[9].EventhoughGUIsprovidesuseraneasywaytousethesoftware,theymakethedevelopmentprocessofthesoftwaretangled[2].Graphicaluserinterface(GUI)testingistheprocessoftestingsoftware'sgraphicaluserinterfacetosafeguarditmeetsitswrittenspecificationsandtodetectifapplicationisworkingfunctionallycorrect.GUItestinginvolvesperformingsometasksandcomparingtheresultwiththeexpectedoutput.Thisisperformedusingtestcases.GUITestingcanbeperformedeithermanuallybyhumansorautomaticallybyautomatedmethods.
Manualtestingisdonebyhumanssuchastestersordevelopersitselfinsomecasesanditisoftenerrorproneandtherearechancesofmostofthetestscenariosleftout.Itisverytimeconsumingalso.AutomatedGUITestingincludesautomatingtestingtasksthathavebeendonemanuallybefore,usingautomatedtechniquesandtools.AutomatedGUItestingismore,efficient,precise,reliableandcosteffective.Atestcasenormallyconsistsofaninput,output,expectedresultandtheactualresult.MorethanonetestcaseisrequiredtotestthefullfunctionalityoftheGUIapplication.Acollectionoftestcasesarecalledtestsuite.Atestsuitecontainsdetailedguidelinesorobjectivesforeachcollectionoftestcases.ModelBasedTesting(MBT)isaquickandorganizedmethodwhichautomatesthetestingprocessthroughautomatedtestsuitegenerationandexecutiontechniquesandtools[11].ModelbasedtestingusesthedirectedgraphmodeloftheGUIcalledevent-interactiongraph(EIG)[4]andeventsemanticinteractiongraph(ESIG).Eventinteractiongraphisarefinementofeventflowgraph(EFG)[1].EIGcontainseventsthatinteractwiththebusinesslogicoftheGUIapplication.EventSemanticInteraction(ESI)isusedtoidentifysetofeventsthatneedtobetestedtogetherinmulti-wayinteractions[3]anditismoreusefulwhenpartitioningtheeventsaccordingtoitsfunctionality.Thispaperisorganizedasfollow:
Section2providessometechniques,algorithmsusedtogeneratetestcases,amethodtorepairtheinfeasibletestsuitesaredescribedinsection3,GUItestingonvarioustypesofsoftwaresorunderdifferentconditionsareelaboratedinsection4,section5describesabouttestingtheGUIapplicationbytakingeventcontextintoconsiderationandlastsectionconcludesthepaper.
2.TESTCASEGENERATION
2.1.UsingGUIRun-TimeStateasFeedback
XunYuanandAtifMMemon[3],usedGUIruntimestateasfeedbackfortestcasegenerationandthefeedbackisobtainedfromtheexecutionofaseedtestsuiteonanApplicationUnderTest(AUT).ThisfeedbackisusedtogenerateadditionaltestcasesandtestinteractionsbetweenGUIeventsinmultipleways.AnEventInteractionGraph(EIG)isgeneratedfortheapplicationtobetestedandseedtestsuitesaregeneratedfortwo-wayinteractionsofGUIevents.ThenthetestsuitesareexecutedandtheGUI’sruntimestateisrecorded.ThisrecordedGUIruntimestateisusedtoobtainEventSemanticInteraction(ESI)relationshipfortheapplicationandtheseESIareusedtoobtaintheEventSemanticInteractionGraph(ESIG).ThetestcasesaregeneratedandESIGsiscapableofmanagingtestcasesformorethantwo-wayinteractionsandhenceforth2-,3-,4-,5-wayinteractionsaretested.Thenewlygeneratedtestcasesaretestedandadditionalfaultsaredetected.ThesestepsareshowninFigure1.Thefaultdetectioneffectivenessishighthanthetwowayinteractionsanditisbecause,testcasesaregeneratedandexecutedforcombinationofeventsindifferentexecutionorders.
Therealsosomedisadvantagesinthisfeedbackmechanism.ThismethodisdesignedfocusingonGUIapplications.ItwillbedifferentforapplicationsthathaveintricateunderlyingbusinesslogicandasimpleGUI.Asmulti-wayinteractionstestcasesaregenerated,largenumberoftestcaseswillbegenerated.Thisfeedbackmechanismisnotautomated.
2.2.UsingCoveringArrayTechnique
XunYuanetal[4],proposedanewautomatedtechniquefortestcasegenerationusingcoveringarrays(CA)forGUItesting.Usually2-waycoveringareusedfortesting.Becauseasnumberofeventsinasequenceincreases,thesizeoftestsuitegrowslarge,preventingfromusingsequenceslongerthan3or4.Butcertaindefectsarenotdetectedusingthiscoveragestrength.Usingthistechniquelongtestsequencesaregeneratedanditissystematicallysampledatparticularcoveragestrength.Byusingcoveringarrayst-waycoveragestrengthisbeingmaintained,butanylengthtestsequencescanbegeneratedofatleastt.Acoveringarray,CA(N;t,k,v),isanN×karrayonvsymbolswiththepropertythateveryN×tsub-arraycontainsallorderedsubsetsofsizetofthevsymbolsatleastonce.
AsshowninFigure2,InitiallyEIGmodeliscreatedwhichisthenpartitionedintogroupsofinteractingeventsandthenconstraintsareidentifiedandusedtogenerateabstractmodelfortesting.Longtestcasesaregeneratedusingcoveringarraysampling.Eventsequencesaregeneratedandexecuted.Ifanyeventinteractionismissed,thenregeneratetestcasesandrepeatthesteps.Thedisadvantagesareeventpartitionandidentifyingconstraintsaredonemanually.
2.3.DynamicAdaptiveAutomatedtestGeneration
XunYuanetal[5],suggestedanalgorithmtogeneratetestsuiteswithfewerinfeasibletestcasesandhighereventinteractioncoverage.DuetodynamicstatebasednatureofGUIs,itisnecessaryandimportanttogeneratetestcasesbasedonthefeedbackfromtheexecutionoftests.Theproposedframeworkusestechniquesfromcombinatorialinteractiontestingtogeneratetestsandbasisforcombinatorialinteractiontestingisacoveringarray.InitiallysmoketestsaregeneratedandthisisusedasaseedtogenerateEventSemanticInteraction(ESI)relationships.EventSemanticInteractionGraphisgeneratedfromESI.Iterativerefinementisdonethroughgeneticalgorithm.AninitialmodeloftheGUIeventinteractionsandaninitialsetoftestsequencesbasedonthemodelaregenerated.Thenabatchoftestcasesaregeneratedandexecuted.Codecoverageisdeterminedandunexecutabletestcasesareidentified.Oncetheinfeasibletestcasesareidentified,itisremovedandthemodelisupdatedandnewbatchoftestcasesaregeneratedandthestepsarefollowedtillalltheuncoveredESIrelationshipsarecovered.TheseautomatedtestcasegenerationprocessisshowninFigure3.ThisautomatedtestgenerationalsoprovidesvalidationforGUIs.
Thedisadvantagesareeventcontextsarenotincorporatedandneedcoverageandtestadequacycriteriatocheckhowtheseimpactsfaultdetection.
2.REPAIRINGTESTSUITES
SiHuangetal[6],proposedamethodtorepairGUItestsuitesusingGeneticalgorithm.NewtestcasesaregeneratedthatarefeasibleandGeneticalgorithmisusedtodeveloptestcasesthatprovideadditionaltestsuitecoveragebyremovinginfeasibletestcasesandinsertingnewfeasibletestcases.Aframeworkisusedtoautomaticallyrepairinfeasibletestcases.AgraphmodelsuchasEFG,EIG,ESIGandtherippedGUIstructureareusedasinput.ThemaincontrollerpassestheseinputstothetestcaseassemblerwhichthenpassestheESIGmodeltothecoveringarraygeneratoralongwiththestrengthoftesting.Thiscoveringarraygeneratorgeneratesaninitialsetofeventsequences.Thecoveringarrayinformationissendtotestcaseassembleranditassemblesthisintoconcretetestcases.Thesearepassedbacktothecontrollerandtestsuiterepairphasebegins.Feasibletestcasesarereturnedbytheframeworkoncetherepairphaseiscomplete.Geneticalgorithmisusedasarepairalgorithm.Aninitialsetoftestcasesareexecutedandifthereisnoinfeasibletestcases,itexitsandisdone.Ifinfeasibletestcasesarepresent,itthenbeginstherepairphase.Acertainnumberofiterationsaresetbasedonanestimateofhowlargetherepairedtestsuitewillbeallowedtogrowandforeachiterationthegeneticalgorithmisexecuted.Thealgorithmaddsbesttestcasetothefinaltestsuites.