提升大型网站并发访问性能Enhancing concurrent access performance of large websites.docx

提升大型网站并发访问性能Enhancing concurrent access performance of large websites.docx

《提升大型网站并发访问性能Enhancing concurrent access performance of large websites.docx》由会员分享，可在线阅读，更多相关《提升大型网站并发访问性能Enhancing concurrent access performance of large websites.docx（5页珍藏版）》请在冰豆网上搜索。

提升大型网站并发访问性能Enhancingconcurrentaccessperformanceoflargewebsites

提升大型网站并发访问性能（Enhancingconcurrentaccessperformanceoflargewebsites）

Asmallwebsite,youcanusetheHTMLstaticpagethemostsimplerealization,withsomepicturestobeautifytheeffect,allofthepagesarestoredinadirectory,thewebsiterequirementsonthesystemstructure,theperformanceisverysimple.WiththeInternetbusinessandconstantlyenrichthewebrelatedtechnologyafteryearsofdevelopment,hasbeensubdividedintoveryfineaspects,especiallyforlargewebsites,thetechnologyisverywide,fromhardwaretosoftware,programminglanguage,database,WebServer,firewallandotherfieldshaveaveryhighdemand,isnottheoriginalsimplestaticHTMLwebsitecanbecompared.

Largesites,suchasportals,requestsinthefaceofalargenumberofuseraccess,highconcurrency,thebasicsolutionconcentratedinthefollowingaspects:

theuseofhighperformanceserver,highperformanceandhighefficiencyofthedatabaseprogramminglanguage,andhighperformanceWebcontainer.Thesesolutions,tosomeextent,meangreaterinvestment.

1,HTMLstatic

Infact,weallknow,thehighestefficiencyandtheminimumconsumptionispurestaticHTMLpages,sowemakeourwebsitepagestaticpagetoachievethemostsimplemethodisthemosteffectivemethod.Butforalotofcontentandfrequentupdatestothesite,wecanallgoonebyonetoachievemanuallysothere,ourcommoninformationsystemCMS,aswevisitedeachportalsitenewschannel,eventheyarethroughotherchannels,informationreleasesystemtomanageandrealizetheinformationreleasesystemcanrealizethemostsimpleinformationinputcanautomaticallygeneratestaticpages,withchannelmanagement,authoritymanagement,automaticcaptureandotherfunctions,foralargesite,hasasetofefficientandmanageableCMSisessential.

Inadditiontotheportalandinformationreleasetypewebsite,forcommunitywebsiteinteractivitydemanding,asfaraspossiblestaticisanecessarymeanstoimprovetheperformanceofthecommunityinthepost,thestaticandreal-timeupdateswhenrestaticalsousealotofstrategies,likeMop'saistheuseofsuchastrategy,soisthecommunityNetEase.

Atthesametime,HTMLstaticisalsoameansofusingsomecachepolicies.Fortheapplicationsthatfrequentlyusedatabasequeriesinthesystem,butthecontentupdatesareverysmall,wecanconsiderusingHTMLstatictoimplement.Forexample,inthepublicforumforumsetinformation,thisinformationcanbethemainstreamofthecurrentforummanagementbackgroundandstoredinthedatabase,thisinformationisactuallyalotinfrontoftheprogramcall,buttheupdatefrequencyisverysmall,canbeconsideredtobepartofthecontentsofthisbackgroundwhenthestatic,thusavoidingalargenumberofdatabaseaccessrequest.

2,thepictureserverseparation

Youknow,totheWebserver,whetheritisApacheorIISorothercontainers,thepictureistheconsumptionofresources,soitisnecessaryforustothepictureandpageseparation,whichisbasicallyalargesitewilladoptastrategy,theyareindependent,andevenalotofTaiwanimageserver.Suchanarchitecturecanreducetheserversystempressuretoprovidepageaccessrequests,andensurethatthesystemdoesnotcrashbecauseofpictureproblems.

Intheapplicationserverandimageserver,youcanconfiguredifferentoptimization,suchasApacheintheconfigurationoftheContentTypecanbeaslittleaspossibletosupport,aslittleaspossibletoensurethesystemLoadModule,higherconsumptionandefficiency.

3,databasecluster,librarytablehash

Largesiteshavecomplexapplications,theseapplicationsmustusethedatabase,sointhefaceofalargenumberofaccesstothedatabase,thebottleneckwillberevealedsoon,thenadatabasewillsoonbeunabletomeettheapplication,soweneedtousetheclusterdatabaseortablehash.

Intermsofdatabaseclustering,

Manydatabaseshavetheirownsolutions,OracleandSybasehaveaverygoodprogram,commonlyusedMySQLMaster/Slavearesimilar,youusewhatkindofDB,refertothecorrespondingsolutiontotheimplementation.

Theabovementioneddatabaseclusterduetothestructure,costandexpansionwillbetheDBtyperestrictions,soweneedtoimprovethesystemarchitecturetoconsiderfromtheapplicationpointofview,tablehashsolutioniscommonlyusedandmosteffective.

Weinstallthebusinessandapplicationorfunctionmoduleintheapplicationdatabaseseparation,differentmodulescorrespondingtodifferentdatabaseortable,thenthesmallerdatabaseforapageorhashfunctionaccordingtocertainstrategies,suchasusertable,tablehashaccordingtouserID,soitcanimprovesystemperformanceandlowcostandhasagoodscalability.

TheSohuforumistheuseofsuchaframework,thedatabaseusersettings,andseparateforumpostsandotherinformation,andthentothepost,theuserinaccordancewiththeplateandIDhashtablesinthedatabase,theendcanbesimpleinconfigurationfilescanmakethesystemwiththeincreaseofalowcostdatabaseinsupplementtheperformanceofthesystem.

4,cache

Theword"cache"hascomeintocontactwithtechnologyandhasbeenusedinmanyplaces.CachinginWebarchitectureandwebdevelopmentisalsoimportant.Herearethetwobasiccaches.Advancedanddistributedcachingisdescribedlater.

Thecachearchitecture,morefamiliartoApachepeoplecanknowthatApacheprovidesitsowncachemodule,theSquidmodulecanalsousetheexternalcache,thesetwomethodscaneffectivelyimprovetheresponseabilitytoaccessApache.

Webapplicationdevelopmentcache,availableontheLinuxMemoryCacheisacommonlyusedcacheinterface,canbeusedinthedevelopmentofweb,suchaswhenusingJavadevelopmentcancallMemoryCacheonsomedatacachesharingandcommunication,somelargecommunitiesusingthisarchitecture.Inaddition,intheuseofweblanguagedevelopment,allkindsoflanguageshavetheirowncachingmodulesandmethods,PHPhasPearCachemodule,Javamore,.Netisnotveryfamiliarwith,Ibelievetheremustbe.

5,mirror

Themirrorisalargesiteusedtoimprovetheperformanceanddatasecurity,mirroringtechnologycansolvedifferentnetworkaccessprovidersandareauseraccessspeeddifference,suchasthedifferencebetweenChinaNetandEduNethaspromptedalotofwebsitesintheeducationnetworkstructuresinthemirrorsite,dataupdateorupdate.Intermsofthedetailsofmirrorimages,thisisnottooelaborate,andtherearemanyprofessionalready-madesolutionarchitecturesandproductsavailable.Therearealsocheapideasthatcanbeimplementedbysoftware,suchasRsynconLinux.

6、loadbalancing

Loadbalancingwillbeahigh-endsolutionforlargewebsitesaddressinghighloadaccessandalargenumberofconcurrentrequests.

Loadbalancingtechnologyhasdevelopedformanyyears,therearemanyprofessionalserviceprovidersandproductscanchoose,Ipersonallycontactedanumberofsolutions,ofwhichtherearetwoarchitectureforyoutomakereference.

（1）hardwarefourlayerswitching;

Thefourthlayerexchangeusestheheaderinformationofthirdlayersandfourthlayersofinformationpackets,andidentifiestheserviceflowaccordingtotheapplicationinterval,andtheserviceflowofthewholeintervalsectionisallocatedtotheappropriateapplicationserverforprocessing.

ThefourthlayerexchangefunctionislikevirtualIP,pointingtothephysicalserver.Thebusinessittransmitsissubjecttoavarietyofprotocols,suchasHTTP,FTP,NFS,Telnet,orotherprotocols.Theseservicesrequirecomplexloadbalancingalgorithmsbasedonphysicalservers.IntheIPworld,thebusinesstypeisdeterminedbytheterminalTCPortheUDPportaddress,andtheapplicationintervalinthefourthlayerswitchingisdeterminedbythesourceandterminalIPaddresses,theTCPandtheUDPports.

Switchproductsinfourlayersofhardware,

Thereareanumberofwell-knownproductstochoosefrom,suchasAlteon,F5,etc.,theseproductsareexpensive,butvalueformoney,canprovideexcellentperformanceandflexibilityofmanagement."YahooChina"wascloseto2000servers,usingonlythreeorfoursetsofAlteon.

（2）softwarefourlayerswitching;

Asyouallknow,theprincipleofthehardwarefourlayerswitch,thefourlayerexchangeofsoftwarebasedontheOSImodelcameintobeing.Thesolutionisconsistent,buttheperformanceisslightlyworse.However,tomeetacertainamountofpressureoreaseofeffort,somepeoplesaythatthesoftwareimplementationisactuallymoreflexible,processingcapacitydependsentirelyonyourabilitytoconfigurethefamiliar.

WecanusethefourlayerexchangesoftwarecommonlyusedontheLinuxLVSLVSLinuxVirtualistosolveServer,heprovidesreal-timedisasterresponseheartbeatbasedonheartbeatscheme,improvetherobustnessofsystem,atthesametimeforthevirtualVIPconfigurationandmanagementfunctionofflexible,canmeetvariousapplicationrequirements,thedistributedthesystemisessential.

Atypicaluseofloadbalancingstrategyisbasedontheexchangeofsoftwareorhardwareofthefourlayerstructuresofthesquidclusters,thisideainmanylargewebsitesincludingsearchenginesareused,sothearchitectureofhighperformanceandlowcostandstrongexpansion,toincreaseordecreasethestructureoftheinsidenodesareveryeasy.

Forlargewebsites,eachofthemethodsmentionedearliermaybeusedatthesametime.Itiseasytointroducehere.Intheprocessofimplementation,manydetailsstillneedtobelearnedandunderstood.SometimesasmallsquidparameterorApacheparametersettin