ArcGIS实时大数据-Geoevent Server.docx

2019EsriChinaDeveloperSummitArCGIS实时大数据-GeoEVentServer产品技术部刘宇ChinaBeUlNGTHESCIENCEOFWHERE1、实时数据流概述2、实时大数据接入和处理3、实时数据展示和挖掘分析4、基于GeoEVentSerVer快速创建实时GlS应用5、基于GeoEVentSDK的扩展开发6、总结SeSIaTHESCIENCEOFWHERE实时流数据实时流数据有哪些类别属性变化，位置不变2019EsriChinaDeveloperSummit低功耗传感器设备、.一X串!GP常自费献标看具备IP功能的设备®113移动设猿像气田备头装置制动器设备RFlD2019EsriChinaDeveloperSummitI如何对妾类型繁多的实时数据？如何高效分析、姐里实时数据？如何高效展示、挖掘时空大数据?如何敏捷快速搭建实时应用？Besri三naTHESCIENCEOFWHERE实时大数据接入和处理豁视器*JMSZU上次里W时间：2017年7月20日上午10:13:47GeoEventServer,实时大数据持续接入和处理服务神2019EsriChinaDeveloperSummrt应用场景属三½wwtt三即*sp用内置Kafka,开箱即用的集群弹性与可GcoEvcnt#入/出it*故大法卓QIcuOUt1$/»15/»61/»61/»00:02:0500:02:05tt输入JfcAdfrPOyPinSlnX4821500:02:05krOfic*ho<oul比中61/00:02;052019EsrfCNneDveicrSunvnIMS3IgMT>ay*cDefinitiOn创建输入连接器输出连接器服务创建ArcGIS产品体系ArcGISEnterpriseNotebookServer201»EsdCNnaDveioprS11vn*输入连接器ReceiveRSSReceivetextfromaTCPSocketEJReceivetextfromaUDPSocketftp：/ReceiveFeaturesonaRESTendpoint2019EsriChinaDeveloperSummitXog0-5Jo3n0加ReCeiVeJSoNOnaRESTendpoinf!IReceiveJSONonaWebSocket4>s:MReceiveJSONonexternalWebSocket三SP°"anArcGISServerforFeaturesWatchafolderfornew.csvfilesWatchafolderfornew.isonfiles叵P:IPollanexternalwebsiteforJSONVValarmexactEarthzONARZonarQosOSIsoftCompass1.DEGeofeedgGeofeedia空间信息是实日掇据中特海量义极其重要的一关需具备接入、处理和分析空间大数据能力空间规则两大类实时流数据分析、处理属性规则(三)UoiieDiJiiON<s)yev!WinnsJdoQeuMus36V02圣单乡回王学十：ostuagoa9GeoEventServer:数十种属性处理规则iI-Equal/NotEqualIImrGreaterZ1.essthanI，Greater/1.essorEqualFieldEnricherFieldReducerConvexHullCreatorDifferenceCreatorTrackIdleDetectorIEgiNj¾MATHS-emexists1snullFieldCalculatorNoO)perationEnvelopeCreatorIJBufferCreatorExtentEnricherAk.(DFieldMapperTrackGapDetector¾JIncidentDetectorGeoTaggeiInterSectoiProjectorGeoNamesMotionCalculatorUnionCreatorReverseGeocoderWaterSCADASymmetricDifference属性规则1.UCBeSM标二IrlTmTInTInmHMMy!二JjJfflJ34M<三HMdffi*sl÷4M二二二：二羊至生主左生一'1.AjlA>JIJ->>一一9J三thttc1ppt1.t1.U÷÷I,j,j4-jj-4j4j4IfIIWIIa11wl旧ISI：2019EsriChinaDeveloperSummit实时数据展示和挖掘esri三inaTHESCIENCEOFWHERE实时大数据存储、展示、分析数据高效存储-分布式时空大数据存储-云存储实时大数据输出和可视化-多种输出途径-聚合展示/离散要素展示实时通知提醒O时空大数据挖掘分析X矗1妾画移动设备桌面同行二I涮&务实时和历史要素聚合GeoEventServer三sArcGISEnterpriseX母多样的展示方式PortalforArcGISOperationsDashboardWebAppBuiIderforArcGISArcGISProInsightsforArcGISJSAPIH2019EwlChrwDeveloperSurtmi一号馆观众实时动态HomeFlightUA1.1602-February15,2016NewMapCreatePresentationAdministratorDe(asAddTk.Edt8B0AboutcontenttegendContents1.abelsSFOandA1.FightUA1.1602(Feb152016)巨四四FlightRoutesOerTimeUAIJ602 NEXRADRadar FAA5010unagery¾AQriChina运.BEUlNGTHESCIENCEOFWHERE基于GeOEVentSerVer快速创建实时GIS应用2019EsriChinaDeveloper-Summit评估需求金/J2019EsriChinaDeveAoperS11vnl实时数据传送频率?整体数据量？实时数据使用的输入、输出协议和需要哪些扩展？可视化途径？报警输出的渠道？实时历史数据是否需要挖掘分析？MACHINE1PortalWebAdaptor0QwithGISServerandGeoEventServer1.icensesServerWebAdaptor单台机器-WebGIS-GeoEventServer适合：-小数据量，小场景一内部自用，开发扩展测试一流服务的输出-PortalforArCGIS作为使用流服务的客户端ArCGISDataStore3台机器分布式部署0WebAdaptorforFederatedSite- 1台WebGIS- 1aGeoEventServer- 1台时空型ArCGlSDataStoreBaseArcGlS适合EnterpriseDeploymentArcGlSSerVerwithGeoEventServer1.icense口一局域网，企业内部MACHINE1MACHINE3一小数据量，小场景一流服务的输出、时空大数据存储输出SpatiotemporalDataStore- PortalforArCGlS作为流服务和时空输出的客户端- PortalforArCGIS作为实时历史数据MACHINE2分析（常规tools）的客户端ArcGISEnterpriseDeploymentMACHINEMACHINEMACHINEMACHINEMACHINEWebAdaptorforFederatedSpatiotemporalDataStoreNodesArcGISServerithGeoEventServer1.icense时空型数据库分布式部署-1台WebGIS一1台GeOEVentServer- n台时空型ArCGlSDataStore适合：一企业级应用- 高性能的实时数据写入一时空大数据存储输出- PortalforArCGIS作为时空输出的客户端- PortalforArCGlS作为实时历史数据分析（常规tools）的客户端MACHINE1集群及分布式部署1台WebGIS廖BaseArcGISEnterpriseDeploymentMACHINE5ArcGISServerwithGeoEventServer1.icenseArcGISServerwithGeoEventServer1.icenseSWebAdaptorforFederatedSiteArcGISServerwithGeoEventServer1.icenseMACHINE4MACHINE6MACHINE7SpatiotemporalDataStoreNodesn台GeOEVentServern台时空型ArCGlSDataStore适合：大型企业级应用海量实时数据的接入、处理和输出高性能的实时数据写入时空大数据存储输出PortalforArCGIS作为时空输出的客户端*PortalforArCGlS作为实时历史数据分析的客户端（不推荐）WebAdaptorforFederatedSite三WebAdaptorforFederatedSiteBaseArcGISEnterpriseDeploymentArcGISServerwithGeoAnaIyticsServer1.icenseMACHINE3BaseArcGISEnterpriseArcGISServerwithGeoEventSpatiotemporalDataStoreDeploymentServer1.icenseMACHINE5ArcGISServerwithGeoEventServer1.icenseMACHINE6ArcGlSServerwithGeoEventServer1.icenseMACHINE7MACHINE2SpatiotemporalDataStoreNodes大型企业级应用复杂的环境高薪接入、处理、输出和可视化实时历史大数据挖掘(GeoAnalyticsServer)实时大数据如何同时接入和处理数以万计的数据?如何输出实时大数据？O代码,配置式搭建2019E*ChraiDevttoporSwrmtArcGIS实时GIS解决方案：静态目标监控步史败据物述成放：25日2019EsriChinaDeveloperSummit案例欣赏fesriaTHESCIENCEOFWHERESIMO-SiNGAPORETIAIxC不安全Ococjtyarcoisoriine6Port双8oCitW8g0>Qtyh<rrt>OCoc-ior天津生态城镜像城市Sino-SingaporeTWNiNE8Gv20181022Mon'22:13:18W显贴满点能源运行362万立方米供气品经济项目m安自:崇电甑鱼生项目;28Q42WTJSKUSJ.2TJSTC.GJ.1TJsTeg9niQFariChina断住备【WEATHERDEIAJ1.SPRIORITYEVENTSlof3>localConditionsSomevileTOWNHopkinlarCanibndge1.EGEND4PrimtyEvenis(WebEOC)TransportationStatusWebEO习30000HaH-25k5k-10k15k-2Cktn10k-15k20k-Half25k-30k35k-40kAnncMjnccr-RmshUlSIRIBiniONOFERI()RIIYEVEKlSEMSSTATUSEMSSTATUS30TotalCalls7ActiveCallsAciiveEMScallsforntedicaiserice.Totalunnarsh,whavereceivedmedkalattention.Currentnmitersreceivingmedicalattention.FORECASTIOWiChanceoIRainPRECIPUghtRaJnTEMP47degreeToioIEMSCallsfonneditealsvice.HUMlDilY83%WINDWindfromtfe&Stat9mphGuststo2Imph一30k-35k40kAmncuncer1PriorityEventsNumberofncitentxaurentlybeingtrackedonleWebeOCprioriIyeve川beardRUNNERPRoGRESSWalthamWatcitoWn4EMSEvent(WebE)4MileMarker4#RunnersBetweenTimingMal0-500501-10001001-20002001-30003001-505001+PoieniialEvcm>Roujcs13.MI%COMP1.ETE/TiENERGYUSAGEHOSSAMSAYED!DUA1.I智慧迪拜之D3-传感器流程2019E*fQMOv«*operSunvnlD3传感器及系数据可视化服务ArcGISIOT平台应用和设备移动船舶监控系统Curent07:48:16：RetrievingDataPorttenderauNddefined11S2HOSdiDg-FIlPiieilcChannelBY24Action02M)1GnoacsWMSoum07:3106GARZA0739AGIUAKE-SATPibjOiO-!2GUABMAMHoClS4MNo11hCerropcaoho0737：i?DaWiwIndi鹏GORGONAIO7*H)JGARZA07>«M7GHAKfXM*0>746OKI,7GnOeKSUaKSOUmClMnE<1147*MCERROJEFEenteredGatun-1.anding9GTANBeSriChinaTHESCIENCEOFWHERE刊19ESriCCnxDmrtGeoEventSerVer的扩展AMCtsssenPackagesGeoEvent提供面向JaVa的开发包,co<nericomcome&nxe90or11try9e0me<ry09caHsfor各个组成部分均支持自定义com眸afla即加comeee.<×>odonco<n领Qeeoooneoofcomge$.c(xecofn.eh.ge.ooe.acicomeerfOesweoomponentcomOSngcs.rchpco<nosngcscore18nAJlChsGeoEventProcessor自定义connectorsAO-OIActcneoEcn自定义自定义processorsAOiAQiEveniAfiOQssTypcAcrzatoAdsp9fAdapoorOascconnectorsNrdftperAapefWra(3pefAdaplefWrafjperTEnd醴VAGSConnm3HSPomeAOSOgneCMnStMMBienerSireamSezsaemAJertTypeM。SISAnJarUniIAnarUnilCocte4cG坞儆闻Come的。ArcG*SServe<duslermapperArcGlSSCrVRfCoenOa)OnConnoctbnTypoAcGtSSne(ComeaOetateWrapperAfggiSSwgQnHKflonOgta唱y"apx>,ra11satodFRAMESFRAMESM2019EsrighinjEsri:AGES:SDKAPI10.5.0APIRacKagesPackaoeco<n.eri.oofe.9eomtryC(Xn询cor9geometryogcC(Xn.CsmggqdaptafcomasrigosadapoQruOlcofn.ed.oe81oOrXWonoomCSrtgC511noorCOfnesngesxiXGcofr1.esries.oorecomponentoom.esri.ges.core.conditionCOfrtasri90500roj900cvo11tC(XnesrioeBXJOfehit)com.esh.9e.oore.iinoo11esri.ges.re.incidentcomgeexxxeoerax11comsriQe,weeoufoemesri.ges.ocxevalidationcom.cri.gcs.datas(orc.foldcrc<M11Qsngo3.1r11xmMu18ncom.esri.gcs.jaxb.adaterCOmQSri.9e3qIbXonneclo<com.CMr1.好JaXbm侬际'adKIuoTapuTasaP)uOTATUTJ2aAaxadoxdal*2(odguex?-bueAT3DBaxodsucX?*4UaAaOaBTXE3WODSa-9T9T9:3EOUTEDOl/:dD4BuTSadAIAlxadozdXZnxapTAordn)uoTaTuTJaaAaxadoxdAz?z(aNnoaNIsdKlaxicuexI)zclns)uotatuTJ>aafcucxlPiJrHX)UION>AT3DYDTTqudz(sseo>oratuTJed3xodguexIPunOqUIOW>ATAOY)XaBbOT9=BKxo4DeaZabboT>TPunE-N3DDOTXabbOT=TPungTeUJDYaesqEAYaclMoufcadKIuoTacuT3saPn)an<iguoTaTutJaaAaxadoxdMou'nTznxapTaordn)andsotaTuTJaaAaxadoxdenenSbuTx9S*adKIAaxadoxa(ZOzZauoradaXgAazadozd)yD?eDaoPxoMeGed)andgoraTuTJeaAaxe<iozdMou,ouPNXaEnn)andsuoTaTUTJ=Aaxsdoxd:zoxxabeWzoxxa)uoTack>oxg>uT3ungaouMol?：(oxj,bcNxoxxa)xOxx3429D0T:()aDccc=2abXOxZa-MHOHNZIININTu)S3ETEUEX3oN3DD0T=BcNxoxZaBuTxlsaccguo11TUT3212xodcucxISPUc?KCUOTaTUTJaa3PdCUCXIPunoqUlONCAlaOYJDDYlqUd(TgTagoM：'<TBTgoaSHVaazodeuex7-busaraoeajctigucx?*/usaoaBZEaDDSTTaupxoNssed,adKIAazsdozdvloAeeed)UOTaTuTSaaAazadoxdaNVNHaSnNIINOaSNNaxodsuex3-buaATaDeaxiMlguex3'AuaAeOaBTxEa"WOD)STTau,buTxaSadAIAaxedozd'eueNXeEnu)UOT11JTJ=AaxadozdNIIaoaSNVaI'axodsupx3-busAT3DB'a(<lsuDI?AuaA20B5,TIEaWoDSIiuiuinsJdoQeuMUS36102uodsue:2019EsrfCiaDvwttoperSurrvnt扩展输入连接器2019EarfCiraDeveloperSummlponent.ComponentException;importcom.esri.es,framework.il8n.Bundle1.ogger;importcom.esr.ges.framework.i18n.Bundle1.ggerFactory;importcom.esri.ges.messaging.Bvte1.istener;publicabstractclassInboundTianspoiiBascp×tendsIransportBaseimplementsInDoundTransport(三)Ovemdepublicvoidrun()13如霜然牌博喘般肥/叔meprivatestaticfinalBundle1.ogger-1.0G6ER=BundlsetErrorMessage(11");tRunnguSntj*(RIillIngState.STARTED);ork.transpublicInboundTransportBase(TransportDefinitionthrowsComponentExceptione1718日19trybytebytes=consumer,receive();25,31SUPeqdefinitionXif(definitiongetransportType()=null)llthrownewComponentException(1.OGGER.translatpublicvoidsetByte1.istener(Byte1.istenerbyte1.isthis.bvte1.istener=byte1.istener;publicbooleansuusteraDe()returnfalse;ifRytJMffeln喝驾黄翁铅8：Ro，(bytes.length);Rfeffi瞅a；byte1.istener.receive(bb11,);bb.clear();)catch(MessagingExceptione)1.OGGER.error("",e);数据格式转换importcom.esri.ges.core.geoevenl.GeoEvenl;publicabstractinterfaceGeoEvent1.istenenpublicabstractvoidreceive(GeoEventparamGeoEvent);mportcom.esri.ges.core.geoevent.GeoEvent;,POrtjava.nio.ByteBuffer;ublicabstractinterfaceCieo1.ventAwacBy(c1.istcncnpublicabstractvoidreceive(ByteBufferparamByteBuffer,StringparamString,GeoEventparamGeoEvent);AT2019EsrfCNnaDevtloporSufm*IP0PU1.ATEEFlE1.DS.SUCCESSFU1.1.Y上OverridepublicGeoEventadapt(ByteBufferbuffer,String(buffer.mark();21(TVI22uI23GeoEventmsg;2425元GeoEventDefinitiongeodef;2728try2930tole=geoEvenlCreator.getGeoEvenlDeI:31.getGEventDefinition(',BSTGl1.OGGERJnfol'CREAWD.MSG");34nisi'=Ilns.geoEvcntCrcator,create(ge<xlig7Icatoh(Exceptior)e),returnnull;341StringsTxt=ByteBuffUtil.getString(buffey43if(StringUtil.isNullOrEmpty(sTxt)retamnail;PargeBstUtilbsipuse=newParseBglUtil()iS51BstClassbst=bstparse.getParse(sTxt);曾/Populatethemessagewithalltheattrils,1.is<FeldDefnicion>IxscFieldsdefgeod(for(inti-0:l<listFieldsdef.aize();i+)(FieIdDefinitiontieldDef=IiMlickIsdcl.getSiring.-ll.=,.gdName!if(ieldDef.getType)FieldType.Geometry)(msg.gelGeometr)f().setGeomeu>,(newPoint(b.getJD().getWD);naggetGec!ietry().setSpatialReference(SpatialReference.create(4326);、elseObjectobj=ReflectClass.refIect(bst,fieldName):FieldTypefieldType-fleldDef.getType();switchcaseString:mag,getField(tieldDef'getName(),obj.toString(O);break:caseBlean:、msg.selField(tieldDef.getName(),(BOOIean)Obj);break;caseDate:eld(1.ieldDef.getNajne().(Date)obj);casemag.setHeld(fieldDef.getNameO,(Double)obj);break；CaSCmlglostF'ield(fieldDef.getNane(),(Float)obj);break:caseInteger:msg.SetField(tield)ef.getfmeO,(Integer)obj):break;case1.ong:msg.setField(tieldDef.getNameO,(1.ong)obj)：break;caseShort:gasetField(FieldDefgetNameOXShort)cbj);111.OoGERiMO)returnR8g2019EsriChinaDeVelOPerSUmmitlpublicabstractclassOUIboundAdaPlerBaSeextendsAdaDlerBaSe&implementsOUIbOUndAdaDlerprivateGeoEvemAwareByie1.islencrbyte1.isiencr=null;privatestaticfinalBUndIeSgger1.OGGER=BUndIe1.oggerFaCIOryFeuqwger(OUtboUndAdaPteIBase.class);publicC)Ulb。UndAdaDIerBaSC(AdaPIerDefiniliondefinition)thrnueCamnnnentFvrentinnimportCOITpnncot.ComponeotExcnption;publicabstractinterfaceOutboundAdaptereftendsAdapter,GeOEVeM1.iStenerpublicabstractbooleanisByte1.istenerAvailable();publicabstractvoidSetByte1.iStener(GeoEVentAWareByte1.iSteeerbaramGeoEventAwareByte1.istener);publicabstractbyteprocessData(Map<String,1.ist<GeoEvent>>paramMap)throwsComponentException;publicabstractStringgeiMIMEType()throwsComponentException:IInrUwnewUJmByng|及丛磔_m1.ElUioCK-idiEIlCfrwu_wui_cmicu,newvuJett1.,iprucessudlajjpublicStringgeNIMEType()throwsComponentExceptionhemunyCQTWnentExccrtion(1.OGGER4ranslate("METHODNOT_IMP1.EMENTED"5newObjectJH',getMIMETypc*!);Adapter(receive)Output(receive)GeoEventAwareByte1.Byte1.isteneristener2019EarfChnaDeveiBperSurrmlProcessor0VeITidepublicGeoEventprocess(GeoEventge)throwsExceptionif(!ge.getGeoEventDefinition().getTagNames().contains("GEOMETRY")ret