Windows环境下Kafka与Zookeeper安装配置与启动过程

《Windows环境下Kafka与Zookeeper安装配置与启动过程》由会员分享，可在线阅读，更多相关《Windows环境下Kafka与Zookeeper安装配置与启动过程（13页珍藏版）》请在装配图网上搜索。

1、Windows环境下Kafka与Zookeeper安装配置与启动过程1. 软件下载1.1 下载 jdk1.8.0_601.2 下载 zookeeper-3.4.9.tar.gz1.3 下载 kafka_2.12-0.10.2.0.tgz2. 环境准备安装配置java环境，配置jdk1.8为操作系统java运行时环境2.1 安装 jdk1.8将网站下载的jdk1.8.0_60压缩包解压缩到c:program filesjava目录下，如下图:页面选择计算机 OS (C;) Program Files Java 查看(V)工具(叮帮助(H)打开包含至嵯中/心/新？（犊Pad*DecrypterMa

2、ker名称j2sdkl.4.0jdkl.6.0 264iailjdkl.&.0_45jdkl-7.0_L7jdkl.8.0_602.2配置java环境如图在“控制面板-系统和安全-系统”页，鼠标点击“高级系统设置”，在弹出的“系统属性” 高级tab页：在弹出的点击“环境变量”按钮后，在弹出的环境变量对话框中点击“系统变量”栏中的“新建”按钮， “新建系统变量”窗口中输入如下：点确定确定后，再配置JRE_HOME坏境及昼赛系统变量E）建童CLASSPATH- ;%JAVA_HONE%/1 ih/di.=lCcmSpecCTGKE EMC_hUTXLAYU iXWincoys1 svD：emi：,

3、.c：jnd. exenlSGL XXVCFilet (iSOCt.jiuiLji F.T（）.蝙辑（I），. | 删除（L）确定 | | 取消茶统，毒性计算机名硬件高级*保护|远程|环境变昌22同时打开一个 cmd 窗 口在其中输入：SET JAVA_HOME=C:Program FilesJavajdk1.8.0_60SET JRE HOME=%JAVA HOME%jreSETCLASSPATH=.;%JAA_HOME%/lib/dt.jar;%JAVA_HOME%/lib/tools.jar;%JRE_HOME%lib;%JRE_HOME%libr t.jar;%JRE_HOME%lib

4、jce.jar;%JRE_HOME%libmetadata-extractor-2.4.0-beta-1.jar;%JRE_HOME%libmediautil- 1.0.jar;SET Path=%JAVA_HOME%bin;%JAVA_HOME%jrebin;在命令行输入java -version,输出如下，表明系统已启用java配置W 管理员：C:Wi ndcMsXsystem 32c md.exeMicrosoft Windows 版本 6.1,花01版权所有(c) 2003 Microsoft CorporationD保留所有权利口C:Usersliyongj iang jaua -u

5、ersionjaua version M1 .8.0_60,Jaua(TM) SE Runtime Environment (build 1.8.G_GQ-b27)Jaua HotSpotiTMj 64-Bit Server UM (build 25.GG-b23, mixed mode)C: Usersliyong j iar)93.Zookeeper安装配置3.1解压与目录设计在目录e:apachezookeeperT解压文件zookeeper-3.4.9.tar.gz,并将解压文件夹改名为zk0,复制该文件夹到相同目 录下分别改名为zk1、zk2.i zkozklA zk23.2在zk0

6、zk1zk2目录下都创建空文件夹data和logs，如下图1contrib2017/3/21 14:151JrllAtA2017/3/2216:03文4犊创建EIHJJ: 2017/3/22 14:29大小：2.65 KB2017/3/2114:15划犊1文件夹:vision-卫2017/3/2114:15文件myid2017/3/21 iq；l 5以犊logs2017/3/22 1&:04划犊3.2在data目录中创建文件myid，设置zookeeper服务器的序号。version-2myid2017/3/23 8:552015/7；9 12:05Myid的内容分别为0、1、2myid xU

7、 i i iili i iiiil i i i3.3配置zookeeper的属性配置 zk0zk1zk2 目录下的 config/zoo.cfg 文件。zk0/config/zoo.cfg 文件内容为：tickTime=2000initLimit=5syncLimit=2dataDir=E:/Apache/zookeeper/zk0/datadataLogDir=E:/Apache/zookeeper/zk0/logsclientPort=2181server.0=127.0.0.1:2888:3888server.1=127.0.0.1:2889:3889server.2=127.0.0.1

8、:2890:3890zk1/config/zoo.cfg 文件内容为：tickTime=2000initLimit=5syncLimit=2dataDir=E:/Apache/zookeeper/zk1/datadataLogDir=E:/Apache/zookeeper/zk1/logsclientPort=2182server.0=127.0.0.1:2888:3888server.1=127.0.0.1:2889:3889server.2=127.0.0.1:2890:3890zk2/config/zoo.cfg 文件内容为：tickTime=2000initLimit=5syncLim

9、it=2dataDir=E:/Apache/zookeeper/zk2/datadataLogDir=E:/Apache/zookeeper/zk2/logsclientPort=2183server.0=127.0.0.1:2888:3888server.1=127.0.0.1:2889:3889server.2=127.0.0.1:2890:38903.4 启动 zookeeper server开三个cmd窗口，依次执行如下指令:E:cd E:Apachezookeeperzk0binzkServer.cmdE:cd E:Apachezookeeperzk2bin zkServer.cmd

10、E:cd E:Apachezookeeperzk1binzkServer.cmd在三个窗口未同时启动前，前面开的窗口会报警:g 管理员C;WindwsXsystem32Umd.exe - zkServer.cmdat jaua.r?t.AbtrectPLairSocketlmpl.doConnectfAbstractPlainSocketlmpl.ja ua：350)at jaua.n&t.Ab$trctPLairiSocktImpl.connectToAddresfAbtractPlainSocket Impl.jaua；28S)at jaua .r&t. fibstractPlainSoc

11、ketlinpl . cannect(flbstractPlainSockat Impl . jaua ；1BS)at jaua.ret.Plainsocketlmpl.connect(PLainSocketlmpl.j aua:1?2)at jflua.ret.SocksSocketImpl.connpct(SocksSocketImpl.j aua:392)at jflua.ret.Socket.connect(Socket.jaua:589)at erg. apache. zookep&r. seru&r. quoruiti. QuoruitiCnxManegr .connctOnefQ

12、uoruiti CnxManagr.jaua:3S1)at or. spache. zookeeper. seruer. quorum. QuorumCnxManager. toSendi；QuorumCnxM .jaua；35H)at erg . apache . zoakeeper . ceruer . quorum . FastLpaderELectior$Messergpr$lilarkp rSender.processfFastLead&rElect ion.jaua：M521at erg . apache . zookeeper . seruer . quorum . FastLc

13、aderELeetior$Mp3 5prgcr$lilorke rSender.rum； FastLaderElpction.jaua:433)at jaua.lang.Thread一ruriThread. jsub: 75)201 7-03-24 10：O7：O3.649 itiyid ： 0 - INFO WorkrSender myid：0 ：QucrumPcsr$QuoriJiti Seruer143 - Resolued hostname: 127.0.0.1 to address； /127.0.0.12017-03-24 10=07:10.004 myid - WARN Quor

14、umPeermyid=0/0；0；0；Q；0；O；0；0；218 1:FolLower116 - Got zxid SsSOOOflOQOI espected SkI201F-03-2H 10：0r；ie.015 myid；e - INFO SyrcThread；S；FiLeTxnLoge203 - Creatir 9 n&u log File: log.300000001三个窗口都启动后，如下表明zookeeper正常启动:B 萱C:Wi nd owssystem 32c md.exe - zkSen/er.cmd2017-03-24 10；07；34,005 myid；1 - INFO S

15、essionTrack&r:ZooKe&perSeru&r35B- Expiring session Cx5af SaaS235CaO3, t imeout of SOOOOnis 海d201 7-03-24 1 0 ： 07 ： 34,0G7 myid ： 1 - INFO Proc&GsThireadsid ： 1 eport ： 1) ： ： PrepR&q eatProces3or4ST - Processed session temination for sessionLd: ax5afSaaS235aO 52C17-C3-24 10:07:34,007 myid：1 - INFO

16、ProcessThreadsid：1 eport：-!)：PrepReq uestProceGsor4B7 - Processed session termination for sessionid: 0x5aF8aaS2350G 32017-03-24 10:09:43.123 myidl - INFO /I 27 G G 1 ； 3SB9 ； QLiordniCnxHanager$L lg te nerG541 - n&c&iued connection request /I 27.0.0.1 :572S22017-03-24 10:09:43.132 myidl - INFO Uorke

17、rReceLuerniyid=1；FastLeaderELect ioriQSOO - Not if icat ion : 1i惬8日勇 format uersionl . 2 in . Leaderi . 0x20000003d n.zxLdi . 0x1 (n round): LOOKING (n.state i . 2 (n.sid): 0x2 r peerEpochi LEADING (my state)2017-03-24 10:09:43.201 myidl - INFO LearnerHardler-/127001：572B3；Learne rHardler329 - Follo

18、wer sid: 2 : irfo : org.apache.zoakeper.seruer.quorum.Quor nPeer$QuoruinS&ruer(5c2b5ba2017-C3-24 10:09:43.210 myid l - INFO LearnerHardler /12F 0 0 1 ；572S3:Learns rHardl&r3S4 - Synchronizing ui th Fol Louer sid ： 2 niaxCoiiiniLt tedLog = Gx30GOG0GOG ni inComniLt tdLog = Oxl00060001 peprLastZxid=0x2

19、O0CaO03d2017-03-24 10:09:43.211 myidl - INFO LearnerHardler-/127001：572B3；Learne rHardler45S - Sending QIFF2017-03-24 10:09:43.235 myidl - INFO LearnerHardler-/127001：572B3；Learne rHardler51 S - Rpceiued NELILEftDER-flCk nis用ge fron 23.5 启动 zkclient 测试 zk server新开一个cmd窗口，执行如下指令E:cd E:Apachezookeeper

20、zk0bin zkCli.cmd -server 127.0.0.1:2182nt:1iyongj iang201 7-03-21! 10 1S23 868 myid ： - INFO main : EnuironmentQI 00 - Client nuircriiti nt: usr.hoitie：C ： MJrMiyongj iang201 7-03-21! 10：1S：23.869 myid ： - INFO main : EnuironmentQI 00 - Client nuircriiti nt: usr.dir=E：fipachzookep&rzkGbin2017-03-211

21、 16：18：29:371 myid： - INFO main：ZooKepper43S - Initiating client connection; conrectString=127.6.6.1：21S2 seasionTinpout=36060 watcher=org.apache . zookeeppr . ZooKppp?rMain$Mylilatchpr(327 7050dcbde 1 come to ooKeeper*2017-03-211 16： 18：29:995 myid： - INFO main-SendThreadi； 1 27.0.0.1 ： 21 S2 J ： C

22、LiertC nxn$SendThiread(31 G32 - Opening socket connection to seruer IZr.Q.Q.l/IZr.C.e.l ：2 182 Will rot attempt to authent icate using S0SL (unknouir error2017-03-2H ie；lS：29:997 myid： - INFO iiiain-SendThreadC 1 27 . Q . Q . 1 ； 21 82) ； CLiertC nsn$SendThir&adeS7G - Socket connect ion established

23、to 1 27.0 . Q . 1 /I 2? . Q . Q . 1 ； 21 82 .initiating sessionJLine support is enabledzk； 127.0.0.1 ；Z182(C0NNECTINGj 0 2017-03-24 10；10:30.041 niLjid； - INFO indin -SendThreadf 12T. G.0.1 ； 2182j ； ClientCnxn$5endThreadei 239 - Session etablLhitiient complete on server 127.0.0.1/127.0.0.1；2182. se

24、sionid = Oxi1ZdTSOOOO. neg。 tinted timeout = soaoeWATCHER：:WatchedEu&nt stats：SyncCcnnct&d :None path:null在新开的 windows的 cmd 窗 口执行如下命令:create /zk hellocreate /zk/subzkget /zkLs /zk反馈如下：nZxid = 0x30000000amtime = Fri Mar 24 10：23：1 CST 2017pKid =cuersion = 0dataUersicn = 0aclUerGian = 0cphemeralOuiner

25、 = 0x0dataLprgth = 3numChildren = Qzk： 127.0.0.1 ：2182C0NhlEC：TED) 4 g /zkhelloCKid = Qxlctiitis = 2d Mar 22 16 ： 1 3 ： 03 CET 201 7mZsid = 0x100000002mtime = hied Mar 22 16 :1 3 : 03 C5T 201?pZxid = 0x1Q0OQ0OO4cuersion = 1dataUersicn = 0aelU&rion = 0ephemEralOuner = ElxOdataLength = 5numChildren =

26、1zk： 127.G.Q.1 ：2132C0MhlEDTED) 5 1= /zksubzk zk： 12T.6.O.1；2182(C0NNECTED) 61至此，zookeeper安装完毕4.Kafka安装配置4.1目录配置解压kafka_2.12-0.10.2.0.tgz的内容到E:Apachekafka目录下，并将文件命名为kafka0，复制该文件夹到相同目录， 命名为kafkal,如图kafkaOkafkal在这两个文件夹下创建logs和matrix文件夹，如图E:iE：cd E:ApachekafkakafkaBbinwindousE:Apachek.afkaKafkaObinidin

27、cloHSkafka-topics.bat -create .1 ：2181 .127.0.0.1 :Z182.127.0.0.1 ：2183 -replication-factor 2 pic test2Created topic test2 .-zockeeper 12T.0.3 -partitions 2 -toE:Apach kaf kaka Fka b i nw i nd ows4.5 启动 producer在新开的 windows的 cmd 窗 口执行如下命令：E:cd E:Apachekafkakafka0binwindowskafka-console-producer.bat

28、-broker-list 127.0.0.1:9092,127.0.0.1:9093 -topic test2C:Usersliyongj iangE:E；cd E；ApacheXkafkakafkaObinwindowsE: flpach&k.afk.akafkaObinNind&wskafka-consol -producer. bat -brok&r- List 127.0.G.1；S092n127.0.0.1：9GS3 -topic teGt24.6 启动 consumer在新开的 2 个 windows的cmd 窗 口都执行如下命令：E:cd E:Apachekafkakafka0b

29、inwindowskafka-console-consumer.bat -zookeeper 127.0.0.1:2181,127.0.0.1:2182,127.0.0.1:2183 -topic test24.7 producer 和 consumer 联合测试如下图，在producer的窗口中输入文本，回车后会同步显示在2个consumer窗口中。icroeoft Uindowft 版本 6.1.7681 )T权所百(c) 209 Microsoft Corporation 保留所百代利，C ：U5r$liyo9Pn9E-:1 i yo9 j i。叫 E :Apachokafkdkafkd

30、ObinwirxSMekafka-consolo-producer.bat -broker-liet 127 e.e.1 9092 127.9.9 1-9093 -topic t”t2 bllo world!i o old nn.to bo a code writer.K:cd E:ApdchekafkakafkaQbinMindows t:ApachokafkdkafkaObinwirxSowekafkd-con5olo-coneuer .bat -zool9.1 :2181,127.e.e.1:2182,127.e.e. 112183 -topic t”t2火 ir9 the Corvol

31、9Condunr Mi th old consuw is doprytX sd Mill Ia future nojorConidr using g nu consur 凶 pagingrwr) instaX of zookppr.hello uorld?i a old ndn.to be a code writer.indOA-sViyemiAtmd.exe - kafka-conwle-pcodiKer.bat -bfoster-it 127jOX).icroeoft Uindows 版本 6.1.7681 兄权所白(c) 209 Hicroeoft Corporation保留所色代利。:

32、cd E.ApAcbekdfkakdfkdebinMindoaC - U“rsl iong j iongE:E.cd E：ApachokdfkdkdfkaObmwindowE.Apachekdfkdkdfkd0binMxndOMekdfkd-con$ole-conuncr bat -zoo.L 0 1 2181,12?.0 0 1 2182.127 0 0 1:2183 -topicUsing trw ConsolaCoMgr with old conunr is gprxoted ond will b o future zjor*Consider using tha npw consumer* by passing ioruor instead of (zookeeper.hello world!i an a old gn.to b。 9 co writer.