如何安装php+kafka
短信预约 -IT技能 免费直播动态提醒
这篇文章给大家分享的是有关如何安装php+kafka的内容。小编觉得挺实用的,因此分享给大家做个参考,一起跟随小编过来看看吧。
1、 安装java,并设置相关的环境变量
> wget https://download.java.net/openjdk/jdk7u75/ri/openjdk-7u75-b13-linux-x64-18_dec_2014.tar.gz> tar zxvf openjdk-7u75-b13-linux-x64-18_dec_2014.tar.gz> mv java-se-7u75-ri/ /opt/> export JAVA_HOME=/opt/java-se-7u75-ri> export PATH=$PATH:$JAVA_HOME/bin:$JAVA_HOME/jre/bin> export CLASSPATH=.:$JAVA_HOME/lib:$JAVA_HOME/lib/tools.jar#验证安装> java -verisonopenjdk version "1.7.0_75"OpenJDK Runtime Environment (build 1.7.0_75-b13)OpenJDK 64-Bit Server VM (build 24.75-b04, mixed mode)
安装kafka,这里以0.10.2版本为例
> wget http://archive.apache.org/dist/kafka/0.10.2.0/kafka_2.11-0.10.2.0.tgz> tar zxvf kafka_2.11-0.10.2.0.tgz> mv kafka_2.11-0.10.2.0/ /opt/kafka> cd /opt/kafka#启动zookeeper> bin/zookeeper-server-start.sh config/zookeeper.properties[2013-04-22 15:01:37,495] INFO Reading configuration from: config/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)...#启动kafka> bin/kafka-server-start.sh config/server.properties[2013-04-22 15:01:47,028] INFO Verifying properties (kafka.utils.VerifiableProperties)[2013-04-22 15:01:47,051] INFO Property socket.send.buffer.bytes is overridden to 1048576 (kafka.utils.VerifiableProperties)...#尝试创建一个topic> bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test> bin/kafka-topics.sh --list --zookeeper localhost:2181test#生产者写入消息> bin/kafka-console-producer.sh --broker-list localhost:9092 --topic testThis is a messageThis is another message#消费者消费消息> bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --from-beginningThis is a messageThis is another message
安装kafka的C操作库
> wget https://github.com/edenhill/librdkafka/archive/v1.3.0.tar.gz> tar zxvf v1.3.0.tar.gz> cd librdkafka-1.3.0> ./configure> make && make install
安装php的kafka扩展 ,这里选择php-rdkafka扩展 https://github.com/arnaud-lb/php-rdkafka
> wget https://github.com/arnaud-lb/php-rdkafka/archive/4.0.2.tar.gz> tar 4.0.2.tar.gz> cd php-rdkafka-4.0.2> /opt/php7/bin/phpize> ./configure --with-php-config=/opt/php7/bin/php-config> make && make install
修改php.ini,加入 extension=rdkafka.so
安装rdkafka的IDE代码提示文件
> composer create-project kwn/php-rdkafka-stubs php-rdkafka-stubs
以phpstrom为例,在你的项目的External Libraries右键,选择Configure PHP Include Paths,把刚刚的路径添加进来。
编写php测试代码
producer:
<?php$conf = new RdKafka\Conf();$conf->set('log_level', LOG_ERR);$conf->set('debug', 'admin');$conf->set('metadata.broker.list', 'localhost:9092');//If you need to produce exactly once and want to keep the original produce order, uncomment the line below//$conf->set('enable.idempotence', 'true');$producer = new RdKafka\Producer($conf);$topic = $producer->newTopic("test2");for ($i = 0; $i < 10; $i++) { $topic->produce(RD_KAFKA_PARTITION_UA, 0, "Message $i"); $producer->poll(0);}for ($flushRetries = 0; $flushRetries < 10; $flushRetries++) { $result = $producer->flush(10000); if (RD_KAFKA_RESP_ERR_NO_ERROR === $result) { break; }}if (RD_KAFKA_RESP_ERR_NO_ERROR !== $result) { throw new \RuntimeException('Was unable to flush, messages might be lost!');}
low-level consumer:
<?php$conf = new RdKafka\Conf();$conf->set('log_level', LOG_ERR);$conf->set('debug', 'admin');// Set the group id. This is required when storing offsets on the broker$conf->set('group.id', 'myConsumerGroup');$rk = new RdKafka\Consumer($conf);$rk->addBrokers("127.0.0.1");$topicConf = new RdKafka\TopicConf();$topicConf->set('auto.commit.interval.ms', 100);// Set the offset store method to 'file'$topicConf->set('offset.store.method', 'broker');// Alternatively, set the offset store method to 'none'// $topicConf->set('offset.store.method', 'none');// Set where to start consuming messages when there is no initial offset in// offset store or the desired offset is out of range.// 'smallest': start from the beginning$topicConf->set('auto.offset.reset', 'smallest');$topic = $rk->newTopic("test2", $topicConf);// Start consuming partition 0$topic->consumeStart(0, RD_KAFKA_OFFSET_STORED);while (true) { $message = $topic->consume(0, 10000); switch ($message->err) { case RD_KAFKA_RESP_ERR_NO_ERROR: print_r($message); break; case RD_KAFKA_RESP_ERR__PARTITION_EOF: echo "No more messages; will wait for more\n"; break; case RD_KAFKA_RESP_ERR__TIMED_OUT: echo "Timed out\n"; break; default: throw new \Exception($message->errstr(), $message->err); break; }}
high-level consumer:
<?php$conf = new RdKafka\Conf();// Set a rebalance callback to log partition assignments (optional)$conf->setRebalanceCb(function (RdKafka\KafkaConsumer $kafka, $err, array $partitions = null) { switch ($err) { case RD_KAFKA_RESP_ERR__ASSIGN_PARTITIONS: echo "Assign: "; var_dump($partitions); $kafka->assign($partitions); break; case RD_KAFKA_RESP_ERR__REVOKE_PARTITIONS: echo "Revoke: "; var_dump($partitions); $kafka->assign(NULL); break; default: throw new \Exception($err); }});// Configure the group.id. All consumer with the same group.id will consume// different partitions.$conf->set('group.id', 'myConsumerGroup');// Initial list of Kafka brokers$conf->set('metadata.broker.list', '127.0.0.1');// Set where to start consuming messages when there is no initial offset in// offset store or the desired offset is out of range.// 'smallest': start from the beginning$conf->set('auto.offset.reset', 'smallest');$consumer = new RdKafka\KafkaConsumer($conf);// Subscribe to topic 'test2'$consumer->subscribe(['test2']);echo "Waiting for partition assignment... (make take some time when\n";echo "quickly re-joining the group after leaving it.)\n";while (true) { $message = $consumer->consume(1000); switch ($message->err) { case RD_KAFKA_RESP_ERR_NO_ERROR: print_r($message); break; case RD_KAFKA_RESP_ERR__PARTITION_EOF: echo "No more messages; will wait for more\n"; break; case RD_KAFKA_RESP_ERR__TIMED_OUT: echo "Timed out\n"; break; default: throw new \Exception($message->errstr(), $message->err); break; } sleep(2);}
感谢各位的阅读!关于“如何安装php+kafka”这篇文章就分享到这里了,希望以上内容可以对大家有一定的帮助,让大家可以学到更多知识,如果觉得文章不错,可以把它分享出去让更多的人看到吧!
免责声明:
① 本站未注明“稿件来源”的信息均来自网络整理。其文字、图片和音视频稿件的所属权归原作者所有。本站收集整理出于非商业性的教育和科研之目的,并不意味着本站赞同其观点或证实其内容的真实性。仅作为临时的测试数据,供内部测试之用。本站并未授权任何人以任何方式主动获取本站任何信息。
② 本站未注明“稿件来源”的临时测试数据将在测试完成后最终做删除处理。有问题或投稿请发送至: 邮箱/279061341@qq.com QQ/279061341