Kafka List all partition with no leader
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ height:90px;width:728px;box-sizing:border-box;
}
In my kafka Cluster there are more than 2k topics and each topic has 5 partitions. I want list only that partitions which has no leader.
I can go can check for each topic using the below syntax:
kafka-topics.sh --describe --topic <topic_name> --zookeeper <zookeeper_ip>:port
But the problem is there are 2k+ topics, can't be done manually. I can also write a script to loop over each topic and get the partition with no leader. But i am interested in some efficient way to get the information.
apache-kafka apache-zookeeper
edited Nov 22 '18 at 20:29
Anony-Mousse
59.3k797163
asked Nov 22 '18 at 15:21
HackaholicHackaholic
12.5k12644
add a comment |
In my kafka Cluster there are more than 2k topics and each topic has 5 partitions. I want list only that partitions which has no leader.
I can go can check for each topic using the below syntax:
kafka-topics.sh --describe --topic <topic_name> --zookeeper <zookeeper_ip>:port
But the problem is there are 2k+ topics, can't be done manually. I can also write a script to loop over each topic and get the partition with no leader. But i am interested in some efficient way to get the information.
apache-kafka apache-zookeeper
edited Nov 22 '18 at 20:29
Anony-Mousse
59.3k797163
asked Nov 22 '18 at 15:21
HackaholicHackaholic
12.5k12644
add a comment |
In my kafka Cluster there are more than 2k topics and each topic has 5 partitions. I want list only that partitions which has no leader.
I can go can check for each topic using the below syntax:
kafka-topics.sh --describe --topic <topic_name> --zookeeper <zookeeper_ip>:port
But the problem is there are 2k+ topics, can't be done manually. I can also write a script to loop over each topic and get the partition with no leader. But i am interested in some efficient way to get the information.
apache-kafka apache-zookeeper
edited Nov 22 '18 at 20:29
Anony-Mousse
59.3k797163
asked Nov 22 '18 at 15:21
HackaholicHackaholic
12.5k12644
In my kafka Cluster there are more than 2k topics and each topic has 5 partitions. I want list only that partitions which has no leader.
I can go can check for each topic using the below syntax:
kafka-topics.sh --describe --topic <topic_name> --zookeeper <zookeeper_ip>:port
But the problem is there are 2k+ topics, can't be done manually. I can also write a script to loop over each topic and get the partition with no leader. But i am interested in some efficient way to get the information.
apache-kafka apache-zookeeper
apache-kafka apache-zookeeper
edited Nov 22 '18 at 20:29
Anony-Mousse
59.3k797163
asked Nov 22 '18 at 15:21
HackaholicHackaholic
12.5k12644
edited Nov 22 '18 at 20:29
Anony-Mousse
59.3k797163
asked Nov 22 '18 at 15:21
HackaholicHackaholic
12.5k12644
edited Nov 22 '18 at 20:29
Anony-Mousse
59.3k797163
edited Nov 22 '18 at 20:29
Anony-Mousse
59.3k797163
edited Nov 22 '18 at 20:29
Anony-Mousse
59.3k797163
59.3k797163
asked Nov 22 '18 at 15:21
HackaholicHackaholic
12.5k12644
asked Nov 22 '18 at 15:21
HackaholicHackaholic
12.5k12644
asked Nov 22 '18 at 15:21
HackaholicHackaholic
12.5k12644
12.5k12644
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
Using kafka-topics.sh you can specify the --unavailable-partitions flag to only list partitions that currently don't have a leader and hence cannot be used by Consumers or Producers.
For example:
kafka-topics.sh --describe --unavailable-partitions --zookeeper <zookeeper_ip>:port
answered Nov 22 '18 at 15:38
Mickael MaisonMickael Maison
8,72842831
Ah thanks for the answer. I have seen that options in topics.sh but was not aware that i can do my job, thanks once agin for pointing it out.
– Hackaholic
Nov 22 '18 at 15:43
I tried the above, but it listing everything one with no leader and also which has leader
– Hackaholic
Nov 22 '18 at 15:50
What's your Kafka version? We're running on 2.0.0 and the above command works correctly for us, i.e. when we don't have--unavailable-partitionsit lists every partition on the cluster, when we do have it it outputs nothing (as all our partitions are healthy).
– Carr0t
Nov 22 '18 at 16:00
kafka version is 1.1
– Hackaholic
Nov 22 '18 at 16:08
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53434014%2fkafka-list-all-partition-with-no-leader%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Using kafka-topics.sh you can specify the --unavailable-partitions flag to only list partitions that currently don't have a leader and hence cannot be used by Consumers or Producers.
For example:
kafka-topics.sh --describe --unavailable-partitions --zookeeper <zookeeper_ip>:port
answered Nov 22 '18 at 15:38
Mickael MaisonMickael Maison
8,72842831
Ah thanks for the answer. I have seen that options in topics.sh but was not aware that i can do my job, thanks once agin for pointing it out.
– Hackaholic
Nov 22 '18 at 15:43
I tried the above, but it listing everything one with no leader and also which has leader
– Hackaholic
Nov 22 '18 at 15:50
What's your Kafka version? We're running on 2.0.0 and the above command works correctly for us, i.e. when we don't have--unavailable-partitionsit lists every partition on the cluster, when we do have it it outputs nothing (as all our partitions are healthy).
– Carr0t
Nov 22 '18 at 16:00
kafka version is 1.1
– Hackaholic
Nov 22 '18 at 16:08
add a comment |
Using kafka-topics.sh you can specify the --unavailable-partitions flag to only list partitions that currently don't have a leader and hence cannot be used by Consumers or Producers.
For example:
kafka-topics.sh --describe --unavailable-partitions --zookeeper <zookeeper_ip>:port
answered Nov 22 '18 at 15:38
Mickael MaisonMickael Maison
8,72842831
Ah thanks for the answer. I have seen that options in topics.sh but was not aware that i can do my job, thanks once agin for pointing it out.
– Hackaholic
Nov 22 '18 at 15:43
I tried the above, but it listing everything one with no leader and also which has leader
– Hackaholic
Nov 22 '18 at 15:50
What's your Kafka version? We're running on 2.0.0 and the above command works correctly for us, i.e. when we don't have--unavailable-partitionsit lists every partition on the cluster, when we do have it it outputs nothing (as all our partitions are healthy).
– Carr0t
Nov 22 '18 at 16:00
kafka version is 1.1
– Hackaholic
Nov 22 '18 at 16:08
add a comment |
Using kafka-topics.sh you can specify the --unavailable-partitions flag to only list partitions that currently don't have a leader and hence cannot be used by Consumers or Producers.
For example:
kafka-topics.sh --describe --unavailable-partitions --zookeeper <zookeeper_ip>:port
answered Nov 22 '18 at 15:38
Mickael MaisonMickael Maison
8,72842831
Using kafka-topics.sh you can specify the --unavailable-partitions flag to only list partitions that currently don't have a leader and hence cannot be used by Consumers or Producers.
For example:
kafka-topics.sh --describe --unavailable-partitions --zookeeper <zookeeper_ip>:port
answered Nov 22 '18 at 15:38
Mickael MaisonMickael Maison
8,72842831
answered Nov 22 '18 at 15:38
Mickael MaisonMickael Maison
8,72842831
answered Nov 22 '18 at 15:38
Mickael MaisonMickael Maison
8,72842831
answered Nov 22 '18 at 15:38
Mickael MaisonMickael Maison
8,72842831
8,72842831
Ah thanks for the answer. I have seen that options in topics.sh but was not aware that i can do my job, thanks once agin for pointing it out.
– Hackaholic
Nov 22 '18 at 15:43
I tried the above, but it listing everything one with no leader and also which has leader
– Hackaholic
Nov 22 '18 at 15:50
What's your Kafka version? We're running on 2.0.0 and the above command works correctly for us, i.e. when we don't have--unavailable-partitionsit lists every partition on the cluster, when we do have it it outputs nothing (as all our partitions are healthy).
– Carr0t
Nov 22 '18 at 16:00
kafka version is 1.1
– Hackaholic
Nov 22 '18 at 16:08
add a comment |
Ah thanks for the answer. I have seen that options in topics.sh but was not aware that i can do my job, thanks once agin for pointing it out.
– Hackaholic
Nov 22 '18 at 15:43
I tried the above, but it listing everything one with no leader and also which has leader
– Hackaholic
Nov 22 '18 at 15:50
What's your Kafka version? We're running on 2.0.0 and the above command works correctly for us, i.e. when we don't have--unavailable-partitionsit lists every partition on the cluster, when we do have it it outputs nothing (as all our partitions are healthy).
– Carr0t
Nov 22 '18 at 16:00
kafka version is 1.1
– Hackaholic
Nov 22 '18 at 16:08
Ah thanks for the answer. I have seen that options in topics.sh but was not aware that i can do my job, thanks once agin for pointing it out.
– Hackaholic
Nov 22 '18 at 15:43
Ah thanks for the answer. I have seen that options in topics.sh but was not aware that i can do my job, thanks once agin for pointing it out.
– Hackaholic
Nov 22 '18 at 15:43
I tried the above, but it listing everything one with no leader and also which has leader
– Hackaholic
Nov 22 '18 at 15:50
I tried the above, but it listing everything one with no leader and also which has leader
– Hackaholic
Nov 22 '18 at 15:50
What's your Kafka version? We're running on 2.0.0 and the above command works correctly for us, i.e. when we don't have
--unavailable-partitions it lists every partition on the cluster, when we do have it it outputs nothing (as all our partitions are healthy).– Carr0t
Nov 22 '18 at 16:00
What's your Kafka version? We're running on 2.0.0 and the above command works correctly for us, i.e. when we don't have
--unavailable-partitions it lists every partition on the cluster, when we do have it it outputs nothing (as all our partitions are healthy).– Carr0t
Nov 22 '18 at 16:00
kafka version is 1.1
– Hackaholic
Nov 22 '18 at 16:08
kafka version is 1.1
– Hackaholic
Nov 22 '18 at 16:08
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53434014%2fkafka-list-all-partition-with-no-leader%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
