-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[run-tests] feat:allow client skips the non-continued deleted ranges stats #4
Commits on Oct 19, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 26b47ff - Browse repository at this point
Copy the full SHA 26b47ffView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7e5cad7 - Browse repository at this point
Copy the full SHA 7e5cad7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 912f344 - Browse repository at this point
Copy the full SHA 912f344View commit details -
[improve][broker]consumer backlog eviction policy should not reset re…
…ad position for consumer (apache#18037) ### Motivation Fixes apache#18036 ### Modifications - The backlog eviction policy should use `asyncMarkDelete` instead of `resetCursor` in order to move the mark delete position.
Configuration menu - View commit details
-
Copy full SHA for 7404e0d - Browse repository at this point
Copy the full SHA 7404e0dView commit details
Commits on Oct 20, 2022
-
[fix][test] Fix flaky test org.apache.pulsar.broker.service.persisten…
…t.PersistentSubscriptionMessageDispatchStreamingDispatcherThrottlingTest#setup (apache#18115)
Configuration menu - View commit details
-
Copy full SHA for 3eac221 - Browse repository at this point
Copy the full SHA 3eac221View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1225a24 - Browse repository at this point
Copy the full SHA 1225a24View commit details -
Configuration menu - View commit details
-
Copy full SHA for 10eaac2 - Browse repository at this point
Copy the full SHA 10eaac2View commit details -
Configuration menu - View commit details
-
Copy full SHA for de3dbaa - Browse repository at this point
Copy the full SHA de3dbaaView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3783ad2 - Browse repository at this point
Copy the full SHA 3783ad2View commit details -
Configuration menu - View commit details
-
Copy full SHA for cec8c91 - Browse repository at this point
Copy the full SHA cec8c91View commit details -
[improve][doc] Add code example for WebSocket API to use TLS with CLI…
… tools (apache#15485) * add a new section for websocket API * Update site2/docs/security-tls-transport.md Co-authored-by: Yunze Xu <[email protected]> * Update site2/docs/security-tls-transport.md Co-authored-by: Yunze Xu <[email protected]> * Update site2/docs/security-tls-transport.md Co-authored-by: Yunze Xu <[email protected]> * updates * updates * updates * update code snippet as per review comments Co-authored-by: Yunze Xu <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 5b452d1 - Browse repository at this point
Copy the full SHA 5b452d1View commit details -
[feat] [broker] PIP-188 support blue-green cluster migration [part-1] (…
…apache#17962) * [feat][PIP-188] support blue-green cluster migration [part-1] Add blue-green cluster migration Fix dependency * cleanup
Configuration menu - View commit details
-
Copy full SHA for b0945d1 - Browse repository at this point
Copy the full SHA b0945d1View commit details -
[fix] The Pulsar standalone bookie is not getting passed the config f…
…rom standalone.conf (apache#18126)
Configuration menu - View commit details
-
Copy full SHA for cbf5cf5 - Browse repository at this point
Copy the full SHA cbf5cf5View commit details -
Configuration menu - View commit details
-
Copy full SHA for e5b3ffd - Browse repository at this point
Copy the full SHA e5b3ffdView commit details -
[improve][io] JDBC sinks: implement JDBC Batch API (apache#18017)
* [improve][io] JDBC sinks: implement JDBC Batch API * more tests and transactions support * remove .db files * doc * fix batch results and thread safey * add next flush test - fix doc - improve code readability
Configuration menu - View commit details
-
Copy full SHA for 7b52a92 - Browse repository at this point
Copy the full SHA 7b52a92View commit details -
[fix][doc] Point Python and C++ docs to new GitHub repos (apache#18140)
* [fix][doc] Point Python and C++ docs to new GitHub repos * Fix cpp examples link * Add notice to redirect any users
Configuration menu - View commit details
-
Copy full SHA for a4d00eb - Browse repository at this point
Copy the full SHA a4d00ebView commit details -
[fix][broker] PulsarRegistrationClient - implement getAllBookies and …
…follow BookieServiceInfo updates (apache#18133) * [fix] PulsarRegistrationClient - implement getAllBookies and follow BookieServiceInfo updates * remove debug
Configuration menu - View commit details
-
Copy full SHA for 0c326c0 - Browse repository at this point
Copy the full SHA 0c326c0View commit details
Commits on Oct 21, 2022
-
[improve][client] Support MAX_ACK_GROUP_SIZE configurable (apache#18107)
### Motivation The current MAX_ACK_GROUP_SIZE is fixed at 1000, increase the configuration acknowledgementsGroupSize, support MAX_ACK_GROUP_SIZE configurable: https://github.com/apache/pulsar/blob/afcdbf0e2b5fb905e1f82f0220436f8f9ec0c742/pulsar-client/src/main/java/org/apache/pulsar/client/impl/PersistentAcknowledgmentsGroupingTracker.java#L63-L64 ### Modifications 1.Add configuration acknowledgementsGroupSize;
Configuration menu - View commit details
-
Copy full SHA for 092d3b3 - Browse repository at this point
Copy the full SHA 092d3b3View commit details -
[fix][client] Reserve allocated buffer in BatchMessageContainer on cl…
…ient memory limitation. (apache#17936)
Configuration menu - View commit details
-
Copy full SHA for 639393d - Browse repository at this point
Copy the full SHA 639393dView commit details -
Configuration menu - View commit details
-
Copy full SHA for b4bba3a - Browse repository at this point
Copy the full SHA b4bba3aView commit details -
[feat][ci] check style for all source code (apache#18142)
* [feat][ci] check style for all source code This closes apache#18131. * fix violations Signed-off-by: tison <[email protected]> * no snapshot update Signed-off-by: tison <[email protected]> * remove mysterious dependency Signed-off-by: tison <[email protected]> Signed-off-by: tison <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for ae7722b - Browse repository at this point
Copy the full SHA ae7722bView commit details -
When accumulating acks, update the batch index in batchDeletedIndexes…
… and check whether it is greater than the batch index of the previous ack (apache#18042) Co-authored-by: leolinchen <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for fa328a4 - Browse repository at this point
Copy the full SHA fa328a4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0854032 - Browse repository at this point
Copy the full SHA 0854032View commit details -
Configuration menu - View commit details
-
Copy full SHA for 330654a - Browse repository at this point
Copy the full SHA 330654aView commit details
Commits on Oct 22, 2022
-
[cleanup][misc] Fix imports using shaded dependencies (apache#18113)
Dave Maughan authoredOct 22, 2022 Configuration menu - View commit details
-
Copy full SHA for 845d992 - Browse repository at this point
Copy the full SHA 845d992View commit details
Commits on Oct 23, 2022
-
Configuration menu - View commit details
-
Copy full SHA for c55be38 - Browse repository at this point
Copy the full SHA c55be38View commit details -
Configuration menu - View commit details
-
Copy full SHA for 55d6c5f - Browse repository at this point
Copy the full SHA 55d6c5fView commit details
Commits on Oct 24, 2022
-
Support dynamic configuration of exposeBundlesMetricsInPrometheus (ap…
…ache#18148) Co-authored-by: leolinchen <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for b6d519c - Browse repository at this point
Copy the full SHA b6d519cView commit details -
Configuration menu - View commit details
-
Copy full SHA for bdbbb1e - Browse repository at this point
Copy the full SHA bdbbb1eView commit details -
Configuration menu - View commit details
-
Copy full SHA for e8db584 - Browse repository at this point
Copy the full SHA e8db584View commit details -
Configuration menu - View commit details
-
Copy full SHA for 39270f0 - Browse repository at this point
Copy the full SHA 39270f0View commit details -
[feat][broker] Segmented transaction buffer snapshot segment and inde…
…x system topic (apache#16931) Master Issue: apache#16913 ### Motivation Implement system topic client for snapshot segment topic and index topic to send segment snapshots or indexes. The configuration `transactionBufferSegmentedSnapshotEnabled` is used in the Transaction Buffer to determine which `AbortedTxnProcessor` is adopted by this TB. ### Modification In the new implementation of the Transaction Buffer Snapshot System topic, because the system topic that needs to be processed has changed from the original one to three with different schemes, we have added generics to the TransactionBufferSnapshotBaseSystemTopicClient class and the SystemTopicTxnBufferSnapshotService<T> class. And Pulsar Service maintains a factory class TransactionBufferSnapshotServiceFactory used to obtain SystemTopicTxnBufferSnapshotService. This way, we can obtain the required System topic client through pulsarService to read and send snapshots. <img width="1336" alt="image" src="https://user-images.githubusercontent.com/55571188/197467173-9028e58a-79cc-4fe4-81e2-c299c568caee.png">
Configuration menu - View commit details
-
Copy full SHA for d211766 - Browse repository at this point
Copy the full SHA d211766View commit details -
[fix][admin] Passing
force
parameter todeleteNamespaceBundle
whe……n delete namespaces (apache#18153) ### Motivation In the current implementation, don't pass the `force` parameter to `deleteNamespaceBundle` when deleting namespaces, we should pass the `force` parameter. ### Modifications Passing `force` parameter to `deleteNamespaceBundle` when delete namespaces.
Configuration menu - View commit details
-
Copy full SHA for d1b5c02 - Browse repository at this point
Copy the full SHA d1b5c02View commit details -
Configuration menu - View commit details
-
Copy full SHA for 031e37c - Browse repository at this point
Copy the full SHA 031e37cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7fee34d - Browse repository at this point
Copy the full SHA 7fee34dView commit details -
Configuration menu - View commit details
-
Copy full SHA for e913a10 - Browse repository at this point
Copy the full SHA e913a10View commit details -
[fix][storage] Autorecovery default reppDnsResolverClass to ZkBookieR…
…ackAffinityMapping (apache#15640) * [Autorecovery] Default reppDnsResolverClass to ZkBookieRackAffinityMapping * Improve documentation Fixes: apache#18012 ### Motivation The current Bookkeeper configuration defaults to using `org.apache.bookkeeper.net.ScriptBasedMapping` for the `DNSToSwitchMapping` implementation. However, this default configuration does not align with the Broker's default configuration, which is `org.apache.pulsar.zookeeper.ZkBookieRackAffinityMapping`. As such, the default configuration for a Pulsar cluster does not lead to ideal rack awareness when ledgers need to be recovered. The result is that a user can configure a cluster for rack awareness and the brokers will honor that configuration, but the autorecovery process will not because it does not have the correct bookkeeper cluster topology view. I propose we configure bookkeeper to use the broker's `ZkBookieRackAffinityMapping` class. That way, autorecovery will honor the operator's configured rack awareness policies out of the box. ### Modifications * Add default value for `reppDnsResolverClass` to the `conf/bookkeeper.conf` configuration. This change effectively switches the default from `org.apache.bookkeeper.net.ScriptBasedMapping` to `org.apache.pulsar.zookeeper.ZkBookieRackAffinityMapping`. ### Verifying this change I manually verified that the `ZkBookieRackAffinityMapping` works by running some tests in a minikube cluster deployed with the DataStax helm chart. I set up 3 racks, 4 bookies, and a topic with a E=2, Qw=2, and Qa=2. I then verified that the autorecovery pod correctly discovered the racks and then identified when an ensemble was not following the rack placement policy after two bookies were removed. I documented my testing a bit more here: datastax/pulsar-helm-chart#214. ### Does this pull request potentially affect one of the following parts: It changes a default value. The tradeoff is that a user relying on the `ScriptBasedMapping` default might accidentally get switched to using the `ZkBookieRackAffinityMapping` implementation. Given that `ScriptBasedMapping` doesn't work out of the box, and that the broker's default to `ZkBookieRackAffinityMapping`, I think this is an acceptable tradeoff. - [x] `doc`
Configuration menu - View commit details
-
Copy full SHA for 9812297 - Browse repository at this point
Copy the full SHA 9812297View commit details -
Configuration menu - View commit details
-
Copy full SHA for 31dad38 - Browse repository at this point
Copy the full SHA 31dad38View commit details -
[fix][doc] Reflect archived and halted repositories (apache#18067)
* [fix][doc] Remove archived and halted repositories * Add back archived repositories For anyone who wants to revive them. Signed-off-by: tison <[email protected]> Signed-off-by: tison <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 573c8f6 - Browse repository at this point
Copy the full SHA 573c8f6View commit details
Commits on Oct 25, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 91562d2 - Browse repository at this point
Copy the full SHA 91562d2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 82237d3 - Browse repository at this point
Copy the full SHA 82237d3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4ffa741 - Browse repository at this point
Copy the full SHA 4ffa741View commit details -
Configuration menu - View commit details
-
Copy full SHA for ae0153c - Browse repository at this point
Copy the full SHA ae0153cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 58765c1 - Browse repository at this point
Copy the full SHA 58765c1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 26aec17 - Browse repository at this point
Copy the full SHA 26aec17View commit details -
Configuration menu - View commit details
-
Copy full SHA for f63356c - Browse repository at this point
Copy the full SHA f63356cView commit details -
[fix][broker] do not serialize field bundleStats (apache#18150)
* do not serialize field bundleStats * add unit test. * use org.testng.Assert.assertFalse * add apache license header * fix doc * fix doc and change the package level. Co-authored-by: fengwenzhi <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 6cc30c9 - Browse repository at this point
Copy the full SHA 6cc30c9View commit details
Commits on Oct 26, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 9f91d7b - Browse repository at this point
Copy the full SHA 9f91d7bView commit details -
[doc] [client] [go] Add chunking to go-client doc (apache#17789)
* add go-client chunking doc * Update site2/docs/client-libraries-go.md Co-authored-by: Zixuan Liu <[email protected]> * Update site2/docs/client-libraries-go.md Co-authored-by: Anonymitaet <[email protected]> * Update site2/docs/client-libraries-go.md Co-authored-by: Anonymitaet <[email protected]> * Update site2/docs/client-libraries-go.md Co-authored-by: Anonymitaet <[email protected]> Co-authored-by: Zixuan Liu <[email protected]> Co-authored-by: Anonymitaet <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 29461bd - Browse repository at this point
Copy the full SHA 29461bdView commit details
Commits on Oct 27, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 6657fe4 - Browse repository at this point
Copy the full SHA 6657fe4View commit details -
[improve][doc] Improve the authentication enablement workflow across …
…multiple providers (apache#18035) * Update security-athenz.md * improve auth overview * address review comments * Improve OAuth2 authentication * improve Kerberos authentication * Update security-athenz.md
Configuration menu - View commit details
-
Copy full SHA for a48bc8b - Browse repository at this point
Copy the full SHA a48bc8bView commit details -
[improve][doc] cherry-pick cpp client docs installation section (apac…
…he#18188) * [improve][doc] cherry-pick cpp client docs installation section Signed-off-by: tison <[email protected]> * Apply suggestions from code review Co-authored-by: momo-jun <[email protected]> * Update client-libraries-cpp.md Signed-off-by: tison <[email protected]> Co-authored-by: momo-jun <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 59e00ba - Browse repository at this point
Copy the full SHA 59e00baView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5c1f8af - Browse repository at this point
Copy the full SHA 5c1f8afView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3d7f9e5 - Browse repository at this point
Copy the full SHA 3d7f9e5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1c78e0a - Browse repository at this point
Copy the full SHA 1c78e0aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5b7c5c6 - Browse repository at this point
Copy the full SHA 5b7c5c6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2c9e729 - Browse repository at this point
Copy the full SHA 2c9e729View commit details -
[fix][test] Fix flaky test `testDoNotGetOffloadPoliciesMultipleTimesW…
…henTrimLedgers` (apache#18147)
Configuration menu - View commit details
-
Copy full SHA for c7990b9 - Browse repository at this point
Copy the full SHA c7990b9View commit details -
Configuration menu - View commit details
-
Copy full SHA for b061c6a - Browse repository at this point
Copy the full SHA b061c6aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5e3f8ba - Browse repository at this point
Copy the full SHA 5e3f8baView commit details -
[fix] [pulsar-client] Fix pendingLookupRequestSemaphore leak when Ser… (
apache#18219) ### Motivation https://github.com/apache/pulsar/blob/b061c6ac5833c21e483368febebd0d30679a35e1/pulsar-client/src/main/java/org/apache/pulsar/client/impl/ClientCnx.java#L748-L774 The `pendingLookupRequestSemaphore` will leak when handleError. There are `LookUpRequestSemaphore` not released when removing it from `pendingRequests` related PR: apache#17856 ### Modifications We can't easily release the semaphore in `handleError`, because there are not only `LookUpRequest`. So release the semaphore when LookupException ### Verifying this change Add unit test case to cover this change ### Documentation <!-- DO NOT REMOVE THIS SECTION. CHECK THE PROPER BOX ONLY. --> - [ ] `doc-required` (Your PR needs to update docs and you will update later) - [x] `doc-not-needed` bug fixs, no need doc - [ ] `doc` (Your PR contains doc changes) - [ ] `doc-complete` (Docs have been already added)
Configuration menu - View commit details
-
Copy full SHA for fad3ccc - Browse repository at this point
Copy the full SHA fad3cccView commit details -
Configuration menu - View commit details
-
Copy full SHA for b193051 - Browse repository at this point
Copy the full SHA b193051View commit details
Commits on Oct 28, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 8f8637a - Browse repository at this point
Copy the full SHA 8f8637aView commit details -
[improve][test] Improve websocket.proxy tests based on Awaitility (ap…
…ache#18216) Signed-off-by: Zixuan Liu <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for d86a50c - Browse repository at this point
Copy the full SHA d86a50cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7a88cb7 - Browse repository at this point
Copy the full SHA 7a88cb7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 069ac87 - Browse repository at this point
Copy the full SHA 069ac87View commit details -
Configuration menu - View commit details
-
Copy full SHA for b7b9239 - Browse repository at this point
Copy the full SHA b7b9239View commit details -
[fix][offload] Fix the problem that ManagedLedger does not release lo…
…cks in some cases when offload (apache#18221)
Configuration menu - View commit details
-
Copy full SHA for 3f5acfe - Browse repository at this point
Copy the full SHA 3f5acfeView commit details -
[fix][cli] Fix CLI client produce don't able to use multiple -m send …
…multiple messages (apache#18238)
Configuration menu - View commit details
-
Copy full SHA for 67a3de7 - Browse repository at this point
Copy the full SHA 67a3de7View commit details -
[fix] Combination of autocreate + forced delete of partitioned topic …
…with active consumer leaves topic metadata inconsistent. (apache#18193)
Configuration menu - View commit details
-
Copy full SHA for 3fdbc9f - Browse repository at this point
Copy the full SHA 3fdbc9fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 46c0438 - Browse repository at this point
Copy the full SHA 46c0438View commit details
Commits on Oct 31, 2022
-
Configuration menu - View commit details
-
Copy full SHA for a31e804 - Browse repository at this point
Copy the full SHA a31e804View commit details
Commits on Nov 1, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 8a2e854 - Browse repository at this point
Copy the full SHA 8a2e854View commit details
Commits on Nov 2, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 8460be2 - Browse repository at this point
Copy the full SHA 8460be2View commit details