Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
142 commits
Select commit Hold shift + click to select a range
493d2ed
[fix][doc] broken command (#18869)
tisonkun Dec 12, 2022
25866a3
[improve][cli] handle help flag properly (#18832)
tisonkun Dec 12, 2022
1be5a69
[fix][txn] Fix PendingAckHandleImpl when `pendingAckStoreProvider.che…
tjiuming Dec 12, 2022
bdbb118
[fix][broker] Ignore the exception of creating namespace (#18837)
nodece Dec 12, 2022
9917aac
[improve][broker] Fast return when AppendIndexMetadataInterceptor is …
Nicklee007 Dec 12, 2022
1cd20c5
[improve][misc] Upgrade Netty to 4.1.86.Final and Netty Tcnative to 2…
lhotari Dec 13, 2022
eb3a4bf
[fix][ci] Fix running OWASP for PRs that change dependencies (#18892)
lhotari Dec 13, 2022
4a0b775
[improve][doc] improve doc and fix errors (#18860)
labuladong Dec 13, 2022
7e258af
[fix][client] moving get sequenceId into the sync code segment (#17836)
liangyepianzhou Dec 13, 2022
0a2d927
[improve][client] Implement equals by compareTo to avoid logic unalig…
tisonkun Dec 13, 2022
1df65b9
[fix][cli] Pulsar shell: allow absolute config file (#18805)
nicoloboschi Dec 13, 2022
83922c2
[fix][txn] Fix replication of transactional messages (#18896)
nicoloboschi Dec 13, 2022
a489dcd
[cleanup][build] Bump master branch to 2.12.0-SNAPSHOT (#18905)
nicoloboschi Dec 13, 2022
01e7eac
[improve][doc] ProducerBuilder.java (#18809)
mendonk Dec 13, 2022
789122b
[fix][broker] Fix namespace deletion if __change_events topic has not…
nicoloboschi Dec 13, 2022
fdba644
[refactor][doc] Improve schema docs (#18434)
momo-jun Dec 14, 2022
f4e4fd5
[improve][broker] Add config `fsyncEnable` for `RocksdbMetadataStore`…
coderzc Dec 14, 2022
5dcc9b0
[fix][broker] Fix incorrect Nic usage collected by pulsar (#18882)
thetumbled Dec 14, 2022
27427b3
[cleanup][doc] Delete site2/website/static directory (#18900)
tisonkun Dec 14, 2022
7cce3c5
[cleanup][misc] Remove website legacy tools (#18902)
tisonkun Dec 14, 2022
9881c59
[cleanup][doc] Adapter and manager data (#18918)
tisonkun Dec 14, 2022
52c382a
[improve][doc] Added docs for key shared subscription hashing schemes…
asafm Dec 14, 2022
9e8bf7a
[improve][cli] Option to create replicated subscriptions in pulsar-pe…
nicoloboschi Dec 14, 2022
7642604
[fix][doc] fix rest api `partitioned-internalStats` is missing in doc…
urfreespace Dec 14, 2022
050b310
[fix][broker] Fix the breaking change of standalone metadata initiali…
BewareMyPower Dec 14, 2022
4129583
[fix][misc] do not require encryption on system topics (#18898)
nicoloboschi Dec 14, 2022
558260b
[fix] Change link to Slack workspace auto-invite (#18933)
merlimat Dec 15, 2022
a951549
[fix][io] Only bundle kafka schema registry client (#18931)
nicoloboschi Dec 15, 2022
1107af2
[fix][client] Fix update response body text (#18794)
tuteng Dec 15, 2022
3011946
[fix][sec] Upgrade scala-library to get rid of CVE-2022-36944 (#18021)
nicoloboschi Dec 15, 2022
b1f9e35
[improve][cli] pulsar-perf: check for invalid CLI options (#18889)
pgier Dec 15, 2022
a35670d
[improve][txn] fix error in recoverTracker.handleCommittingAndAbortin…
TakaHiR07 Dec 16, 2022
56ad217
[improve][monitor] Rename "GC Pauses" to "GC Time" in Pulsar JVM dash…
lhotari Dec 16, 2022
1d9956c
[fix][txn] transaction pending ack store future not completely proble…
congbobo184 Dec 16, 2022
fdebf50
[cleanup][broker] Remove duplicate code to improve delete subscriptio…
nodece Dec 16, 2022
e9a9364
[cleanup][io] Remove useless kafka server dep in debezium sources (#1…
nicoloboschi Dec 16, 2022
3bb052a
[fix][txn] producer may reject a message from client but actually wri…
nicoloboschi Dec 16, 2022
b9446aa
[fix] [tx] Transaction buffer recover blocked by readNext (#18833)
poorbarcode Dec 17, 2022
002fa49
[improve][cli] pulsar cli: use return code 1 for general error (#18946)
pgier Dec 17, 2022
4ac9305
[feat][broker][PIP-195] Support internal cursor properties - part4 (#…
coderzc Dec 19, 2022
e07b67f
[fix][broker]Update interceptor handler exception (#18940)
tuteng Dec 19, 2022
feb3cb4
[fix][doc] typo in functions-runtime (#18976)
0xflotus Dec 19, 2022
8f1c1b1
[fix][broker]fix multi invocation for ledger createComplete (#18975)
aloyszhang Dec 19, 2022
fa8a5b2
[feat][broker][PIP-195] Implement BookkeeperBucketSnapshotStorage - p…
coderzc Dec 20, 2022
83aaa0d
[fix][client] Fix too many redelivered messages when one message acke…
AnonHxy Dec 20, 2022
6dac18a
[improve][doc] Update PR template and PIP for metrics changes (#18961)
codelipenghui Dec 20, 2022
a95bb63
[fix][doc] Ammend PIP proposal around discussions (#18974)
asafm Dec 20, 2022
83993ae
[fix] [broker] getLastMessageId returns a wrong batch index of last m…
poorbarcode Dec 20, 2022
3177345
[fix][sec] upgrade org.testng:testng to 7.7.0 (#18977)
pen4 Dec 20, 2022
a408e9e
[fix][broker] Copy proto command fields into final variables in Serve…
michaeljmarshall Dec 20, 2022
37ea179
[fix][doc]Fix indentation problem in docker-compose.yaml (#18994)
liangyepianzhou Dec 20, 2022
22866bd
[fix][broker] Fix deadlock in PendingAckHandleImpl (#18989)
nicoloboschi Dec 20, 2022
6746553
[improve][io] reduce dependencies of pulsar-io-common module (#19000)
nicoloboschi Dec 20, 2022
f360807
[improve][broker] Add javadoc for PulsarDecoder handle* method parame…
lhotari Dec 20, 2022
154d352
[fix][test] Fix flaky test PulsarMultiListenersWithoutInternalListene…
lhotari Dec 20, 2022
1154d0a
[improve][broker] Omit making a copy of CommandAck when there are no …
lhotari Dec 20, 2022
46cacff
[fix][broker] Fix direct memory leak in RawReaderImpl (#18928)
lhotari Dec 20, 2022
423bd84
[fix][test] Run BlobStoreManagedLedgerOffloader* tests separately and…
lhotari Dec 20, 2022
ef0f385
[fix][broker] Fix thread-safety issue with currentLedgerEntries and c…
lhotari Dec 20, 2022
8b66a21
[improve][broker] Add logs for why namespace bundle been split (#19003)
codelipenghui Dec 20, 2022
05e6f5e
[improve][broker][client] PIP-215 Added TopicCompactionStrategy for S…
heesung-sohn Dec 21, 2022
5ea6790
[feat][io] Upgarde ClickHouse driver to support loadbalance policy (#…
tisonkun Dec 21, 2022
3b09016
[improve][admin]Remove repeating validateTopicOwnershipAsync action (…
gaozhangmin Dec 21, 2022
08591d9
[improve][io] Upgrade Kafka client, connect runtime to 2.8.2 and Conf…
lhotari Dec 21, 2022
3ea7568
[improve][broker] Use validateTopicOperationAsync methods in all case…
lhotari Dec 21, 2022
1666ecc
[feat][broker][PIP-195] Implement delayed message bucket snapshot rec…
coderzc Dec 22, 2022
8990855
[improve] Add PulsarExceptionBase class that supports slf4j like para…
aahmed-se Dec 22, 2022
74017d5
[improve][broker] Only get consumer future when interceptor not null …
michaeljmarshall Dec 22, 2022
dc29f3a
[fix][broker]Update rest api response class (#18965)
tuteng Dec 22, 2022
41edd2e
[fix][txn] Correct the prompt message (#17009)
thetumbled Dec 22, 2022
f85d591
[feat][doc] add Pulsar API content (#19002)
Anonymitaet Dec 22, 2022
849bea6
Update .asf.yaml to avoid merge PRs without approvals to the active r…
codelipenghui Dec 23, 2022
64caf49
[fix][broker] Fix thread safety issue in info-internal admin api for …
lhotari Dec 23, 2022
513e671
Revert "Update .asf.yaml to avoid merge PRs without approvals to the …
codelipenghui Dec 23, 2022
38053b5
[improve][io] Debezium sources: Support loading config from secrets (…
Dec 23, 2022
aaf3a9a
[improve][client] Check topic pattern when creating consumer (#19029)
yuruguo Dec 23, 2022
cbf5487
[improve][misc] Send GitHub discussion notifications to commits@ (#19…
michaeljmarshall Dec 23, 2022
d8569cd
[fix][client] Prevent DNS reverse lookup when physical address is an …
lhotari Dec 23, 2022
fd5037d
[fix][broker] change name limitTime to limitTimeInSec (#19053)
StevenLuMT Dec 25, 2022
63bf0ab
[fix][doc] Stablize swagger docs (#19025)
tisonkun Dec 26, 2022
67bd947
[fix][doc] miss stats-internal for non-partition topic and wrong API …
ericsyh Dec 26, 2022
b42aed1
[improve][doc] Java example explaining code without using lombok (#19…
AlvaroStream Dec 26, 2022
82feb13
[fix][broker] Throw AlreadyClosedException while request to a closed …
codelipenghui Dec 26, 2022
9f9f73c
[improve][test] Move the SimpleProducerConsumerTest out of the flaky …
codelipenghui Dec 26, 2022
ef750a8
[fix][client] add support to TableView to read encrypted messages (#1…
rbarbey Dec 26, 2022
b24034f
[fix][proxy] Cleanup default collector registry when closing the Prox…
gaoran10 Dec 27, 2022
4f72fdb
[fix][client] ExtNonPersistentTopics and prevent prefix match (#19065)
tisonkun Dec 27, 2022
39429dc
[fix][sec] Upgrade woodstox to 5.4.0 (#19041)
nicoloboschi Dec 27, 2022
537d540
[fix][doc] Clarify order processing semantics for Key Shared Subscrip…
asafm Dec 27, 2022
a22da8a
[improve][io] Parameterize hadoop version for hdfs2 and hdfs3 (#19058)
sekikn Dec 27, 2022
3df9ecf
[fix][broker]fix missing return when internalGetReplicatedSubscriptio…
HQebupt Dec 27, 2022
492a9c3
[improve] Introduce the sync() API to ensure consistency on reads dur…
eolivelli Dec 27, 2022
2877221
[fix][client] retry letter producer respect auto schema (#19051)
tisonkun Dec 27, 2022
dc3b6f1
[improve][client] Change default threads from 1 to available processo…
codelipenghui Dec 28, 2022
1f59981
[improve][io] Add zstd support to hdfs2 and hdfs3 (#19050)
sekikn Dec 28, 2022
ea4d3b4
[fix][broker] forbid uploading BYTES schema with admin API (#18995)
labuladong Dec 28, 2022
753d4ee
[cleanup][doc] Counterpart of pulsar-site PR-345 (#19079)
tisonkun Dec 28, 2022
b5f84ca
[improve][doc] Use metadataServiceUri in favor of zkServers (#16159)
Dec 29, 2022
1e59e93
[fix][io] Include Alluxio in the distribution (#19095)
sekikn Dec 29, 2022
ae98392
[improve][doc] improve connector and client document (#19075)
labuladong Dec 29, 2022
a8da549
[improve][broker] PIP-192 Added LeastResourceUsageWithWeight broker a…
heesung-sohn Dec 29, 2022
62a2058
[improve][sec] Suppress false positive OWASP reports (#19105)
tisonkun Dec 29, 2022
c13f389
[refactor] Remove docs from the main repo (#19100)
tisonkun Dec 29, 2022
c611a1a
[fix][broker] Fix estimateBacklogFromPosition if position is greater …
AnonHxy Dec 30, 2022
ed33fb3
[fix][ci] Fix pulsar shell license issue (#19101)
Technoboy- Dec 30, 2022
36cff70
[fix][cli] Fix wrong description of pulsar-admin flags (#19108)
maxsxu Dec 30, 2022
e194c01
[improve][admin,broker] Add option to unloadNamespaceBundle with bund…
vineeth1995 Dec 31, 2022
b3f3e0b
[fix][admin] Keep new inputSpecs when updating sink configs (#19082)
Jan 2, 2023
1736396
[fix][sec] Upgrade jettison to 1.5.3 (#19038)
nicoloboschi Jan 2, 2023
f912fb3
[fix][build] Resolve OWASP Dependency Check false positives (#19120)
lhotari Jan 2, 2023
9ec1d07
[feat][broker][PIP-195]Implement Filter out all delayed messages and …
coderzc Jan 3, 2023
a2ec02d
[cleanup][broker] Fix ClusterDataImpl#clone and add test (#19126)
michaeljmarshall Jan 4, 2023
3bb93cb
[fix][broker][PIP-195] fix cursor skip read (#19124)
coderzc Jan 4, 2023
8790ed1
[fix][monitor] Fix the partitioned publisher topic stat aggregation b…
heesung-sohn Jan 4, 2023
a6516a8
[fix][broker] Topic could be in fenced state forever if deletion fail…
nicoloboschi Jan 4, 2023
3afc291
[improve][schema] Do not print error log with stacktrace for 404 (#19…
codelipenghui Jan 5, 2023
4b8f447
[feat][broker][PIP-195] Implement BucketDelayedDeliveryTrackerFactory…
coderzc Jan 5, 2023
593fcb8
[improve][io] Elasticsearch sink: Support loading config from secrets…
Jan 5, 2023
4028ad3
[improve][ci] Improve CI ssh access in forks, don't fail build if set…
lhotari Jan 5, 2023
c862356
[revert] "[fix][broker] change name limitTime to limitTimeInSec (#190…
michaeljmarshall Jan 8, 2023
badd69b
[fix][broker] fix ttl expiration block due to no-recoverable exceptio…
aloyszhang Jan 8, 2023
96f8262
[improve][broker] Add oshi library to help control OS resources. (#18…
mattisonchao Jan 9, 2023
56a7b89
[fix][broker] Reject create non existent persistent partitions. (#19086)
mattisonchao Jan 9, 2023
b05fddb
[improve][admin]internalGetMessageById shouldn't be allowed on partit…
gaozhangmin Jan 9, 2023
6335fa1
[cleanup][txn] Use MLTransactionMetadataStore in integration tests (#…
nicoloboschi Jan 9, 2023
e829672
[improve][broker] Add parameter check for create/update cluster. (#19…
mattisonchao Jan 9, 2023
90764e7
[fix][txn] Always send correct transaction id in end txn response (#1…
nicoloboschi Jan 10, 2023
9ef54fd
[improve][cli] Expose updateLocalTopicOnly to UpdatePartitionedCmd (#…
aloyszhang Jan 10, 2023
d6fcdb8
[improve][broker,proxy] Use ChannelVoidPromise to avoid useless promi…
nicoloboschi Jan 10, 2023
5171d81
[feat][ci] Add integration to ge.apache.org Gradle Enterprise server …
lhotari Jan 10, 2023
82b1357
[fix][build] Upgrade dependency-check-maven plugin to fix broken OWAS…
lhotari Jan 10, 2023
dda1437
[fix][io] Fix Alluxio sink to respect the alluxioMasterHost property …
sekikn Jan 11, 2023
7431381
[improve][broker] Add ref count for sticky hash to optimize the perfo…
codelipenghui Jan 11, 2023
932023d
[cleanup][broker] Pass subName to authz provider on unsubscribe (#19176)
michaeljmarshall Jan 11, 2023
0feaa45
[improve][broker]add NamespacePolicies and AntiAffinity check before …
Nicklee007 Jan 11, 2023
78ea7f0
[improve][broker]Use cursor.isActive instead to judge if cursor is ac…
gaozhangmin Jan 11, 2023
4b0dc9a
[fix][cli] Shell syntax (#19188)
tisonkun Jan 11, 2023
d96af0a
[fix][broker] Pass subName for subscription operations in ServerCnx (…
michaeljmarshall Jan 11, 2023
89b1ff1
[fix] Some typos in Cmd classes (#19190)
Nicklee007 Jan 12, 2023
b3eb409
[fix][broker] Fix update authentication data
nodece Nov 2, 2022
357035f
Fix review
nodece Jan 12, 2023
631cd02
Improve write
nodece Jan 12, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
The diff you're trying to view is too large. We only load the first 3000 changed files.
2 changes: 1 addition & 1 deletion .asf.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -87,5 +87,5 @@ notifications:
commits: commits@pulsar.apache.org
issues: commits@pulsar.apache.org
pullrequests: commits@pulsar.apache.org
discussions: dev@pulsar.apache.org
discussions: commits@pulsar.apache.org
jira_options: link label
9 changes: 9 additions & 0 deletions .github/PULL_REQUEST_TEMPLATE.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,12 @@ Fixes #xyz

Master Issue: #xyz

<!-- If the PR belongs to a PIP, please add the PIP link here -->

PIP: #xyz

<!-- Details of when a PIP is required and how the PIP process work, please see: https://github.com/apache/pulsar/blob/master/wiki/proposals/PIP.md -->

### Motivation

<!-- Explain here the context, and why you're making that change. What is the problem you're trying to solve. -->
Expand Down Expand Up @@ -50,6 +56,8 @@ This change added tests and can be verified as follows:

### Does this pull request potentially affect one of the following parts:

<!-- DO NOT REMOVE THIS SECTION. CHECK THE PROPER BOX ONLY. -->

*If the box was checked, please highlight the changes*

- [ ] Dependencies (add or upgrade a dependency)
Expand All @@ -60,6 +68,7 @@ This change added tests and can be verified as follows:
- [ ] The binary protocol
- [ ] The REST endpoints
- [ ] The admin CLI options
- [ ] The metrics
- [ ] Anything that affects deployment

### Documentation
Expand Down
36 changes: 36 additions & 0 deletions .github/actions/gradle-enterprise/action.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
#
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.
#

name: Configure Gradle Enterprise integration
description: Configure Gradle Enterprise when secret GE_ACCESS_TOKEN is available
inputs:
token:
description: 'The token for accessing Gradle Enterprise'
required: true
runs:
using: composite
steps:
- run: |
if [[ -n "${{ inputs.token }}" ]]; then
echo "::group::Configuring Gradle Enterprise for build"
cp .mvn/ge-extensions.xml .mvn/extensions.xml
echo "GRADLE_ENTERPRISE_ACCESS_KEY=${{ inputs.token }}" >> $GITHUB_ENV
echo "::endgroup::"
fi
shell: bash
16 changes: 15 additions & 1 deletion .github/actions/ssh-access/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -121,8 +121,22 @@ runs:
tmux set -t upterm window-size largest
echo '::endgroup::'
echo -e "\nSSH connection information"
# wait up to 10 seconds for upterm admin socket to appear
for i in {1..10}; do
ADMIN_SOCKET=$(find $HOME/.upterm -name "*.sock")
if [ ! -S "$ADMIN_SOCKET" ]; then
echo "Waiting for upterm admin socket to appear in ~/.upterm/*.sock ..."
sleep 1
else
echo "upterm admin socket available in $ADMIN_SOCKET"
break
fi
done
shopt -s nullglob
upterm session current --admin-socket ~/.upterm/*.sock
upterm session current --admin-socket ~/.upterm/*.sock || {
echo "Starting upterm failed."
exit 0
}
elif [[ "${{ inputs.action }}" == "wait" ]]; then
# only wait if upterm was installed
if command -v upterm &>/dev/null; then
Expand Down
7 changes: 7 additions & 0 deletions .github/workflows/ci-maven-cache-update.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -47,6 +47,8 @@ env:
jobs:
update-maven-dependencies-cache:
name: Update Maven dependency cache for ${{ matrix.name }}
env:
JOB_NAME: Update Maven dependency cache for ${{ matrix.name }}
runs-on: ${{ matrix.runs-on }}
timeout-minutes: 45

Expand Down Expand Up @@ -75,6 +77,11 @@ jobs:
- name: Tune Runner VM
uses: ./.github/actions/tune-runner-vm

- name: Configure Gradle Enterprise
uses: ./.github/actions/gradle-enterprise
with:
token: ${{ secrets.GE_ACCESS_TOKEN }}

- name: Detect changed files
if: ${{ github.event_name != 'schedule' }}
id: changes
Expand Down
9 changes: 8 additions & 1 deletion .github/workflows/ci-owasp-dependency-check.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,9 @@ env:
jobs:
run-owasp-dependency-check:
if: ${{ github.repository == 'apache/pulsar' }}
name: Run OWASP Dependency Check
name: Run OWASP Dependency Check for ${{ matrix.name }}
env:
JOB_NAME: Run OWASP Dependency Check for ${{ matrix.name }}
runs-on: ubuntu-20.04
timeout-minutes: 45
strategy:
Expand All @@ -55,6 +57,11 @@ jobs:
- name: Tune Runner VM
uses: ./.github/actions/tune-runner-vm

- name: Configure Gradle Enterprise
uses: ./.github/actions/gradle-enterprise
with:
token: ${{ secrets.GE_ACCESS_TOKEN }}

- name: Cache local Maven repository
uses: actions/cache@v3
with:
Expand Down
8 changes: 8 additions & 0 deletions .github/workflows/pulsar-ci-flaky.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -69,6 +69,8 @@ jobs:
build-and-test:
needs: preconditions
name: Flaky tests suite
env:
JOB_NAME: Flaky tests suite
runs-on: ubuntu-20.04
timeout-minutes: 100
if: ${{ needs.preconditions.outputs.docs_only != 'true' }}
Expand All @@ -79,10 +81,16 @@ jobs:
- name: Tune Runner VM
uses: ./.github/actions/tune-runner-vm

- name: Configure Gradle Enterprise
uses: ./.github/actions/gradle-enterprise
with:
token: ${{ secrets.GE_ACCESS_TOKEN }}

- name: Setup ssh access to build runner VM
# ssh access is enabled for builds in own forks
if: ${{ github.repository != 'apache/pulsar' && github.event_name == 'pull_request' }}
uses: ./.github/actions/ssh-access
continue-on-error: true
with:
limit-access-to-actor: true

Expand Down
Loading