Feature/website next preview test - #80
Open
urfreespace wants to merge 46 commits into
Open
Conversation
…ar Functions/Pulsar IO/Pulsar SQL (apache#13098) * commit 2.5.0 chapter Get Started Concepts and Architecture Pulsar Schema * commit version 2.5.0 Pulsar Functions/Pulsar IO/Pulsar SQL Co-authored-by: Anonymitaet <50226895+Anonymitaet@users.noreply.github.com>
…rnetes (Helm)/Deployment/Administration (apache#13099) * commit 2.5.0 chapter Get Started Concepts and Architecture Pulsar Schema * commit version 2.5.0 Pulsar Functions/Pulsar IO/Pulsar SQL * Kubernetes (Helm)/Deployment/Administration Co-authored-by: Anonymitaet <50226895+Anonymitaet@users.noreply.github.com>
…rity/Client Libraries/Admin API/Adaptors (apache#13100) * commit 2.5.0 chapter Get Started Concepts and Architecture Pulsar Schema * commit version 2.5.0 Pulsar Functions/Pulsar IO/Pulsar SQL * Kubernetes (Helm)/Deployment/Administration * Security/Client Libraries/Admin API/Adaptors Co-authored-by: Anonymitaet <50226895+Anonymitaet@users.noreply.github.com>
…books/Development/Reference (apache#13101) * commit 2.5.0 chapter Get Started Concepts and Architecture Pulsar Schema * commit version 2.5.0 Pulsar Functions/Pulsar IO/Pulsar SQL * Kubernetes (Helm)/Deployment/Administration * Security/Client Libraries/Admin API/Adaptors * Cookbooks/Development/Reference Co-authored-by: Anonymitaet <50226895+Anonymitaet@users.noreply.github.com>
…Started/Concepts and Architecture/Pulsar Schema (apache#13104) * commit 2.5.0 chapter Get Started Concepts and Architecture Pulsar Schema * commit version 2.5.0 Pulsar Functions/Pulsar IO/Pulsar SQL * Kubernetes (Helm)/Deployment/Administration * Security/Client Libraries/Admin API/Adaptors * Cookbooks/Development/Reference * Get Started/Concepts and Architecture/Pulsar Schema Co-authored-by: Anonymitaet <50226895+Anonymitaet@users.noreply.github.com>
…ar Functions/Pulsar IO/Pulsar SQL (apache#13105) * commit 2.5.0 chapter Get Started Concepts and Architecture Pulsar Schema * commit version 2.5.0 Pulsar Functions/Pulsar IO/Pulsar SQL * Kubernetes (Helm)/Deployment/Administration * Security/Client Libraries/Admin API/Adaptors * Cookbooks/Development/Reference * Get Started/Concepts and Architecture/Pulsar Schema * Pulsar Functions/Pulsar IO/Pulsar SQL Co-authored-by: Anonymitaet <50226895+Anonymitaet@users.noreply.github.com>
Motivation
The helm deployment of pulsar with azure Multi Tiered Offloading enabled would fail, as broker.conf is missing the required key managedLedgerOffloadBucket. This is evident when deploying pulsar via the pulsar-helm-chart with the command below.
helm install \
--values $HELM_CHART_DIR/ci-archive/azure-no-test.yaml \
--values bucket-values.yaml \
--set enableAntiAffinity=0 \
--set storageOffload.storageAccount=$AZURE_STORAGE_ACCOUNT \
--set storageOffload.storageAccountKey=$AZURE_STORAGE_ACCESS_KEY \
--dependency-update --debug --version=1.2.1 \
pulsar $HELM_CHART_DIR
Where HELM_CHART_DIR contains the path to the latest version of the helm chart. This issue can be reproduced by undoing the workaround I applied to the helm chart and described below.
The workaround consists of the line (also below) from broker-configmap.yaml . Then, launching the helm install above will only inject the env variable managedLedgerOffloadBucket without adding it to /pulsar/conf/broker.conf.
# workaround to inject it in the broker.conf (problem: gets injected also in client.conf)
PULSAR_PREFIX_managedLedgerOffloadBucket: "{{ .Values.storageOffload.bucket }}"
As a result, running the following commands on the broker pod
/pulsar/bin/pulsar-admin topics create public/default/offload
/pulsar/bin/pulsar-admin topics create-subscription public/default/offload -m earliest -s sub
/pulsar/bin/pulsar-perf produce -n 1 public/default/offload -m 10000 -s 20
/pulsar/bin/pulsar-admin topics offload -s 1M public/default/offload
/pulsar/bin/pulsar-admin topics offload-status public/default/offload
will lead to the error:
Error in offload
null
Reason: Error offloading: org.apache.bookkeeper.mledger.ManagedLedgerException: java.util.concurrent.CompletionException: java.lang.NullPointerException: Null containerName
The disadvantage of the workaround (and hence the need for this fix) is that managedLedgerOffloadBucket would then be injected also on the client.conf by apply-config-from-env.py.
Modifications
Addition of the managedLedgerOffloadBucket to broker.conf.
…oyment/Administration/Security (apache#13106) * commit 2.5.0 chapter Get Started Concepts and Architecture Pulsar Schema * commit version 2.5.0 Pulsar Functions/Pulsar IO/Pulsar SQL * Kubernetes (Helm)/Deployment/Administration * Security/Client Libraries/Admin API/Adaptors * Cookbooks/Development/Reference * Get Started/Concepts and Architecture/Pulsar Schema * Pulsar Functions/Pulsar IO/Pulsar SQL * Deployment/Administration/Security Co-authored-by: Anonymitaet <50226895+Anonymitaet@users.noreply.github.com>
…nt Libraries/Admin API/Adaptors/Cookbooks/Development/Reference (apache#13107) * commit 2.5.0 chapter Get Started Concepts and Architecture Pulsar Schema * commit version 2.5.0 Pulsar Functions/Pulsar IO/Pulsar SQL * Kubernetes (Helm)/Deployment/Administration * Security/Client Libraries/Admin API/Adaptors * Cookbooks/Development/Reference * Get Started/Concepts and Architecture/Pulsar Schema * Pulsar Functions/Pulsar IO/Pulsar SQL * Deployment/Administration/Security * Client Libraries/Admin API/Adaptors/Cookbooks/Development/Reference * patch Co-authored-by: Anonymitaet <50226895+Anonymitaet@users.noreply.github.com>
* Add guide to copy file source connector to container Added instruction to copy file source connector into docker image. Adjusted numbers accordingly * spelling correction * added restart command and sentence suggestion * Update site2/docs/io-file-source.md Co-authored-by: Anonymitaet <50226895+Anonymitaet@users.noreply.github.com> Co-authored-by: Anonymitaet <50226895+Anonymitaet@users.noreply.github.com>
### Motivation We shoud not generate the statistics of a uninitialized PendingAck,and we should check if it is initialized when we get it by `getStoreManageLedger()`. ### Modifications Shoud not generate the statistics of a uninitialized PendingAck Add check if it is initialized when we get it by `getStoreManageLedger()`.
…2930) * replace thenAccept with thenAcceptAsync to avoid deadlock. * Use pulsar executor. Co-authored-by: Bharani Chadalavada <bchadalavada@splunk.com>
Signed-off-by: LiLi <urfreespace@gmail.com>
…ion (apache#12450) * fix updateSink fail to update cleanupSubscription * fix getSinkInfo miss cleanupSubscription Co-authored-by: wangjialing <wangjialing@cmss.chinamobile.com>
…t started/concepts/schema (apache#13142) Signed-off-by: LiLi <urfreespace@gmail.com> Co-authored-by: Anonymitaet <50226895+Anonymitaet@users.noreply.github.com>
…nctions/io/sql (apache#13143) * [website][upgrade]feat: website upgrade / docs migration - 2.4.1 / get started/concepts/schema Signed-off-by: LiLi <urfreespace@gmail.com> * [website][upgrade]feat: website upgrade / docs migration - 2.4.1 / functions/io/sql Signed-off-by: LiLi <urfreespace@gmail.com> Co-authored-by: Anonymitaet <50226895+Anonymitaet@users.noreply.github.com>
…ployment/administration/security (apache#13144) * [website][upgrade]feat: website upgrade / docs migration - 2.4.1 / get started/concepts/schema Signed-off-by: LiLi <urfreespace@gmail.com> * [website][upgrade]feat: website upgrade / docs migration - 2.4.1 / functions/io/sql Signed-off-by: LiLi <urfreespace@gmail.com> * [website][upgrade]feat: website upgrade / docs migration - 2.4.1 / deployment/administration/security Signed-off-by: LiLi <urfreespace@gmail.com> Co-authored-by: Anonymitaet <50226895+Anonymitaet@users.noreply.github.com>
…ient/admin api/adaptors (apache#13145) * [website][upgrade]feat: website upgrade / docs migration - 2.4.1 / get started/concepts/schema Signed-off-by: LiLi <urfreespace@gmail.com> * [website][upgrade]feat: website upgrade / docs migration - 2.4.1 / functions/io/sql Signed-off-by: LiLi <urfreespace@gmail.com> * [website][upgrade]feat: website upgrade / docs migration - 2.4.1 / deployment/administration/security Signed-off-by: LiLi <urfreespace@gmail.com> * [website][upgrade]feat: website upgrade / docs migration - 2.4.1 / client/admin api/adaptors Signed-off-by: LiLi <urfreespace@gmail.com> Co-authored-by: Anonymitaet <50226895+Anonymitaet@users.noreply.github.com>
…okbooks/development/reference (apache#13146) * [website][upgrade]feat: website upgrade / docs migration - 2.4.1 / get started/concepts/schema Signed-off-by: LiLi <urfreespace@gmail.com> * [website][upgrade]feat: website upgrade / docs migration - 2.4.1 / functions/io/sql Signed-off-by: LiLi <urfreespace@gmail.com> * [website][upgrade]feat: website upgrade / docs migration - 2.4.1 / deployment/administration/security Signed-off-by: LiLi <urfreespace@gmail.com> * [website][upgrade]feat: website upgrade / docs migration - 2.4.1 / client/admin api/adaptors Signed-off-by: LiLi <urfreespace@gmail.com> * [website][upgrade]feat: website upgrade / docs migration - 2.4.1 / cookbooks/development/reference Signed-off-by: LiLi <urfreespace@gmail.com> * test Signed-off-by: LiLi <urfreespace@gmail.com> * patch Signed-off-by: LiLi <urfreespace@gmail.com> Co-authored-by: Anonymitaet <50226895+Anonymitaet@users.noreply.github.com>
Without this fix, the autorecovery pod initialisation will fail with error:
`[0.001s][error][logging] Error opening log file 'logs/pulsar_bookie_gc_1.log': No such file or directory`
…ache#13168) - the phase must be set to verify - unless this is specified, modernizer-maven-plugin will analyse outdated class files
…dle (apache#13159) Co-authored-by: wuzhanpeng <wuzhanpeng@bigo.sg>
…t exception (apache#13171) * [Proxy] Print stacktrace in uncaught exception handler * [Proxy] Fix IllegalStateException: Insufficient configured threads - happens at startup since the proxy client consumes 50% of number of available CPU cores for selectors
…ent (apache#12490) * fix JsonSchema, copy data out to prevent modifying the reference object, check keys before deleting them * add unit test, but cannot test due to compilation failure for cpp lib
apache#12779) * [Java Client] Use epoch to version producer's cnx to prevent early delivery of messages * Update initial epoch value: it now gets incremented before the first connection
…arted/concept/functions Signed-off-by: LiLi <urfreespace@gmail.com>
…/sql/deployment Signed-off-by: LiLi <urfreespace@gmail.com>
…ministration/client/security Signed-off-by: LiLi <urfreespace@gmail.com>
…aptors/admin/cookbooks Signed-off-by: LiLi <urfreespace@gmail.com>
…velop/io/reference Signed-off-by: LiLi <urfreespace@gmail.com>
Signed-off-by: LiLi <urfreespace@gmail.com>
|
The pr had no activity for 30 days, mark with Stale label. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
14 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
(If this PR fixes a github issue, please add
Fixes #<xyz>.)Fixes #
(or if this PR is one task of a github issue, please add
Master Issue: #<xyz>to link to the master issue.)Master Issue: #
Motivation
Explain here the context, and why you're making that change. What is the problem you're trying to solve.
Modifications
Describe the modifications you've done.
Verifying this change
(Please pick either of the following options)
This change is a trivial rework / code cleanup without any test coverage.
(or)
This change is already covered by existing tests, such as (please describe tests).
(or)
This change added tests and can be verified as follows:
(example:)
Does this pull request potentially affect one of the following parts:
If
yeswas chosen, please highlight the changesDocumentation
Check the box below and label this PR (if you have committer privilege).
Need to update docs?
doc-required(If you need help on updating docs, create a doc issue)
no-need-doc(Please explain why)
doc(If this PR contains doc changes)