Skip to content

Che-Theia editor failed to start #18255

@dmytro-ndp

Description

@dmytro-ndp

Describe the bug

Che Theia Editor stack on opening:
screenshot-Wait_for_workspace_readiness (2)

Screencast: https://youtu.be/4YvSEzBgj9A

Che Theia pod logs:
https://codeready-workspaces-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/basic-MultiUser-Che-check-e2e-tests-against-k8s/2678/artifact/logs-and-configs/workspace-logs/

2020-11-01 03:01:32.882 root INFO Theia app listening on http://127.0.0.1:3100. 
2020-11-01 03:01:32.891 root INFO [eclipse_che_github_auth_plugin.theia]: trying to decompress into "/tmp/theia-unpacked/eclipse_che_github_auth_plugin.theia"... 
2020-11-01 03:01:32.891 root INFO [eclipse_che_ports_plugin.theia]: trying to decompress into "/tmp/theia-unpacked/eclipse_che_ports_plugin.theia"... 
2020-11-01 03:01:32.892 root INFO [eclipse_che_telemetry_plugin.theia]: trying to decompress into "/tmp/theia-unpacked/eclipse_che_telemetry_plugin.theia"... 
2020-11-01 03:01:32.892 root INFO [eclipse_che_theia_containers_plugin.theia]: trying to decompress into "/tmp/theia-unpacked/eclipse_che_theia_containers_plugin.theia"... 
2020-11-01 03:01:32.892 root INFO [eclipse_che_theia_ssh_plugin.theia]: trying to decompress into "/tmp/theia-unpacked/eclipse_che_theia_ssh_plugin.theia"... 
2020-11-01 03:01:32.892 root INFO [eclipse_che_welcome_plugin.theia]: trying to decompress into "/tmp/theia-unpacked/eclipse_che_welcome_plugin.theia"... 
2020-11-01 03:01:32.892 root INFO [eclipse_che_workspace_plugin.theia]: trying to decompress into "/tmp/theia-unpacked/eclipse_che_workspace_plugin.theia"... 
2020-11-01 03:01:32.892 root INFO [task_plugin.theia]: trying to decompress into "/tmp/theia-unpacked/task_plugin.theia"... 
2020-11-01 03:01:32.892 root INFO [theia_yeoman_plugin.theia]: trying to decompress into "/tmp/theia-unpacked/theia_yeoman_plugin.theia"... 
2020-11-01 03:01:32.896 root INFO PluginTheiaDirectoryHandler: accepting plugin with path Params: /plugins/installed.json
2020-11-01 03:01:32.896 root INFO PluginTheiaDirectoryHandler: accepting plugin with path Params: /plugins/sidecars
2020-11-01 03:01:32.897 root ERROR Failed to load plugin dependencies from '/plugins/installed.json' path Params: Error: ENOTDIR: not a directory, open '/plugins/installed.json/package.json'
2020-11-01 03:01:32.898 root ERROR Failed to load plugin dependencies from '/plugins/sidecars' path Params: Error: ENOENT: no such file or directory, open '/plugins/sidecars/package.json'
2020-11-01 03:01:32.964 root ERROR Security problem: Unable to configure separate webviews domain:  Params: Error: Unable to get workspace containers. Cause: [object Object]
    at CheServerWorkspaceServiceImpl.<anonymous> (/home/theia/node_modules/@eclipse-che/theia-remote-api/lib/node/che-server-workspace-service-impl.js:184:31)
    at step (/home/theia/node_modules/@eclipse-che/theia-remote-api/lib/node/che-server-workspace-service-impl.js:53:23)
    at Object.throw (/home/theia/node_modules/@eclipse-che/theia-remote-api/lib/node/che-server-workspace-service-impl.js:34:53)
    at rejected (/home/theia/node_modules/@eclipse-che/theia-remote-api/lib/node/che-server-workspace-service-impl.js:26:65)
    at processTicksAndRejections (internal/process/task_queues.js:97:5)
...
2020-11-01 03:04:15.721 root ERROR Failed to load plugins: Params: Error: Request 'findUniqueEndpointByAttribute' failed
    at Proxy.<anonymous> (https://static.developers.redhat.com/che/theia_artifacts/theia.7f287bc124d096ce3823.js:1:1529562)
    at t.<anonymous> (https://static.developers.redhat.com/che/theia_artifacts/theia.7f287bc124d096ce3823.js:1:1865943)
    at https://static.developers.redhat.com/che/theia_artifacts/theia.7f287bc124d096ce3823.js:1:1865306
    at Object.next (https://static.developers.redhat.com/che/theia_artifacts/theia.7f287bc124d096ce3823.js:1:1865411)
    at a (https://static.developers.redhat.com/che/theia_artifacts/theia.7f287bc124d096ce3823.js:1:1864125)
2020-11-01 03:04:16.146 root INFO Changed application state from 'initialized_layout' to 'ready'. 
2020-11-01 03:04:25.313 root INFO >>> Storing the layout... 

Che version

  • latest
  • nightly
  • other: please specify

Steps to reproduce

  1. Deploy nightly Eclipse Che to minikube / minishift.
  2. Create and open workspace.

Expected behavior

Workspace has started

Runtime

  • kubernetes (include output of kubectl version)
  • Openshift (include output of oc version)
  • minikube 1.1.1
  • minishift 3.11
  • docker-desktop + K8S (include output of docker version and kubectl version)
  • other: (please specify)

Screenshots

Installation method

chectl server:start --k8spodreadytimeout=180000 --listr-renderer=verbose --platform=minikube --che-operator-cr-patch-yaml=custom-resource-patch.yaml --chenamespace=eclipse-che

where custom-resource-patch.yaml:

spec:
  server:
    cheImage: 'quay.io/eclipse/che-server'
    cheImageTag: 'nightly'
    customCheProperties:
      CHE_LIMITS_USER_WORKSPACES_RUN_COUNT: '-1'
  auth:
    updateAdminPassword: false
  • OperatorHub
  • I don't know

Environment

  • my computer
    • Windows
    • Linux
    • macOS
  • Cloud
    • Amazon
    • Azure
    • GCE
    • other (please specify)
  • other: please specify

Eclipse Che Logs

Che Server pod logs:
https://codeready-workspaces-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/basic-MultiUser-Che-check-e2e-tests-against-k8s/2678/artifact/logs-and-configs/che-logs/

2020-11-01 03:00:12,847[nio-8080-exec-7]  [INFO ] [o.e.c.a.w.s.WorkspaceManager 694]    - Workspace 'admin/petclinic-dev-environment' with id 'workspacelof0ryy1dy4de611' created by user 'admin'
2020-11-01 03:00:13,864[nio-8080-exec-6]  [WARN ] [k.n.KubernetesNamespaceFactory 627]  - Trying to fetch namespaces with labels '{app.kubernetes.io/part-of=che.eclipse.org, app.kubernetes.io/component=workspaces-namespace}', but failed for lack of permissions. Cause: 'Failure executing: GET at: https://10.96.0.1/api/v1/namespaces?labelSelector=app.kubernetes.io%2Fpart-of%3Dche.eclipse.org%2Capp.kubernetes.io%2Fcomponent%3Dworkspaces-namespace. Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. namespaces is forbidden: User "system:serviceaccount:eclipse-che:che" cannot list resource "namespaces" in API group "" at the cluster scope.'
2020-11-01 03:00:13,977[nio-8080-exec-6]  [INFO ] [o.e.c.a.w.s.WorkspaceRuntimes 480]   - Starting workspace 'admin/petclinic-dev-environment' with id 'workspacelof0ryy1dy4de611' by user 'admin'
2020-11-01 03:00:14,056[aceSharedPool-0]  [WARN ] [i.f.k.c.i.VersionUsageUtils 60]      - The client is using resource type 'ingresses' with unstable version 'v1beta1'
2020-11-01 03:00:14,197[aceSharedPool-0]  [WARN ] [k.n.KubernetesNamespaceFactory 627]  - Trying to fetch namespaces with labels '{app.kubernetes.io/part-of=che.eclipse.org, app.kubernetes.io/component=workspaces-namespace}', but failed for lack of permissions. Cause: 'Failure executing: GET at: https://10.96.0.1/api/v1/namespaces?labelSelector=app.kubernetes.io%2Fpart-of%3Dche.eclipse.org%2Capp.kubernetes.io%2Fcomponent%3Dworkspaces-namespace. Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. namespaces is forbidden: User "system:serviceaccount:eclipse-che:che" cannot list resource "namespaces" in API group "" at the cluster scope.'
2020-11-01 03:00:14,795[aceSharedPool-0]  [WARN ] [k.n.KubernetesNamespaceFactory 627]  - Trying to fetch namespaces with labels '{app.kubernetes.io/part-of=che.eclipse.org, app.kubernetes.io/component=workspaces-namespace}', but failed for lack of permissions. Cause: 'Failure executing: GET at: https://10.96.0.1/api/v1/namespaces?labelSelector=app.kubernetes.io%2Fpart-of%3Dche.eclipse.org%2Capp.kubernetes.io%2Fcomponent%3Dworkspaces-namespace. Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. namespaces is forbidden: User "system:serviceaccount:eclipse-che:che" cannot list resource "namespaces" in API group "" at the cluster scope.'
2020-11-01 03:00:25,819[aceSharedPool-0]  [WARN ] [k.n.KubernetesNamespaceFactory 627]  - Trying to fetch namespaces with labels '{app.kubernetes.io/part-of=che.eclipse.org, app.kubernetes.io/component=workspaces-namespace}', but failed for lack of permissions. Cause: 'Failure executing: GET at: https://10.96.0.1/api/v1/namespaces?labelSelector=app.kubernetes.io%2Fpart-of%3Dche.eclipse.org%2Capp.kubernetes.io%2Fcomponent%3Dworkspaces-namespace. Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. namespaces is forbidden: User "system:serviceaccount:eclipse-che:che" cannot list resource "namespaces" in API group "" at the cluster scope.'
2020-11-01 03:01:33,445[aceSharedPool-0]  [INFO ] [o.e.c.a.w.s.WorkspaceRuntimes 965]   - Workspace 'admin:petclinic-dev-environment' with id 'workspacelof0ryy1dy4de611' started by user 'admin'

Additional context

Che server warnings were expected, and had been appeared in earlier Che versions when workspace had started successfully.

Issue hasn't been reproduced in Eclipse Che 7.21.0 https://github.com/eclipse/che-theia/commits/7.21.x
Eclipse Che 7.21.0 workspace logs to compare: https://codeready-workspaces-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/basic-MultiUser-Che-check-e2e-tests-against-k8s/2699/artifact/logs-and-configs/workspace-logs/

Metadata

Metadata

Assignees

Labels

area/editor/theiaIssues related to the che-theia IDE of Chee2e-test/failureIssues that is related to a test failures reported by our CI platform and our QE.kind/bugOutline of a bug - must adhere to the bug report template.severity/blockerCauses system to crash and be non-recoverable or prevents Che developers from working on Che code.

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions