Run Test: slices-bi-singlenode-login 2026-03-11 16:00:50.044668 CET - Run: /usr/local/bin/uv pip install --upgrade slices-cli --extra-index-url=https://doc.slices-ri.eu/pypi/ 2026-03-11 16:00:54.051923 CET - Run: slices --version 2026-03-11 16:00:54.237123 CET - version: Slices CLI v2025.1.5 Slices CLI core v1.1.2 Slices CLI bi v2.0.2 Slices clientlib core v5.3.8 Slices clientlib bi v5.1.2 2026-03-11 16:00:54.237384 CET - Run: slices pubkey list --format text 2026-03-11 16:00:54.964934 CET - Pubkey already registered 2026-03-11 16:00:54.965170 CET - Run: slices bi infrastructure list --format csv --all --refresh 2026-03-11 16:00:55.519760 CET - Refreshed infrastructure list. Total: 22 entries. 2026-03-11 16:00:55.519864 CET - Check List Flavors 2026-03-11 16:00:55.520105 CET - Run: slices bi --infra de-munich-bi-vm flavor list -f json 2026-03-11 16:01:56.431778 CET - Check List DiskImages 2026-03-11 16:01:56.431977 CET - Run: slices bi --infra de-munich-bi-vm diskimage list -f json 2026-03-11 16:02:57.099901 CET - Requesting resources 2026-03-11 16:02:57.100409 CET - Cloudinit user data: #!/bin/sh echo "Hello World. The time is now $(date -R)!" | tee '/user_data_output.txt' 2026-03-11 16:02:57.100527 CET - Run: slices bi --infra de-munich-bi-vm create tst --image 'Ubuntu 24.04.3' --flavor tiny --duration 2h --experiment tst-defa7da3 --user-data /tmp/tmp_40uc7_f 2026-03-11 16:06:04.374531 CET - Resource ID: r_de-munich-bi-vm_01kkepxz1zekst3ddt93sxs8d5 2026-03-11 16:06:04.374667 CET - Waiting until resource ready 2026-03-11 16:06:06.375065 CET - Run: slices bi --infra de-munich-bi-vm list-resources --format json --experiment tst-defa7da3 tst 2026-03-11 16:07:07.129435 CET - Status: UP 2026-03-11 16:07:07.129482 CET - Experiment ID: exp_expauth.ilabt.imec.be_01kkepr99qewcagws5e98yz9kz 2026-03-11 16:07:07.129522 CET - Check if resources are registered in experiment 2026-03-11 16:07:07.129702 CET - Run: slices experiment list-resources --format json tst-defa7da3 2026-03-11 16:07:07.766572 CET - Status (on expauth): UP 2026-03-11 16:07:07.766708 CET - Testing extend expires_at (all resources in experiment) 2026-03-11 16:07:07.766840 CET - Run: slices bi --infra de-munich-bi-vm extend --duration 3h --experiment tst-defa7da3 2026-03-11 16:12:09.678301 CET - Run: slices bi --infra de-munich-bi-vm list-resources --format json --experiment tst-defa7da3 tst 2026-03-11 16:13:10.422201 CET - Testing extend expires_at (single resource in experiment) 2026-03-11 16:13:10.422424 CET - Run: slices bi --infra de-munich-bi-vm extend tst --duration 4h --experiment tst-defa7da3 2026-03-11 16:18:16.774726 CET - Run: slices bi --infra de-munich-bi-vm list-resources --format json --experiment tst-defa7da3 tst 2026-03-11 16:19:17.528152 CET - Testing ssh login 2026-03-11 16:19:17.538111 CET - Run: slices bi --infra de-munich-bi-vm ssh --no-exec --proxy on --show ssh_config --experiment tst-defa7da3 tst 2026-03-11 16:20:18.368283 CET - Run: slices bi --infra de-munich-bi-vm ssh --no-exec --proxy off --show server_pubkey_openssh --experiment tst-defa7da3 tst 2026-03-11 16:21:26.123350 CET - Run: slices bi --infra de-munich-bi-vm ssh --no-exec --proxy off --show proxy_pubkey_openssh --experiment tst-defa7da3 tst 2026-03-11 16:22:26.860211 CET - Logging in using 'slices bi ssh' 2026-03-11 16:22:26.860266 CET - Forcing IPv4 only. 2026-03-11 16:22:26.860417 CET - Run: slices bi --infra de-munich-bi-vm ssh --show nothing --experiment tst-defa7da3 tst -- -4 uname -a 2026-03-11 16:23:29.680878 CET - Forcing IPv4 only. 2026-03-11 16:23:29.681040 CET - Run: slices bi --infra de-munich-bi-vm ssh --show nothing --experiment tst-defa7da3 tst -- -4 uptime 2026-03-11 16:24:32.345156 CET - CLI SSH Test passed. 2026-03-11 16:24:32.345199 CET - Uname: Linux tst 6.8.0-87-generic #88-Ubuntu SMP PREEMPT_DYNAMIC Sat Oct 11 09:28:41 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux 2026-03-11 16:24:32.345209 CET - Uptime: 15:24:32 up 18 min, 1 user, load average: 0.03, 0.02, 0.03 2026-03-11 16:24:32.345234 CET - Logging in using SSH over SSH proxy 2026-03-11 16:24:32.345380 CET - Run: slices bi --infra de-munich-bi-vm ssh --no-exec --proxy on --show proxy_pubkey_openssh --experiment tst-defa7da3 tst 2026-03-11 16:25:33.161518 CET - Added paramiko HostKeyEntry for 131.159.14.13 2026-03-11 16:25:33.161614 CET - Added paramiko HostKeyEntry for 131.159.14.13 2026-03-11 16:25:33.161749 CET - Added paramiko HostKeyEntry for 131.159.14.13 2026-03-11 16:25:33.162021 CET - Added paramiko HostKeyEntry for [tripwire.net.in.tum.de]:10022 2026-03-11 16:25:33.162102 CET - Added paramiko HostKeyEntry for [tripwire.net.in.tum.de]:10022 2026-03-11 16:25:33.162136 CET - Added paramiko HostKeyEntry for [tripwire.net.in.tum.de]:10022 2026-03-11 16:25:33.162145 CET - Connecting to proxy tripwire.net.in.tum.de:10022 2026-03-11 16:25:33.956209 CET - Connecting to 131.159.14.13:22 over proxy 2026-03-11 16:25:35.319171 CET - SSH Test output: 2026-03-11 16:25:35.319218 CET - Uname: Linux tst 6.8.0-87-generic #88-Ubuntu SMP PREEMPT_DYNAMIC Sat Oct 11 09:28:41 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux 2026-03-11 16:25:35.319228 CET - Uptime: 15:25:35 up 19 min, 1 user, load average: 0.09, 0.03, 0.03 2026-03-11 16:25:35.485290 CET - lsb_release: Ubuntu 24.04.3 LTS 2026-03-11 16:25:35.485339 CET - lsb_release matches expected value 2026-03-11 16:25:35.485349 CET - SSH Test passed. 2026-03-11 16:25:35.652638 CET - Cloud-init user-data: Hello World. The time is now Wed, 11 Mar 2026 15:07:03 +0000! 2026-03-11 16:25:35.659433 CET - Destroying tst-defa7da3 tst 2026-03-11 16:25:35.659597 CET - Run: slices bi --infra de-munich-bi-vm destroy --experiment tst-defa7da3 tst 2026-03-11 16:28:41.334713 CET - Content of log file '/opt/slices-monitor-worker/slices_monitor_tests/551dcb67-418d-4787-889c-ea2cdf294dab/step_Destroy_command_1.txt': /opt/slices-monitor-worker/slices-cli-venv/bin/slices bi --infra de-munich-bi-vm destroy --experiment tst-defa7da3 tst 2026-03-11 16:28:41.334824 CET - Content of log file '/opt/slices-monitor-worker/slices_monitor_tests/551dcb67-418d-4787-889c-ea2cdf294dab/destroy.txt': Deleting tst ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ ╭───────────────────── Traceback (most recent call last) ──────────────────────╮ │ /opt/slices-monitor-worker/slices-cli-venv/lib/python3.14/site-packages/slic │ │ es_clientlib_bi/bi_task.py:71 in get_tasks │ │ │ │ 68 │ │ │ params={"task_ids": task_ids}, │ │ 69 │ │ ) │ │ 70 │ │ try: │ │ ❱ 71 │ │ │ response.raise_for_status() │ │ 72 │ │ except HTTPError as err: │ │ 73 │ │ │ raise from_httpx_exception(err) from err │ │ 74 │ │ return _tasks_status_decoder.decode(response.content) │ │ │ │ /opt/slices-monitor-worker/slices-cli-venv/lib/python3.14/site-packages/http │ │ x/_models.py:829 in raise_for_status │ │ │ │ 826 │ │ } │ │ 827 │ │ error_type = error_types.get(status_class, "Invalid status co │ │ 828 │ │ message = message.format(self, error_type=error_type) │ │ ❱ 829 │ │ raise HTTPStatusError(message, request=request, response=self │ │ 830 │ │ │ 831 │ def json(self, **kwargs: typing.Any) -> typing.Any: │ │ 832 │ │ return jsonlib.loads(self.content, **kwargs) │ ╰──────────────────────────────────────────────────────────────────────────────╯ HTTPStatusError: Server error '500 Internal Server Error' for url 'https://slices-bi.slices-de.eu/de-munich-bi-vm/slices-bi/apis/bi.slices.eu/v1/t asks/?task_ids=task_de-munich-bi-vm_5zq57grsqr9case5wj9qbjnh0t' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/500 The above exception was the direct cause of the following exception: ╭───────────────────── Traceback (most recent call last) ──────────────────────╮ │ /opt/slices-monitor-worker/slices-cli-venv/lib/python3.14/site-packages/slic │ │ es_cli_bi/commands/bi_helpers.py:83 in wrapper_handle_some_exceptions │ │ │ │ 80 │ def wrapper_handle_some_exceptions(*args, **kwargs): │ │ 81 │ │ """Function wrapper for handle_some_exceptions.""" # noqa: D4 │ │ 82 │ │ try: │ │ ❱ 83 │ │ │ return func(*args, **kwargs) │ │ 84 │ │ except ApiResponseError as e: │ │ 85 │ │ │ if e._httpx_status_error.response.status_code in ( │ │ 86 │ │ │ │ 502, │ │ │ │ /opt/slices-monitor-worker/slices-cli-venv/lib/python3.14/site-packages/slic │ │ es_cli_bi/commands/bi.py:1318 in destroy_resource │ │ │ │ 1315 │ │ except Exception: │ │ 1316 │ │ │ err_console.print(f"Could not remove ssh host key for {re │ │ 1317 │ │ │ ❱ 1318 │ task_results = follow_progress( │ │ 1319 │ │ ctx.obj.bi_tasks_api, │ │ 1320 │ │ [task_id for _, task_id, _ in delete_task_info], │ │ 1321 │ │ [task_name for task_name, _, _ in delete_task_info], │ │ │ │ /opt/slices-monitor-worker/slices-cli-venv/lib/python3.14/site-packages/slic │ │ es_cli_bi/core/progress.py:86 in follow_progress │ │ │ │ 83 │ │ │ bi_task_status: list[TaskStatus] = [] │ │ 84 │ │ │ while tasks_to_query: │ │ 85 │ │ │ │ bi_task_status.extend( │ │ ❱ 86 │ │ │ │ │ bi_tasks_api.get_tasks( │ │ 87 │ │ │ │ │ │ task_ids=tasks_to_query[0:MAX_PROGRESS_UPDATES │ │ 88 │ │ │ │ │ ) │ │ 89 │ │ │ │ ) │ │ │ │ /opt/slices-monitor-worker/slices-cli-venv/lib/python3.14/site-packages/slic │ │ es_clientlib_bi/bi_task.py:73 in get_tasks │ │ │ │ 70 │ │ try: │ │ 71 │ │ │ response.raise_for_status() │ │ 72 │ │ except HTTPError as err: │ │ ❱ 73 │ │ │ raise from_httpx_exception(err) from err │ │ 74 │ │ return _tasks_status_decoder.decode(response.content) │ │ 75 │ │ │ 76 │ def get_task_logs( │ ╰──────────────────────────────────────────────────────────────────────────────╯ ServiceException: ServiceException (for GET https://slices-bi.slices-de.eu/de-munich-bi-vm/slices-bi/apis/bi.slices.eu/v1/ta sks/?task_ids=task_de-munich-bi-vm_5zq57grsqr9case5wj9qbjnh0t): Internal Server Error 2026-03-11 16:28:41.334886 CET - Error in test step 'Destroy': "slices bi destroy" failed (return value is 1) 2026-03-11 16:28:41.334912 CET - Wait 2s before retry 2026-03-11 16:31:44.436711 CET - Content of log file '/opt/slices-monitor-worker/slices_monitor_tests/551dcb67-418d-4787-889c-ea2cdf294dab/step_DestroyRetry1_retry1_command_1.txt': /opt/slices-monitor-worker/slices-cli-venv/bin/slices bi --infra de-munich-bi-vm destroy --experiment tst-defa7da3 tst 2026-03-11 16:31:44.436813 CET - Content of log file '/opt/slices-monitor-worker/slices_monitor_tests/551dcb67-418d-4787-889c-ea2cdf294dab/destroy_retry1.txt': Deleting tst: task starting # task_id='ba87f3b1cb6d4cab82b7f8a93a87c7fe' tas… 1… Destroy failure ❌ ❌ Failed to destroy tst with ID r_de-munich-bi-vm_01kkepxz1zekst3ddt93sxs8d5 Failure: INTERNAL_ERROR task_id='ba87f3b1cb6d4cab82b7f8a93a87c7fe' task_name='slices_bi_refimpl_backend.tasks.compute_resource:delete_compute_resou rce' labels={} labels_types={} args=[UUID('019cdd6e-fc3f-74f3-a1b5-ba48f3dca1a5'), 'status_change:api_initiated:delete'] kwargs={'initiator': 'user_account.ilabt.imec.be_1c3x2sxhmv8dqtmkxh9392sa0g'} Details stored at: /root/.slices/cli_error_details/err_2026-03-11T15:31:44+00:00.txt 2026-03-11 16:31:44.436834 CET - Error in test step 'Destroy (Retry 1)': "slices bi destroy" failed (return value is 1) 2026-03-11 16:31:44.436856 CET - Wait 2s before retry 2026-03-11 16:34:47.446197 CET - Content of log file '/opt/slices-monitor-worker/slices_monitor_tests/551dcb67-418d-4787-889c-ea2cdf294dab/step_DestroyRetry2_retry2_command_1.txt': /opt/slices-monitor-worker/slices-cli-venv/bin/slices bi --infra de-munich-bi-vm destroy --experiment tst-defa7da3 tst 2026-03-11 16:34:47.446292 CET - Content of log file '/opt/slices-monitor-worker/slices_monitor_tests/551dcb67-418d-4787-889c-ea2cdf294dab/destroy_retry2.txt': Deleting tst: task starting # task_id='b112ad127d2745909d34451bf36c7862' tas… 1… Destroy failure ❌ ❌ Failed to destroy tst with ID r_de-munich-bi-vm_01kkepxz1zekst3ddt93sxs8d5 Failure: INTERNAL_ERROR task_id='b112ad127d2745909d34451bf36c7862' task_name='slices_bi_refimpl_backend.tasks.compute_resource:delete_compute_resou rce' labels={} labels_types={} args=[UUID('019cdd6e-fc3f-74f3-a1b5-ba48f3dca1a5'), 'status_change:api_initiated:delete'] kwargs={'initiator': 'user_account.ilabt.imec.be_1c3x2sxhmv8dqtmkxh9392sa0g'} Details stored at: /root/.slices/cli_error_details/err_2026-03-11T15:34:47+00:00.txt 2026-03-11 16:34:47.446313 CET - Error in test step 'Destroy (Retry 2)': "slices bi destroy" failed (return value is 1) 2026-03-11 16:34:47.446331 CET - Wait 2s before retry 2026-03-11 16:37:50.637130 CET - Content of log file '/opt/slices-monitor-worker/slices_monitor_tests/551dcb67-418d-4787-889c-ea2cdf294dab/step_DestroyRetry3_retry3_command_1.txt': /opt/slices-monitor-worker/slices-cli-venv/bin/slices bi --infra de-munich-bi-vm destroy --experiment tst-defa7da3 tst 2026-03-11 16:37:50.637233 CET - Content of log file '/opt/slices-monitor-worker/slices_monitor_tests/551dcb67-418d-4787-889c-ea2cdf294dab/destroy_retry3.txt': Deleting tst: task starting # task_id='6fb79966c481437095d23ec6abf6ec28' tas… 1… Destroy failure ❌ ❌ Failed to destroy tst with ID r_de-munich-bi-vm_01kkepxz1zekst3ddt93sxs8d5 Failure: INTERNAL_ERROR task_id='6fb79966c481437095d23ec6abf6ec28' task_name='slices_bi_refimpl_backend.tasks.compute_resource:delete_compute_resou rce' labels={} labels_types={} args=[UUID('019cdd6e-fc3f-74f3-a1b5-ba48f3dca1a5'), 'status_change:api_initiated:delete'] kwargs={'initiator': 'user_account.ilabt.imec.be_1c3x2sxhmv8dqtmkxh9392sa0g'} Details stored at: /root/.slices/cli_error_details/err_2026-03-11T15:37:50+00:00.txt 2026-03-11 16:37:50.637255 CET - Error in test step 'Destroy (Retry 3)': "slices bi destroy" failed (return value is 1)