++ hostname + exec /cockroach/cockroach start --join=cockroachdb-0.cockroachdb.cockroachdb.svc.cluster.local:26257,cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257,cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257 --advertise-host=cockroachdb-0.cockroachdb.cockroachdb.svc.cluster.local --certs-dir=/cockroach/cockroach-certs/ --http-port=8080 --port=26257 --cache=25% --max-sql-memory=25% --logtostderr=INFO I240718 13:09:04.992593 1 server/status/recorder.go:823 ⋮ [n?] 1 ‹available memory from cgroups (8.0 EiB) is unsupported, using system memory 16 GiB instead: › I240718 13:09:05.004373 1 1@cli/start.go:1471 ⋮ [n?] 2 ‹CockroachDB CCL v24.1.1 (x86_64-pc-linux-gnu, built 2024/06/14 07:28:29, go1.22.3 X:nocoverageredesign)› I240718 13:09:05.008861 1 server/status/recorder.go:823 ⋮ [n?] 3 ‹available memory from cgroups (8.0 EiB) is unsupported, using system memory 16 GiB instead: › I240718 13:09:05.008898 1 1@cli/start.go:552 ⋮ [n?] 4 soft memory limit of Go runtime is set to 8.8 GiB I240718 13:09:05.008932 1 1@cli/start.go:589 ⋮ [n?] 5 GC target percentage of Go runtime is set to 300% I240718 13:09:05.057873 1 server/status/recorder.go:823 ⋮ [T1,Vsystem,n?] 6 ‹available memory from cgroups (8.0 EiB) is unsupported, using system memory 16 GiB instead: › I240718 13:09:05.057955 1 server/config.go:679 ⋮ [T1,Vsystem,n?] 7 system total memory: 16 GiB I240718 13:09:05.057993 1 server/config.go:681 ⋮ [T1,Vsystem,n?] 8 server configuration: I240718 13:09:05.057993 1 server/config.go:681 ⋮ [T1,Vsystem,n?] 8 +‹max offset 500000000› I240718 13:09:05.057993 1 server/config.go:681 ⋮ [T1,Vsystem,n?] 8 +‹cache size 3.9 GiB› I240718 13:09:05.057993 1 server/config.go:681 ⋮ [T1,Vsystem,n?] 8 +‹SQL memory pool size 3.9 GiB› I240718 13:09:05.057993 1 server/config.go:681 ⋮ [T1,Vsystem,n?] 8 +‹scan interval 10m0s› I240718 13:09:05.057993 1 server/config.go:681 ⋮ [T1,Vsystem,n?] 8 +‹scan min idle time 10ms› I240718 13:09:05.057993 1 server/config.go:681 ⋮ [T1,Vsystem,n?] 8 +‹scan max idle time 1s› I240718 13:09:05.057993 1 server/config.go:681 ⋮ [T1,Vsystem,n?] 8 +‹event log enabled true› I240718 13:09:05.058167 1 1@cli/start.go:1332 ⋮ [T1,Vsystem,n?] 9 using local environment variables: I240718 13:09:05.058167 1 1@cli/start.go:1332 ⋮ [T1,Vsystem,n?] 9 +COCKROACH_CHANNEL=kubernetes-helm I240718 13:09:05.058217 1 1@cli/start.go:1339 ⋮ [T1,Vsystem,n?] 10 process identity: ‹uid 1000 euid 1000 gid 1000 egid 1000› I240718 13:09:05.062786 1 1@cli/start.go:1494 ⋮ [T1,Vsystem,n?] 11 GEOS loaded from directory ‹/usr/local/lib/cockroach› I240718 13:09:05.062834 1 1@cli/start.go:778 ⋮ [T1,Vsystem,n?] 12 starting cockroach node I240718 13:09:05.175915 39 3@pebble/objstorage/objstorageprovider/remote.go:105 ⋮ [n?,s?,pebble] 13 remote storage configured; no creatorID yet I240718 13:09:05.209431 39 3@pebble/event.go:800 ⋮ [n?,s?,pebble] 14 [JOB 1] MANIFEST created 000001 I240718 13:09:05.256203 39 3@pebble/event.go:828 ⋮ [n?,s?,pebble] 15 [JOB 1] WAL created 000002 I240718 13:09:05.289788 71 3@pebble/event.go:820 ⋮ [n?,s?,pebble] 16 [JOB 2] all initial table stats loaded I240718 13:09:05.328175 39 3@pebble/event.go:796 ⋮ [n?,s?,pebble] 17 upgraded to format version: 014 I240718 13:09:05.344921 39 3@pebble/event.go:796 ⋮ [n?,s?,pebble] 18 upgraded to format version: 015 I240718 13:09:05.357851 39 3@pebble/event.go:796 ⋮ [n?,s?,pebble] 19 upgraded to format version: 016 I240718 13:09:05.357911 39 server/config.go:876 ⋮ [T1,Vsystem,n?] 20 1 storage engine initialized I240718 13:09:05.360110 39 server/config.go:879 ⋮ [T1,Vsystem,n?] 21 Pebble cache size: 3.9 GiB I240718 13:09:05.360136 39 server/config.go:879 ⋮ [T1,Vsystem,n?] 22 store 0: max size 0 B, max open file limit 1043576 I240718 13:09:05.360148 39 server/config.go:879 ⋮ [T1,Vsystem,n?] 23 store 0: /cockroach/cockroach-data: rw encrypted=false fs:{bdev=tmpfs fstype=tmpfs mountpoint=/sys/firmware mountopts=ro,relatime,inode64} I240718 13:09:05.422429 39 1@rpc/tls.go:252 ⋮ [T1,Vsystem,n?] 24 server certificate addresses: ‹IP=127.0.0.1; DNS=localhost,cockroachdb-public,cockroachdb-public.cockroachdb,cockroachdb-public.cockroachdb.svc.cluster.local,*.cockroachdb,*.cockroachdb.cockroachdb,*.cockroachdb.cockroachdb.svc.cluster.local; CN=node› I240718 13:09:05.431004 39 1@rpc/tls.go:301 ⋮ [T1,Vsystem,n?] 25 web UI certificate addresses: ‹IP=127.0.0.1; DNS=localhost,cockroachdb-public,cockroachdb-public.cockroachdb,cockroachdb-public.cockroachdb.svc.cluster.local,*.cockroachdb,*.cockroachdb.cockroachdb,*.cockroachdb.cockroachdb.svc.cluster.local; CN=node› I240718 13:09:05.624785 39 3@pebble/event.go:800 ⋮ [n?,s?,pebble] 26 [JOB 1] MANIFEST created 000001 I240718 13:09:05.638818 39 3@pebble/event.go:828 ⋮ [n?,s?,pebble] 27 [JOB 1] WAL created 000002 I240718 13:09:05.670339 131 3@pebble/event.go:820 ⋮ [n?,s?,pebble] 28 [JOB 2] all initial table stats loaded I240718 13:09:05.700514 39 3@pebble/event.go:796 ⋮ [n?,s?,pebble] 29 upgraded to format version: 014 I240718 13:09:05.709363 39 3@pebble/event.go:796 ⋮ [n?,s?,pebble] 30 upgraded to format version: 015 I240718 13:09:05.748354 39 3@pebble/event.go:796 ⋮ [n?,s?,pebble] 31 upgraded to format version: 016 I240718 13:09:05.890399 39 1@server/clock_monotonicity.go:66 ⋮ [T1,Vsystem,n?] 32 monitoring forward clock jumps based on server.clock.forward_jump_check.enabled W240718 13:09:05.972933 39 1@cli/start.go:1293 ⋮ [T1,Vsystem,n?] 33 Running a server without --sql-addr, with a combined RPC/SQL listener, is deprecated. W240718 13:09:05.972933 39 1@cli/start.go:1293 ⋮ [T1,Vsystem,n?] 33 +This feature will be removed in a later version of CockroachDB. I240718 13:09:05.973312 39 1@cli/start.go:1544 ⋮ [T1,Vsystem,n?] 34 initial startup completed. I240718 13:09:05.973312 39 1@cli/start.go:1544 ⋮ [T1,Vsystem,n?] 34 +Node will now attempt to join a running cluster, or wait for `cockroach init`. I240718 13:09:05.973312 39 1@cli/start.go:1544 ⋮ [T1,Vsystem,n?] 34 +Client connections will be accepted after this completes successfully. I240718 13:09:05.973312 39 1@cli/start.go:1544 ⋮ [T1,Vsystem,n?] 34 +Check the log file(s) for progress. I240718 13:09:05.977648 39 server/init.go:229 ⋮ [T1,Vsystem,n?] 35 no stores initialized I240718 13:09:05.977684 39 server/init.go:230 ⋮ [T1,Vsystem,n?] 36 awaiting `cockroach init` or join with an already initialized node I240718 13:09:06.023104 191 server/init.go:405 ⋮ [T1,Vsystem,n?] 37 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:06.036988 191 server/init.go:405 ⋮ [T1,Vsystem,n?] 38 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:07.047328 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 39 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:08.054886 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 40 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:09.050191 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 41 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:10.084253 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 42 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:11.050727 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 43 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:12.054300 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 44 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:13.056955 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 45 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:14.054064 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 46 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:15.047799 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 47 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:16.059924 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 48 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:17.050871 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 49 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:18.053030 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 50 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:19.051162 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 51 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:20.048640 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 52 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:21.051397 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 53 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:22.050053 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 54 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:23.053139 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 55 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:24.049398 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 56 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:25.048386 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 57 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:26.070913 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 58 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:27.057066 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 59 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:28.054653 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 60 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:32.694732 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 61 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:33.054401 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 62 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:34.049758 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 63 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:35.051193 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 64 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry W240718 13:09:35.972946 620 1@cli/start.go:642 ⋮ [T1,Vsystem,n?] 65 The server appears to be unable to contact the other nodes in the cluster. Please try: W240718 13:09:35.972946 620 1@cli/start.go:642 ⋮ [T1,Vsystem,n?] 65 + W240718 13:09:35.972946 620 1@cli/start.go:642 ⋮ [T1,Vsystem,n?] 65 +- starting the other nodes, if you haven't already; W240718 13:09:35.972946 620 1@cli/start.go:642 ⋮ [T1,Vsystem,n?] 65 +- double-checking that the '--join' and '--listen'/'--advertise' flags are set up correctly; W240718 13:09:35.972946 620 1@cli/start.go:642 ⋮ [T1,Vsystem,n?] 65 +- running the 'cockroach init' command if you are trying to initialize a new cluster. W240718 13:09:35.972946 620 1@cli/start.go:642 ⋮ [T1,Vsystem,n?] 65 + W240718 13:09:35.972946 620 1@cli/start.go:642 ⋮ [T1,Vsystem,n?] 65 +If problems persist, please see ‹https://www.cockroachlabs.com/docs/v24.1/cluster-setup-troubleshooting.html›. I240718 13:09:36.058917 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 66 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:37.059220 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 67 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:38.051287 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 68 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:39.061544 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 69 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:40.061879 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 70 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:41.054985 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 71 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:42.056087 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 72 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:43.051313 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 73 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:46.177942 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 74 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:47.058758 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 75 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:48.052336 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 76 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:49.052748 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 77 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:50.048786 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 78 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:51.050171 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 79 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:52.052004 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 80 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:53.049161 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 81 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:54.059629 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 82 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:55.053898 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 83 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:56.057031 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 84 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:57.049186 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 85 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:58.059107 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 86 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:09:59.062660 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 87 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:10:00.049607 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 88 ‹cockroachdb-1.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry I240718 13:10:01.055670 191 server/init.go:451 ⋮ [T1,Vsystem,n?] 89 ‹cockroachdb-2.cockroachdb.cockroachdb.svc.cluster.local:26257› is itself waiting for init, will retry