W0110 18:20:34.187269 11404 main.go:67] W0110 18:20:34.152184 reparent.go:188] master-elect tablet zone1-0000000300 is not the shard master, proceeding anyway as -force was used
W0110 18:20:34.190663 11404 main.go:67] W0110 18:20:34.153987 reparent.go:194] master-elect tablet zone1-0000000300 is not a master in the shard, proceeding anyway as -force was used
I0110 18:20:34.191037 11404 main.go:67] I0110 18:20:34.155673 reparent.go:225] resetting replication on tablet zone1-0000000301
I0110 18:20:34.191174 11404 main.go:67] I0110 18:20:34.156072 reparent.go:225] resetting replication on tablet zone1-0000000300
I0110 18:20:34.191277 11404 main.go:67] I0110 18:20:34.156119 reparent.go:225] resetting replication on tablet zone1-0000000302
InitShardMaster Error: rpc error: code = Unknown desc = tablet zone1-0000000301 ResetReplication failed (either fix it, or Scrap it): rpc error: code = Unknown desc = TabletManager.ResetReplication on zone1-0000000301 error: net.Dial(/vt/vtdataroot/vt_0000000301/mysql.sock) to local server failed: dial unix /vt/vtdataroot/vt_0000000301/mysql.sock: connect: connection refused (errno 2002) (sqlstate HY000): net.Dial(/vt/vtdataroot/vt_0000000301/mysql.sock) to local server failed: dial unix /vt/vtdataroot/vt_0000000301/mysql.sock: connect: connection refused (errno 2002) (sqlstate HY000)
E0110 18:20:34.670352 11404 main.go:72] remote error: rpc error: code = Unknown desc = tablet zone1-0000000301 ResetReplication failed (either fix it, or Scrap it): rpc error: code = Unknown desc = TabletManager.ResetReplication on zone1-0000000301 error: net.Dial(/vt/vtdataroot/vt_0000000301/mysql.sock) to local server failed: dial unix /vt/vtdataroot/vt_0000000301/mysql.sock: connect: connection refused (errno 2002) (sqlstate HY000): net.Dial(/vt/vtdataroot/vt_0000000301/mysql.sock) to local server failed: dial unix /vt/vtdataroot/vt_0000000301/mysql.sock: connect: connection refused (errno 2002) (sqlstate HY000)
W0110 18:20:46.639497 11673 main.go:67] W0110 18:20:46.600314 reparent.go:188] master-elect tablet zone1-0000000400 is not the shard master, proceeding anyway as -force was used
W0110 18:20:46.647104 11673 main.go:67] W0110 18:20:46.605252 reparent.go:194] master-elect tablet zone1-0000000400 is not a master in the shard, proceeding anyway as -force was used
I0110 18:20:46.647160 11673 main.go:67] I0110 18:20:46.615473 reparent.go:225] resetting replication on tablet zone1-0000000400
I0110 18:20:46.647194 11673 main.go:67] I0110 18:20:46.616222 reparent.go:225] resetting replication on tablet zone1-0000000402
I0110 18:20:46.647757 11673 main.go:67] I0110 18:20:46.616265 reparent.go:225] resetting replication on tablet zone1-0000000401
InitShardMaster Error: rpc error: code = Unknown desc = tablet zone1-0000000402 ResetReplication failed (either fix it, or Scrap it): rpc error: code = Unknown desc = TabletManager.ResetReplication on zone1-0000000402 error: net.Dial(/vt/vtdataroot/vt_0000000402/mysql.sock) to local server failed: dial unix /vt/vtdataroot/vt_0000000402/mysql.sock: connect: no such file or directory (errno 2002) (sqlstate HY000): net.Dial(/vt/vtdataroot/vt_0000000402/mysql.sock) to local server failed: dial unix /vt/vtdataroot/vt_0000000402/mysql.sock: connect: no such file or directory (errno 2002) (sqlstate HY000)
E0110 18:20:48.020342 11673 main.go:72] remote error: rpc error: code = Unknown desc = tablet zone1-0000000402 ResetReplication failed (either fix it, or Scrap it): rpc error: code = Unknown desc = TabletManager.ResetReplication on zone1-0000000402 error: net.Dial(/vt/vtdataroot/vt_0000000402/mysql.sock) to local server failed: dial unix /vt/vtdataroot/vt_0000000402/mysql.sock: connect: no such file or directory (errno 2002) (sqlstate HY000): net.Dial(/vt/vtdataroot/vt_0000000402/mysql.sock) to local server failed: dial unix /vt/vtdataroot/vt_0000000402/mysql.sock: connect: no such file or directory (errno 2002) (sqlstate HY000)
Looking at the error log in /vt/vtdataroot/vt_000000040*/error.log,
I see a lot of unknown database 'vt_customer'.
Any idea why I am getting this error?
Just in case, I ran the similar testing, without creating new customer keyspace, creating new shards in commerce keyspace (made sure all the commands are replaced with commerce), but I am getting the same error.
Please let me know if anyone sees anything I can try.