I’m trying to get my second server configured for PMM 2.0. The first one was pretty painless, but when I try to “pmm-admin config” the second one I’m getting a message referencing “internal server error”. I’ve tried two different servers and the result is the same. I’ve looked at the pmm-managed log and there is a reference to a duplicate key - the .zip is attached. I’ve also added the “trace” output below. What am I doing wrong?
[root@db4 ~]# pmm-admin config --server-insecure-tls --server-url=https://pmm2.towxchange.net:443 --trace
/tmp/go/src/github.com/percona/pmm-admin/commands/config.go:97 github.com/percona/pmm-admin/commands.(*configCommand).Run() Running: pmm-agent --server-address=pmm2.towxchange.net:443 --server-insecure-tls --trace setup 10.10.3.204 generic db4.towxchange.net
/tmp/go/src/github.com/percona/pmm-admin/main.go:256 main.main() Result: &commands.configResult{Output:“Checking local pmm-agent status…\ntime=“2019-06-07T16:37:41-04:00” level=debug msg=“POST /local/Status HTTP/1.1\r\nHost: 127.0.0.1:7777\r\nUser-Agent: Go-http-client/1.1\r\nContent-Length: 3\r\nAccept: application/json\r\nContent-Type: application/json\r\nAccept-Encoding: gzip\r\n\r\n{}\n\n” func=“github.com/percona/pmm-agent/vendor/github.com/go-openapi/runtime/client.(*Runtime).Submit” file=”/tmp/go/src/github.com/percona/pmm-agent/vendor/github.com/go-openapi/runtime/client/runtime.go:366" component=setup\ntime=“2019-06-07T16:37:41-04:00” level=debug msg=“HTTP/1.1 200 OK\r\nContent-Length: 56\r\nContent-Type: application/json\r\nDate: Fri, 07 Jun 2019 20:37:41 GMT\r\nGrpc-Metadata-Content-Type: application/grpc\r\n\r\n{\“config_file_path\”:\”/usr/local/percona/pmm-agent.yaml\“}\n” func=“github.com/percona/pmm-agent/vendor/github.com/go-openapi/runtime/client.(*Runtime).Submit” file=“/tmp/go/src/github.com/percona/pmm-agent/vendor/github.com/go-openapi/runtime/client/runtime.go:404” component=setup\ntime=“2019-06-07T16:37:41-04:00” level=debug msg=“Status error: ” func=github.com/percona/pmm-agent/commands.checkStatus file=“/tmp/go/src/github.com/percona/pmm-agent/commands/setup.go:77” component=setup\npmm-agent is running.\nRegistering pmm-agent on PMM Server…\ntime=“2019-06-07T16:37:41-04:00” level=debug msg=“POST /v0/management/Node/Register HTTP/1.1\r\nHost: pmm2.towxchange.net:443\r\nUser-Agent: Go-http-client/1.1\r\nContent-Length: 153\r\nAccept: application/json\r\nContent-Type: application/json\r\nAccept-Encoding: gzip\r\n\r\n{\“address\”:\“10.10.3.204\”,\“distro\”:\“linux\”,\“machine_id\”:\“ebd4625333d5446abe96a4f379fae349\\n\”,\“node_name\”:\“db4.towxchange.net\”,\“node_type\”:\“GENERIC_NODE\”}\n\n” func=“github.com/percona/pmm-agent/vendor/github.com/go-openapi/runtime/client.(*Runtime).Submit” file=“/tmp/go/src/github.com/percona/pmm-agent/vendor/github.com/go-openapi/runtime/client/runtime.go:366” component=setup\ntime=“2019-06-07T16:37:41-04:00” level=debug msg=“HTTP/1.1 500 Internal Server Error\r\nTransfer-Encoding: chunked\r\nTrailer: Grpc-Trailer-Content-Type\r\nConnection: keep-alive\r\nContent-Type: application/json\r\nDate: Fri, 07 Jun 2019 20:37:41 GMT\r\nServer: nginx\r\n\r\n4f\r\n{\“error\”:\“Internal server error.\”,\“message\”:\“Internal server error.\”,\“code\”:13}\r\n0\r\n\r\n\n” func=“github.com/percona/pmm-agent/vendor/github.com/go-openapi/runtime/client.(*Runtime).Submit” file=“/tmp/go/src/github.com/percona/pmm-agent/vendor/github.com/go-openapi/runtime/client/runtime.go:404” component=setup\ntime=“2019-06-07T16:37:41-04:00” level=debug msg=“Register error: &node.RegisterDefault{_statusCode:500, Payload:(*node.RegisterDefaultBody)(0xc000528900)}” func=github.com/percona/pmm-agent/commands.register file=“/tmp/go/src/github.com/percona/pmm-agent/commands/setup.go:123” component=setup\nFailed to register pmm-agent on PMM Server: Internal server error…\n"}
/tmp/go/src/github.com/percona/pmm-admin/main.go:257 main.main() Error: &exec.ExitError{ProcessState:(*os.ProcessState)(0xc00049a980), Stderr:uint8(nil)}
Checking local pmm-agent status…
time=“2019-06-07T16:37:41-04:00” level=debug msg=“POST /local/Status HTTP/1.1\r\nHost: 127.0.0.1:7777\r\nUser-Agent: Go-http-client/1.1\r\nContent-Length: 3\r\nAccept: application/json\r\nContent-Type: application/json\r\nAccept-Encoding: gzip\r\n\r\n{}\n\n” func=“github.com/percona/pmm-agent/vendor/github.com/go-openapi/runtime/client.(*Runtime).Submit” file=“/tmp/go/src/github.com/percona/pmm-agent/vendor/github.com/go-openapi/runtime/client/runtime.go:366” component=setup
time=“2019-06-07T16:37:41-04:00” level=debug msg=“HTTP/1.1 200 OK\r\nContent-Length: 56\r\nContent-Type: application/json\r\nDate: Fri, 07 Jun 2019 20:37:41 GMT\r\nGrpc-Metadata-Content-Type: application/grpc\r\n\r\n{“config_file_path”:”/usr/local/percona/pmm-agent.yaml"}\n" func=“github.com/percona/pmm-agent/vendor/github.com/go-openapi/runtime/client.(*Runtime).Submit” file=“/tmp/go/src/github.com/percona/pmm-agent/vendor/github.com/go-openapi/runtime/client/runtime.go:404” component=setup
time=“2019-06-07T16:37:41-04:00” level=debug msg=“Status error: ” func=github.com/percona/pmm-agent/commands.checkStatus file=“/tmp/go/src/github.com/percona/pmm-agent/commands/setup.go:77” component=setup
pmm-agent is running.
Registering pmm-agent on PMM Server…
time=“2019-06-07T16:37:41-04:00” level=debug msg=“POST /v0/management/Node/Register HTTP/1.1\r\nHost: pmm2.towxchange.net:443\r\nUser-Agent: Go-http-client/1.1\r\nContent-Length: 153\r\nAccept: application/json\r\nContent-Type: application/json\r\nAccept-Encoding: gzip\r\n\r\n{“address”:“10.10.3.204”,“distro”:“linux”,“machine_id”:“ebd4625333d5446abe96a4f379fae349\n”,“node_name”:“db4.towxchange.net”,“node_type”:“GENERIC_NODE”}\n\n” func=“github.com/percona/pmm-agent/vendor/github.com/go-openapi/runtime/client.(*Runtime).Submit” file=“/tmp/go/src/github.com/percona/pmm-agent/vendor/github.com/go-openapi/runtime/client/runtime.go:366” component=setup
time=“2019-06-07T16:37:41-04:00” level=debug msg=“HTTP/1.1 500 Internal Server Error\r\nTransfer-Encoding: chunked\r\nTrailer: Grpc-Trailer-Content-Type\r\nConnection: keep-alive\r\nContent-Type: application/json\r\nDate: Fri, 07 Jun 2019 20:37:41 GMT\r\nServer: nginx\r\n\r\n4f\r\n{“error”:“Internal server error.”,“message”:“Internal server error.”,“code”:13}\r\n0\r\n\r\n\n” func=“github.com/percona/pmm-agent/vendor/github.com/go-openapi/runtime/client.(*Runtime).Submit” file=“/tmp/go/src/github.com/percona/pmm-agent/vendor/github.com/go-openapi/runtime/client/runtime.go:404” component=setup
time=“2019-06-07T16:37:41-04:00” level=debug msg=“Register error: &node.RegisterDefault{_statusCode:500, Payload:(*node.RegisterDefaultBody)(0xc000528900)}” func=github.com/percona/pmm-agent/commands.register file=“/tmp/go/src/github.com/percona/pmm-agent/commands/setup.go:123” component=setup
Failed to register pmm-agent on PMM Server: Internal server error…
pmm-server_2019-06-07_20-34 (1).zip (62.7 KB)