Verify Ability to Upload to Pepperdata Dashboard (Parcel)

If the Pepperdata dashboard does not show current data, it’s likely that pepcollectd—the Pepperdata Collector that uploads data from cluster hosts to the Pepperdata dashboard—cannot upload its data because it has been explicitly excluded from Pepperdata data collection or due to connection errors.

Task 1: Confirm that the Host is Configured for Pepperdata Data Collection

If the Pepperdata dashboard shows data for some hosts but not other hosts, a likely cause of “missing host data” is that the affected hosts have been disabled from Pepperdata data collection.

Procedure

  • On an affected host, use Cloudera Manager to navigate to Pepperdata > Configuration > PepCollector, and find the Collect and upload metrics (pd_collect_and_upload) value.

    • If the value is not selected (checked), select it to enable Pepperdata collection for the host.

    • If the value is selected, Pepperdata should already be collecting data from this host, so continue troubleshooting by proceeding to the next step.

Task 2: Confirm Connectivity

After ensuring that the hosts is configured for Pepperdata data collection, confirm that the hosts can connect to the Pepperdata dashboard. Try to connect from a host to the Pepperdata dashboard using cURL with verbosity.

Procedure

  • If there is direct access (no proxy server), log in to a running host, and use cURL to connect.

    curl --tlsv1.2 -v https://upload-main.pepperdata.com

  • If you are using a proxy server that you configured for Pepperdata (Set Up a Pepperdata Proxy), verify the proxy configuration and verify that the hosts can connect to the Pepperdata dashboard.

    1. In Cloudera Manager, locate the Pepperdata > Configuration > PepCollector > PepCollector Environment Advanced Configuration Snippet (Safety Valve) template.

    2. Ensure that the snippet includes the configuration for your proxy host and port, in the following format, and make note of the host and port information.

      https_proxy=my_proxy_url:my_proxy_port
      
    3. Log in to a cluster node.

    4. Try to connect to the Pepperdata dashboard.

      Be sure to replace the <my_proxy_url> and <my_proxy_port> placeholders with the same proxy server name and port number that you observed in step b.

      curl --proxy <my_proxy_url>:<my_proxy_port> --tlsv1.2 -v https://upload-main.pepperdata.com
      

If you can connect, you’ve confirmed that there is no connectivity problem, and you should contact Pepperdata Support for assistance.

Otherwise, debug the connection failure.

Task 3: Debug Connection Failures

A typical approach for debugging connection failures is to try using cURL to connect to the Pepperdata dashboard from a non-cluster host that is known to have internet access, whether directly or via a proxy that you set up during installation or according to the Set Up a Pepperdata Proxy procedure.

Use the same cURL command—based on your installation environment/cluster manager and the presence or not of a proxy server—that you used in Task 2: Confirm Connectivity.

Example: successful connection

curl --tlsv1.2 -v https://upload-main.pepperdata.com
* Rebuilt URL to: https://upload-main.pepperdata.com/
*   Trying 52.86.112.192...
* Connected to upload-main.pepperdata.com (52.86.112.192) port 443 (#0)
* ALPN, offering http/1.1
* Cipher selection: ALL:!EXPORT:!EXPORT40:!EXPORT56:!aNULL:!LOW:!RC4:@STRENGTH
* successfully set certificate verify locations:
*   CAfile: /opt/local/share/curl/curl-ca-bundle.crt
  CApath: none
* TLSv1.2 (OUT), TLS header, Certificate Status (22):
* TLSv1.2 (OUT), TLS handshake, Client hello (1):
* TLSv1.2 (IN), TLS handshake, Server hello (2):
* NPN, negotiated HTTP1.1
* TLSv1.2 (IN), TLS handshake, Certificate (11):
* TLSv1.2 (IN), TLS handshake, Server key exchange (12):
* TLSv1.2 (IN), TLS handshake, Server finished (14):
* TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
* TLSv1.2 (OUT), TLS change cipher, Client hello (1):
* TLSv1.2 (OUT), TLS handshake, Unknown (67):
* TLSv1.2 (OUT), TLS handshake, Finished (20):
* TLSv1.2 (IN), TLS change cipher, Client hello (1):
* TLSv1.2 (IN), TLS handshake, Finished (20):
* SSL connection using TLSv1.2 / ECDHE-RSA-AES128-GCM-SHA256
* ALPN, server did not agree to a protocol
* Server certificate:
*      subject: OU=GT86417191; OU=See www.rapidssl.com/resources/cps (c)15; OU=Domain Control Validated - RapidSSL(R); CN=*.pepperdata.com
*      start date: Sep 21 05:54:34 2015 GMT
*      expire date: Oct 22 04:31:09 2017 GMT
*      subjectAltName: upload-main.pepperdata.com matched
*      issuer: C=US; O=GeoTrust Inc.; CN=RapidSSL SHA256 CA - G3
*      SSL certificate verify ok.
> GET / HTTP/1.1
> Host: upload-main.pepperdata.com
> User-Agent: curl/7.45.0
> Accept: */*
>
< HTTP/1.1 200 OK
< Server: nginx/1.10.1
< Date: Mon, 24 Jul 2017 15:29:45 GMT
< Content-Type: text/html
< Content-Length: 4
< Last-Modified: Fri, 26 Aug 2016 23:29:38 GMT
< Connection: keep-alive
< ETag: "57c0d0e2-4"
< Accept-Ranges: bytes
<
ok