Syncplicity Support

Search our knowledgebase to get the help you need, today

Follow

Performance counter values

Overview

There are several performance counter values exposed via the v1/diagnostics/metrics ReST endpoint. These values can help with diagnosing server health. See the table below for a list of the performance counters available.

Metric

Description

app.memory.usageAmount of memory DataHub is currently using in MB
app.uptimeThe amount of time DataHub has been running in seconds
app.version.buildDataHub application build (e.g. 4.0.0.1601-beta-f8f1fab594323c5111a7882eb20c748ef8cabf79)
app.version.productDataHub application version (e.g. 4.0.0.1601)
app.cpu.usageTotal current DataHub CPU usage in percent
app.disk.reads_per_secNumber of disk reads per second for DataHub
app.disk.writes_per_secNumber of disk writes per second for DataHub
{platform name}.{connection id}.http.requestsNumber of http request made to connection (Histogram)
{platform name}.{connection id}.ratelimit.occurrencesNumber of rate limits that have occurred on connection
{platform name}.{connection id}.ratelimit.pendingNumber of threads currently waiting on rate limits
{platform name}.{connection id}.ratelimit.rateNumber of rate limits occurring per time unit
{platform name}.{connection id}.ratelimit.waitAmount of time spent waiting for rate limits (Timer)
system.cpu.archSystem CPU architecture (e.g. x64)
system.cpu.countTotal number of CPUs for the system
system.cpu.usageTotal current system CPU usage in percent
system.os.archSystem architecture (e.g. x64)
system.os.descriptionOperating System (e.g. Microsoft Windows 10.0.15.063)
system.platformPlatform of the system (e.g. windows, linux)
system.runtime.descriptionThe system's runtime (e.g. .NET Core 4.6)
system.timezoneTimezone of the system
system.usernameThe system account that DataHub is running under
system.disk.reads_per_secNumber of disk reads per second for the entire system
system.disk.writes_per_secNumber of disk writes per second for the entire system
system.machineMachine name
system.domainWindows domain name of the running DataHub service
system.memory.availableAvailable system memory in MB
threadpool.io.availabledotnet io threads available
threadpool.io.maxdotnet io maximum threads
threadpool.io.mindotnet io minimum threads
threadpool.threads.availabledotnet total threads available
threadpool.threads.maxdotnet total maximum threads
threadpool.threads.mindotnet total minimum threads

Usage

These metrics are retrieved via a ReST request: GET <server-url>/v1/diagnostics/metrics. The request must include an appropriate Authorization header with a valid access token. An example response is found below.

GET <server-url>/v1/diagnostics/metrics

{
    "status": 200,
    "type": "metrics",
    "metrics": {
        "app.memory.usage": {
            "value": 97.59375,
            "type": "gauge"
        },
        "app.uptime": {
            "value": 39167.5232785,
            "type": "gauge"
        },
        "app.version.build": {
            "value": "4.6.0-beta-1063 Commit Hash: b2dbfdf31803453f5a03c8bb43d2cbab28172069",
            "type": "gauge"
        },
        "app.version.product": {
            "value": "4.6.0.0",
            "type": "gauge"
        },
        "box.{connection id}.http.requests": {
            "meter": {
                "count": 136,
                "rate": 0.0051535537437565528,
                "m1_rate": 1.1260504038622832e-189,
                "m5_rate": 9.1980350260578977e-39,
                "m15_rate": 1.4529239046915869e-13,
                "type": "meter"
            },
            "histogram": {
                "count": 136,
                "snapshot": {
                    "count": 136,
                    "min": 203225432,
                    "max": 1476048976,
                    "mean": 498919037.85847086,
                    "median": 300793311,
                    "p75": 680853931,
                    "p95": 1190582127,
                    "p98": 1211678637,
                    "p99": 1236081825,
                    "p999": 1265836889,
                    "stdev": 341938302.94874233
                },
                "type": "histogram"
            },
            "type": "timer"
        },
        "box.{connection id}.ratelimit.occurrences": {
            "count": 0,
            "type": "meter"
        },
        "box.{connection id}.ratelimit.pending": {
            "type": "count"
        },
        "box.{connection id}.ratelimit.rate": {
            "value": 60,
            "type": "gauge"
        },
        "box.{connection id}.ratelimit.wait": {
            "meter": {
                "count": 136,
                "rate": 0.0051535533699762727,
                "m1_rate": 1.1163292759278707e-189,
                "m5_rate": 7.9184134398180043e-39,
                "m15_rate": 1.0821435526848262e-13,
                "type": "meter"
            },
            "histogram": {
                "count": 136,
                "snapshot": {
                    "count": 136,
                    "min": 1095,
                    "max": 69851,
                    "mean": 7150.5801456794507,
                    "median": 4715,
                    "p75": 5847,
                    "p95": 29683,
                    "p98": 38126,
                    "p99": 49442,
                    "p999": 69851,
                    "stdev": 9829.6146137706874
                },
                "type": "histogram"
            },
            "type": "timer"
        },
        "box.{connection id}.http.requests": {
            "meter": {
                "count": 210,
                "rate": 0.0076622261953682219,
                "m1_rate": 0.032199190587865051,
                "m5_rate": 0.010458955318650896,
                "m15_rate": 0.0078161406344572342,
                "type": "meter"
            },
            "histogram": {
                "count": 210,
                "snapshot": {
                    "count": 210,
                    "min": 215483055,
                    "max": 2842707193,
                    "mean": 1032439009.9529421,
                    "median": 291179397,
                    "p75": 1816297017,
                    "p95": 1816297017,
                    "p98": 1816297017,
                    "p99": 1816297017,
                    "p999": 1816297017,
                    "stdev": 774733662.041534
                },
                "type": "histogram"
            },
            "type": "timer"
        },
        "box.{connection id}.ratelimit.occurrences": {
            "count": 0,
            "type": "meter"
        },
        "box.{connection id}.ratelimit.pending": {
            "type": "count"
        },
        "box.{connection id}.ratelimit.rate": {
            "value": 60,
            "type": "gauge"
        },
        "box.{connection id}.ratelimit.wait": {
            "meter": {
                "count": 305,
                "rate": 0.011128443424644691,
                "m1_rate": 0.047011533315858139,
                "m5_rate": 0.015602559550024511,
                "m15_rate": 0.011705046537463877,
                "type": "meter"
            },
            "histogram": {
                "count": 305,
                "snapshot": {
                    "count": 305,
                    "min": 1847,
                    "max": 3792837,
                    "mean": 4819.9955237655158,
                    "median": 5306,
                    "p75": 6092,
                    "p95": 6092,
                    "p98": 6092,
                    "p99": 6092,
                    "p999": 6092,
                    "stdev": 1268.5491625930044
                },
                "type": "histogram"
            },
            "type": "timer"
        },
        "google-drive.{connection id}.http.requests": {
            "meter": {
                "count": 351,
                "rate": 0.012816300933974239,
                "m1_rate": 0.045724280749918404,
                "m5_rate": 0.015516365882469959,
                "m15_rate": 0.011683570456496073,
                "type": "meter"
            },
            "histogram": {
                "count": 351,
                "snapshot": {
                    "count": 351,
                    "min": 37003364,
                    "max": 1453083128,
                    "mean": 308432612.63620812,
                    "median": 338808001,
                    "p75": 454964121,
                    "p95": 454964121,
                    "p98": 454964121,
                    "p99": 454964121,
                    "p999": 454964121,
                    "stdev": 131389000.53507341
                },
                "type": "histogram"
            },
            "type": "timer"
        },
        "google-drive.{connection id}.ratelimit.occurrences": {
            "count": 1,
            "rate": 0.000036514305100235139,
            "m1_rate": 5.9069316606361624e-198,
            "m5_rate": 2.7087023208375623e-42,
            "m15_rate": 1.036853071204758e-16,
            "type": "meter"
        },
        "google-drive.{connection id}.ratelimit.pending": {
            "type": "count"
        },
        "google-drive.{connection id}.ratelimit.rate": {
            "value": 60,
            "type": "gauge"
        },
        "google-drive.{connection id}.ratelimit.wait": {
            "meter": {
                "count": 445,
                "rate": 0.016248864910812344,
                "m1_rate": 0.059249487006776944,
                "m5_rate": 0.0205887388965166,
                "m15_rate": 0.015560077313509845,
                "type": "meter"
            },
            "histogram": {
                "count": 445,
                "snapshot": {
                    "count": 445,
                    "min": 1006,
                    "max": 20985,
                    "mean": 2861.8715448974531,
                    "median": 2512,
                    "p75": 3426,
                    "p95": 4474,
                    "p98": 4474,
                    "p99": 4474,
                    "p999": 4591,
                    "stdev": 1252.2712040101619
                },
                "type": "histogram"
            },
            "type": "timer"
        },
        "office365.{connection id}.batch.commit": {
            "meter": {
                "count": 1,
                "rate": 0.000038390946566568281,
                "m1_rate": 2.9173727189191532e-183,
                "m5_rate": 2.352270564841271e-39,
                "m15_rate": 9.8921922895568056e-16,
                "type": "meter"
            },
            "histogram": {
                "count": 1,
                "snapshot": {
                    "count": 1,
                    "min": 1073755937820,
                    "max": 1073755937820,
                    "mean": 1073755937820,
                    "median": 1073755937820,
                    "p75": 1073755937820,
                    "p95": 1073755937820,
                    "p98": 1073755937820,
                    "p99": 1073755937820,
                    "p999": 1073755937820
                },
                "type": "histogram"
            },
            "type": "timer"
        },
        "office365.{connection id}.http.requests": {
            "meter": {
                "count": 42,
                "rate": 0.0015916386915109677,
                "m1_rate": 5.1423706297766666e-182,
                "m5_rate": 5.5884227063427459e-38,
                "m15_rate": 2.4760140691708318e-13,
                "type": "meter"
            },
            "histogram": {
                "count": 42,
                "snapshot": {
                    "count": 42,
                    "min": 197343527,
                    "max": 2516226389,
                    "mean": 1213808111.8443213,
                    "median": 1255110018,
                    "p75": 1346215292,
                    "p95": 1632429815,
                    "p98": 1633897667,
                    "p99": 1633897667,
                    "p999": 1633897667,
                    "stdev": 211664601.7833747
                },
                "type": "histogram"
            },
            "type": "timer"
        },
        "office365.{connection id}.https://skysyncdesktop.sharepoint.com.ratelimit.occurrences": {
            "count": 0,
            "type": "meter"
        },
        "office365.{connection id}.https://skysyncdesktop.sharepoint.com.ratelimit.pending": {
            "type": "count"
        },
        "office365.{connection id}.https://skysyncdesktop.sharepoint.com.ratelimit.rate": {
            "value": 60,
            "type": "gauge"
        },
        "office365.{connection id}.https://skysyncdesktop.sharepoint.com.ratelimit.wait": {
            "meter": {
                "count": 139,
                "rate": 0.0052674948835200056,
                "m1_rate": 5.0829983578023987e-182,
                "m5_rate": 5.975506033748941e-38,
                "m15_rate": 2.72269241196922e-13,
                "type": "meter"
            },
            "histogram": {
                "count": 139,
                "snapshot": {
                    "count": 139,
                    "min": 2292,
                    "max": 26928,
                    "mean": 5159.0636159517289,
                    "median": 5051,
                    "p75": 5468,
                    "p95": 6286,
                    "p98": 6286,
                    "p99": 6286,
                    "p999": 6286,
                    "stdev": 432.29854592350313
                },
                "type": "histogram"
            },
            "type": "timer"
        },
        "system.cpu.arch": {
            "value": "x64",
            "type": "gauge"
        },
        "system.cpu.count": {
            "value": 2,
            "type": "gauge"
        },
        "system.domain": {
            "value": "A-DOMAIN-NAME",
            "type": "gauge"
        },
        "system.machine": {
            "value": "A-MACHINE-NAME",
            "type": "gauge"
        },
        "system.os.arch": {
            "value": "x64",
            "type": "gauge"
        },
        "system.os.description": {
            "value": "Linux 4.14.62-70.117.amzn2.x86_64 #1 SMP Fri Aug 10 20:14:53 UTC 2018",
            "type": "gauge"
        },
        "system.platform": {
            "value": "linux",
            "type": "gauge"
        },
        "system.runtime.description": {
            "value": ".NET Core 4.6.26725.06",
            "type": "gauge"
        },
        "system.timezone": {
            "value": "UTC",
            "type": "gauge"
        },
        "system.username": {
            "value": "root",
            "type": "gauge"
        },
        "threadpool.io.available": {
            "value": 1000,
            "type": "gauge"
        },
        "threadpool.io.max": {
            "value": 1000,
            "type": "gauge"
        },
        "threadpool.io.min": {
            "value": 2,
            "type": "gauge"
        },
        "threadpool.threads.available": {
            "value": 32763,
            "type": "gauge"
        },
        "threadpool.threads.max": {
            "value": 32767,
            "type": "gauge"
        },
        "threadpool.threads.min": {
            "value": 2,
            "type": "gauge"
        }
    }
}

GET {{url}}v1/diagnostics/system

{
    "status": 200,
    "item": {
        "app_product_version": "4.6.5.0",
        "app_build_version": "4.6.5 Commit Hash: 897208b845f02ad2a17bb04581f95d950c84e5c8",
        "system_platform": "linux",
        "system_time_zone": "UTC",
        "system_runtime_description": ".NET Core 4.6.26725.06",
        "system_os_architecture": "x64",
        "system_os_description": "Linux 4.14.62-70.117.amzn2.x86_64 #1 SMP Fri Aug 10 20:14:53 UTC 2018",
        "system_os_version": "4.14.62.70",
        "system_cpu_count": 2,
        "system_cpu_architecture": "x64",
        "process_memory_size": 529461248,
        "process_dot_net_gen_size": 237947768,
        "bytes_under_management": 36983021614,
        "bytes_under_management_by_job": [
            {
                "job_id": 6,
                "bytes": 367364
            },
            {
                "job_id": 7,
                "bytes": 4610
            },
........
...........
.............
        "jobs_count": 80,
            "jobs": [
                {
                    "source_platform": "box",
                    "destination_platform": "box",
                    "transfer_type": "copy",
                    "count": 3
                },
                {
                    "source_platform": "box",
                    "destination_platform": "dfb",
                    "transfer_type": "copy",
                    "count": 1
                },
.........
............
...............
        "nodes_count": 1,
        "connections_count": 11,
        "connections": [
            {
                "platform": "box",
                "count": 2
            },
            {
                "platform": "dfb",
                "count": 3
            },
.........
............
...............
    "license_key": "bbbbbbb-0000-0000-0000-cc9a375813ea",
        "license_uuid_activation": "BBBD5A0FFFFA4B10A2FCBAB0CCCCCCC"
    }
}


{
    "status": 200,
    "type": "metrics",
    "metrics": {
        "app.cpu.usage": {
            "value": 2.1914459681605569,
            "type": "gauge"
        },
        "app.disk.reads_per_sec": {
            "value": 0.0018906539346250537,
            "type": "gauge"
        },
        "app.disk.writes_per_sec": {
            "value": 0.0018992652610085752,
            "type": "gauge"
        },
        "app.memory.usage": {
            "value": 170.578125,
            "type": "gauge"
        },
        "app.uptime": {
            "value": 226.34152749999998,
            "type": "gauge"
        },
        "app.version.build": {
            "value": "4.0.0.1601-beta-f8f1fab594323c5111a7882eb20c748ef8cabf79",
            "type": "gauge"
        },
        "app.version.product": {
            "value": "4.0.0.1601",
            "type": "gauge"
        },
        "system.cpu.arch": {
            "value": "x64",
            "type": "gauge"
        },
        "system.cpu.count": {
            "value": 8,
            "type": "gauge"
        },
        "system.cpu.usage": {
            "value": 47.398514566849862,
            "type": "gauge"
        },
        "system.disk.reads_per_sec": {
            "value": 0.071384684440680315,
            "type": "gauge"
        },
        "system.disk.writes_per_sec": {
            "value": 0.23684547197398689,
            "type": "gauge"
        },
        "system.machine": {
            "value": "A-MACHINE-NAME",
            "type": "gauge"
        },
        "system.memory.available": {
            "value": 1909,
            "type": "gauge"
        },
        "system.os.arch": {
            "value": "x64",
            "type": "gauge"
        },
        "system.os.description": {
            "value": "Microsoft Windows 10.0.15063 ",
            "type": "gauge"
        },
        "system.platform": {
            "value": "windows",
            "type": "gauge"
        },
        "system.runtime.description": {
            "value": ".NET Core 4.6.25211.01",
            "type": "gauge"
        },
        "system.timezone": {
            "value": "(UTC-07:00) Mountain Time (US & Canada)",
            "type": "gauge"
        },
        "system.username": {
            "value": "ausername",
            "type": "gauge"
        }
    }
}

Monitoring using Prometheus

{{url}}v1/diagnostics/metrics/prometheus

Powered by Zendesk