The Test Iteration Results page presents a single session results page (single session is defined as a single machine that executes a single iteration). This page offers rich and extensive set of graphs and KPIs (Key Performance Indicators) about the session’s streams. In addition, this page enables deep understanding of your application behavior and can help you debug it.
The Test Iteration Results page is composed of the following sections:
Session Summary Dashboard
The Session Summary Dashboard presents the following session’s main quality measurements:
- Call setup time – the time in seconds it takes to all WebRTC channels in the session to exceed 50% of the channels’ average bit-rate. For further information, refer to ‘Understand the test result’s ‘call setup time’ value’.
- Packet loss – The session’s packet loss percentage (divided to in and out channels).
- Effective bit-rate – The session’s effective bit-rate (divided to in and out channels).
Overview – Session Results Overview
This section presents session’s basic information such as session start time, duration, agent location and browser version.
It presents also session’s custom metrics values, if defined. For further information about test custom metrics, please refer to Custom metrics commands.
The Session Results Overview section presents additional information in the following tabs:
Warnings – list of errors and warnings encountered during the session execution. These errors and warnings are collected from the channels’ collected statistics, the agent’s browser’s logs and Nightwatch logs.
Media: Includes the screenshots that were taken during the session execution and other media files if collected (such as audio recording, if configured).
Logs: includes the browser’s log and the WebRTC internals dump.
browser_logs.json – click on this link to view the tested instance (machine’s) browser’s logs (same log messages you can see in the Chrome browser’s debug console). The browser logs includes also all log messages defined in the test script (when using the script command .rtcInfo). The test script’s log messages’ font color is blue.
webrtc_internals_dump.txt – the session’s WebRTC internals dump.
Nightwatch log – The script execution low level logs. Can be used to debug issues in the script.
Channels – Channels’ details
The channels details section includes all audio and video channels used in the WebRTC session. For every session, a session header will be presented with the following details:
a. Channel type – Audio or Video
b. Channel direction – In or Out
c. Channel ID
e. Average bit-rate
f. Status – Successful, Warnings or Failed channel
By clicking on the channel’s header, the channel details section will be opened / closed. The channel details section includes bandwidth, packets, jitter and round trip detailed information
Charts – Audio and Video charts
The audio and video charts provide detailed QoS information about all WebRTC channels in the session.
In the audio and video charts, the charts’ start time is the time when the first WebRTC channel was created.