How to Use the Traffic Viewer

How to use the Traffic Viewer in the Webscale Control Panel
Traffic Viewer overview

The Traffic Viewer enables you to drill down to specific logs based on their type and then step back to previous searches to investigate logs elsewhere. The viewer consists of three types of logs - the traffic logs, the pageview logs and the CSP logs. The viewer that acts as the wrapper for all three views is called the Logs Viewer. The respective viewers for the logs types are:

  • “Traffic Viewer” for the traffic Logs.
  • “Pageview Logs” for the pageview logs.
  • “CSP Reports” for the CSP logs.

You have the option to view logs in two formats: the detailed logs view or the grouped logs view. You can navigate through logs like pages in a book. Each logs view maintains the given settings and filters, even if you navigate to a new view. A new view is created every time you navigate from a logs view to a group view, or vice versa; this drill down pattern allows users to step in and out of particular log subsets. The back button is located on every view except the very first view to allow you to return to the previous view.

Logs Type Selection

You can select the logs type to see its viewer by clicking the 3 vertical dots present at the top of the page above the filter input. The vertical dots can be seen beside the text that lets you know the current viewer type.

Traffic Viewer Type Selector

Filter Builder

Filtering is a useful way to see only the data that you want displayed. For example, a filter allows you to match all or part of a log, or match specific parts of logs to other logs. With each view is paired the filter bar. When you transition to another view, the last view’s filter bar stays at the state you left it in. Obtain values from the records and add them to the filter without triggering a new view. Alternatively, take values from the summary table and trigger a new view that adds that value to the filter. For more detailed instructions, see Filter Building in the Traffic Viewer.

Time Selection

The time selection is independent of the logs views; in other words, whatever time you have selected persists from view to view. The time picker permits you to select any time range within the last month.

The available time ranges within the last month are shown below.

Traffic Viewer Time Selector

You can also provide your own start and end times within the last month by selecting the “Custom” option. A customized start time can be provided in the “From” input field and a customized end time can be provided in the “To” input field.

Traffic Viewer Custom Time Selector

You can compare logs in two time ranges within the last month. This can be achieved by either selecting the “Compare” option in the time picker dropdown or by selecting the “Custom” option in the dropdown followed by checking the “Compare To” box right below the “To” input field for the first time range.

Traffic Viewer Custom Time Selector

Graph

The graph plots data points for each log type or metric provided based on the time range selected. The x-axis represents the time period and the y-axis represents the metric.

Traffic Viewer Graph Overview

Metrics

The metrics and their meanings are described below for the corresponding data end points.

Metrics Explanation
Bytes In Per Second Bytes received by the Webscale proxy per second, including the HTTP request line and headers.
Bytes Out Per Second Bytes sent out by the Webscale proxy per second, including the headers.
Requests The total number of records for the corresponding logs type.
Requests per second Number of records for the corresponding logs type per second.
Page Load Time The time taken to load a page for an application when a pagespeed-based beacon was used.
Pageviews The total number of page loads for an application.
Active Requests The number of requests that were successfully processed.
Cluster Server Count The number of active servers across all clusters.
Rejected Requests The number of requests that were dropped and therefore not processed. There are two ways a request could be rejected:
  • The request was waiting to be processed for a time period that crossed the waiting threshold.
  • There were already too many requests waiting to be processed and so the new request coming in will not even be queued since the new request would cross the waiting limit and therefore be immediately dropped.
Static Server Count The number of active servers that are outside any cluster.
Suspended Requests The number of requests that are waiting to be processed. If the new incoming request crosses the limit to the number of active requests that can be processed in one batch, the request will be queued.

For the meanings of the metrics listed below, see Filter Building in the Traffic Viewer.

  • Bytes In
  • Bytes Out
  • Internal Latency (internal_transport_latency)
  • Queue Latency
  • Response Time (elapsed)
  • Server Latency
  • Threats
  • Traffic TTFB (ttfb)
  • DOM Content Loaded
  • DOM Interactive
  • Pageview Elapsed
  • First Contentful Paint
  • Largest Contentful Paint
  • Pageview TTFB
  • Ready State Interactive

Compare Time Ranges

When comparing time ranges, the graph is updated accordingly. For the single metric, there are two graph lines with each assigned a color to differentiate their data points for their respective time periods.

Traffic Viewer Graph with compare time

Compare Metrics

Metrics can be compared by selecting a metric in each of the two select dropdowns present right next to the “Graph” label below the filter input. When comparing metrics, the graph is updated accordingly. Two graph lines are plotted corresponding to the two metrics with each assigned a color to differentiate their data points. The metrics are placed on the left and right y-axes. The metric on the left y-axis corresponds to the metric selected in the first dropdown (from left to right) and the metric on the right y-axis corresponds to the metric selected in the second dropdown.

Traffic Viewer Graph while comparing metrics

Group Graph

In the group view, when the icon ( ) is clicked, the first five groups from the table have their data points plotted for the chosen metric and is displayed in the graph as five colored lines. You can also add a sixth group to the graph. The maximum number of groups you can view is six.

Traffic Viewer Group Graph

Graph Usability

The graph offers a couple of usability features - drag and hover.

Drag

You can click and drag the graph either to the left or right.

  • Clicking and dragging to the left sets your timerange forward.
  • Clicking and dragging to the right sets your timerange backwards.

Dragging to the left or right always maintains the same time period between start and end times.

Hover

You can either hover over a data point in the graph or over the graph legend.

  • Hovering over a data point displays a popover showing the values for the corresponding metrics.
  • The graph legend contains all the displayed metrics. It tells you what type of metric corresponds to which line on the time graph. Hovering over a legend metric point highlights the corresponding line in the graph.
Hovering over a Data Point in the Graph

Traffic Viewer Graph with Compare Hover
The popover displays the values for the corresponding metrics. The metrics are identified by the color of the graph line they’re associated with.

Hovering over an Item in the Graph Legend

Traffic Viewer Group Graph Legend Hover
Hovering over an item in the legend highlights the corresponding graph line.

Records View

Use the records view to inspect records on a more detailed and individual level. Access all available information about any specific record here.

Traffic Viewer records view

Toggle Visibility

Click the icon ( ) positioned to the right of the “Records” label above the table to display and hide the records.

Reference Tools

Click the “Reference Tools” button to view the list of address sets available in the account the application belongs to. Clicking on any address set will show you its details like its definition and its address entries. You can edit an address set provided you are an account admin and own the address set.

Download Records

Click the download button to download all of the logs that fit your current log request.

Columns Selector

You can display and hide columns in the logs table from the columns dropdown menu. Each logs type has its own list of columns and default columns to be displayed when you initially navigate to the associated view.

Traffic Viewer Columns Selector

These are the columns available in the traffic viewer with the selected columns being the default columns shown when you load the viewer:

Traffic Viewer columns selector

By default, records for only the delivery statuses 0, 14 and 16 are displayed. Whenever either one of the columns “Delivery Status”, “Cache Source” or “Url Map” is selected, records for all delivery statuses are displayed.

Pageview Logs Columns Selector

These are the columns available in the pageview viewer with the selected columns being the default columns shown when you load the viewer:

Pageviews Viewer columns selector

CSP Reports Columns Selector

These are the columns available in the csp reports with the selected columns being the default columns shown when you load the viewer:

CSP Reports Viewer columns selector

In all three logs types, the column selector dropdown has the 3 vertical dots present at the right of the dropdown header. Clicking on it provides options to show either all the columns or only the default ones.

Columns selector options

Group-by Selector

Group the logs by a selected metric from the group-by dropdown menu. Select a metric from this menu to trigger a drill-down and create a new group view.

Table Customization

The records table offers several customization options - sorting, resizing and reordering.

Sorting

Click a column header to order logs by that metric in ascending order; click again to reverse the sort order of the logs.

Column sorted in ascending order

Resizing

Hover column headers to make the column selection window visible. The window will provide a darker background color and a line at the head to indicate that the column can be resized.

Column selection when hovering over a column header

Then move the cursor towards the line at the end of the column header hover selection. Clicking and dragging the line will expand or shrink individual column widths.

Resize a column header

Reordering

Hover column headers to make the column selection window visible. The screenshot in the Resizing section above shows what the column selection window looks like. Then click and hold the mouse down to see the cursor change indicating that the column can be reordered. Then drag and drop the column header to reorder the column.

Resize a column header

Cell Options

Access cell options by either right-clicking the data cell or clicking the dropdown arrow that appears on cell hover.

Context menu cell options

There are several options accessible through this dropdown menu depending on the cell. These options are listed below.

Add to filter

Add a predicate to the current filter to only show records that have the cell’s value for its column.

Replace filter

Overwrite the predicate on the current filter to only show records that have the cell’s value for its column.

Add to Blacklist

Add an IP address to the blacklist from the records view. This option only shows up if the cell is an address. Clicking on this option adds the address to the address set that is being used as the application’s blacklist.

You get a confirmation of adding the address to the blacklist everytime this option is clicked. If the address is already in the whitelist, the address once added will also be in the blacklist. Before adding it to the blacklist, you get a confirmation that you want to add the address to the blacklist when it’s also in the whitelist even though the whitelist overrides the blacklisted addresses. Once confirmed, the address is added to the blacklist.

If the address is already in the blacklist, you no longer see the menu option “Add to Blacklist”. Instead this option is replaced with the option “Remove from Blacklist”. Clicking this option gives you a confirmation of the removal of the address. Once confirmed, the address is removed from the blacklist.

Add to Whitelist

Add an IP address to the whitelist from the records view. This option only shows up if the cell is an address. Clicking on this option adds the address to the address set that is being used as the application’s whitelist.

You get a confirmation of adding the address to the whitelist everytime this option is clicked. If the address is already in the blacklist, the address once added will also be in the whitelist. Before adding it to the whitelist, you get a confirmation that you want to add the address to the whitelist when it’s also in the blacklist. Once confirmed, the address is added to the whitelist.

If the address was already in the whitelist, you no longer see the menu option “Add to Whitelist”. Instead this option is replaced with the option “Remove from Whitelist”. Clicking this option gives you a confirmation of the removal of the address. Once confirmed, the address is removed from the whitelist.

Group by ______

Drill down to a new Group View with the cell value as the grouping metric.

Show Details

Show the view containing all details for that record entry. A double-click on a row will also show these details.

Here’s an example of an access log record’s details:

Record details

You can navigate to the next or previous record entry’s details by clicking the “Next” or “Previous” buttons respectively.

Copy ______

Copy the cell value to the clipboard.

Group View

Use the group view to get a broad analysis of logs. It provides an overview of all logs based on your selected group.

Traffic Viewer group, show logs

Back “Arrow” Button

Click the arrow button to navigate to the previous records view.

Toggle Visibility

Click the icon ( ) positioned to the right of the “Group” label above the table to display and hide the group logs.

Graph Group Button

Click the icon ( ) to the right of the visibility icon to apply a grouping to the graph. By default, the data points plotted in the grouped graph reflect the first five groups in the table.

Group Dropdown

Update the grouping metric without creating a new view by selecting the new field within the grouping dropdown.

Table Customization

The group table offers the same customization options as those in the records view - sorting, resizing and reordering.

Show Logs

Select the arrow to continue to drill down to a new “Records View” for the logs in that group. This action triggers the transition to a new records view and adds the grouping value to the filter, thus only showing the logs within that grouping item.

Aggregate Selector

The group table allows you to access more grouping analysis through the + aggregate selector menu button.

Group table columns selector

The columns that can be added are called aggregable columns. An aggregate column can be added by the following process:

  • Select an operator from the “Operator” dropdown.
  • Select an attribute from the “Attribute” dropdown.
  • Click the “Add” button.
  • More aggregate columns can be added by following steps 1-3.
  • Once you have all the columns needed to be displayed, click the “Apply” button.

An aggregate column can be removed from the view by the following process:

  • Click the icon ( ) next to the aggregate column label.
  • More aggregate columns can be removed from the view by clicking their respective trash icons.
  • Once you have all the columns needed to be removed from view, click the “Apply” button.

Operators

Aggregable columns are the numerical columns for each logs type.

Group table column operators selector

The operators and their respective meanings are described below:

Operator Explanation
Count The total number of requests served by the proxy for each of the groups.
Avg The average numerical value is computed from all the values in the aggregable column.
Max The maximum numerical value is computed from all the values in the aggregable column.
Min The minimum numerical value is computed from all the values in the aggregable column.
Sum The total numerical value is computed from all the values in the aggregable column.

Attributes

The aggregable attributes for each of the logs type is listed below. The CSP Report logs do not have any numerical columns and therefore have no aggregable columns. So the “+” button is absent in the group view for CSP logs.

Traffic Viewer Aggregable Attributes

These are the aggregable columns available in the group view for the traffic viewer:

Group table traffic viewer columns selector attributes

Pageview Logs Aggregable Attributes

These are the aggregable columns available in the group view for the pageviews viewer:

Group table pageviews columns selector attributes

Further Reading

Have questions not answered here? Please Contact Support to get more help.


Last modified April 9, 2020