Articles in this section

Impact Analysis

Impact Analysis connects organizational change to shifts in how employees work. Run A/B tests and before-and-after analyses to measure the impact of workplace programs (such as a reduction in force, a new hybrid work policy or a 4-day workweek), leadership changes, new technology and more.

Impact Analysis is available with the following ActivTrak packages: Productivity Optimization and the Workforce Management + Productivity Optimization Bundle.

To access Impact Analysis, navigate to Executive Summaries > Impact Analysis. Admins and Configurators have access by default. Admins can manage access for other User Roles on the Role Access page (Settings > Access > Role Access).

This dashboard is powered by Insights, which presents processed analytics with historical context. Data refreshes on a regular schedule rather than in real time, so it's best for spotting trends and comparing activity over time. For a complete explanation, see Understanding Live Data and Insights.

Tip: Add Impact Analysis to your Favorites for quick access.

Resources

New to ActivTrak, or looking for a quick refresher? Start with these resources.

Contents

When to use Impact Analysis

Impact Analysis compares the work habits of two groups of employees, or of the same group at two points in time. Use it to:

  • Compare productivity and utilization before and after a change, such as a reduction in force, a leadership change or a return-to-office policy
  • Run an A/B comparison between two locations, teams or days of the week
  • Check whether a new tool or technology is being adopted
  • Test whether a policy such as No-Meeting Fridays increases focus time, reduces screen time and lowers utilization
  • Compare how a pilot team works against a team that isn't part of the pilot

Impact Analysis shows what changed in how people work. It doesn't explain why. Pair the results with what you know about the change, and use best practices to make the comparison easier to trust.

Requirements

Before diving in, make sure the following are configured. Taking time to set these up correctly will ensure your data is accurate and your insights are meaningful.

  1. Groups (or Teams): Organize your users into teams or business units that reflect how your organization actually operates. Without well-structured groups, it's difficult to pinpoint productivity gaps or understand their impact at the department or team level. If you haven't set up groups yet — or need to update your existing ones — start with Group management before moving forward.
  2. Goals: Define the productivity benchmarks your groups are measured against. Setting goals at the group level lets you track performance trends, spot areas of concern, and quantify the gap between current and target productivity. Goals should reflect realistic expectations for each team's role and work patterns. Set productivity goals before digging into your data.
  1. Segments: Create Segments of the employees whose work habits you want to compare. You can define a Segment by work location, time period, days of the week and team. Without Segments, there’s nothing to compare. Create your Segments before running Impact Analysis.

Note: You can't add a newly created Team to a Segment until the next data refresh, which happens every 24 hours.

How Impact Analysis works

Every analysis starts with a Segment, a group of employees plus a window of time. You pick two Segments, called Segment A and Segment B, and the dashboard compares them on productivity, focus, workload and technology usage.

Two setups cover most questions. The first keeps the group the same and changes the time period. The second keeps the time period the same and changes the group.

Setup Keep the same Change Example
Before-and-after Teams, Location and Days of the week Time period Engineering in the 3 months before a leadership change and the 3 months after
A/B comparison Time period Location, Teams or Days of the week Office and Remote employees during the same quarter

Because Segments are saved, you can build them once and reuse them for as long as the comparison stays useful.

Creating and managing Segments

The first step in Impact Analysis is to create Segments of the employees whose work habits you want to compare. You can define a Segment by work location, time period, days of the week and team.

Creating Segments

  1. Navigate to Executive Summaries > Impact Analysis > Segments tab. Admins and Configurators can view, edit and delete existing Segments and create new ones. Power Users and Viewers with access to Impact Analysis can view the list of Segments but can't edit, delete or create them.
  2. To create a new Segment, click the teal Add segment button in the upper right corner of the page.
  3. In the new window, give the Segment a unique name, then select values for each field (described in the table below) to decide who is in the Segment.
  4. Click the teal Add segment button to complete the process.
Location All Locations, Office, Remote, Office/Remote or Unknown.
Time period A Start Date and an End Date for a specific time period. Leave the End Date blank and check No end date for an ongoing comparison.
Days of the week One or more days, Monday through Sunday.
Teams Specific teams or All Teams. The list is limited to your Viewable Groups.

Note: A new Segment appears in the Segments list right away, but you can't view it in Impact Analysis until the next data refresh. The same applies to edits. An edited Segment's data doesn't show in Impact Analysis until the next refresh.

Naming Segments

Choose names that say what the Segment covers, such as "Before Leadership Change" and "After Leadership Change" or "Office Q3" and "Remote Q3". Clear names make the Segment A and Segment B drop-downs easier to scan, especially once your account has a long list of Segments.

Default Segments

The Segments list includes two default Segments: Monday - Thursday and Friday. Select them in Impact Analysis to view sample data before you create your own. For example, you can assess whether No-Meeting Fridays increase focus time, reduce screen time and lead to lower utilization levels. Default Segments are view-only, so they show an eye icon instead of a pencil, and you can't modify or delete them.

Editing and deleting Segments

To edit a Segment, click the pencil icon to the right of it. To delete Segments, select the check box next to each Segment name, then click the Delete button above the list. You can delete one Segment at a time or several at once.

Navigating Impact Analysis

Impact Analysis has four tabs: Summary, Trends, Technology Usage and Segments. The first three show the comparison. The Segments tab is where you build the groups to compare.

Summary tab

Use the Summary tab for a side-by-side comparison of key productivity and utilization metrics for two Segments. It's the best place to start, because it shows the size of the difference before you look at how it developed over time.

Filter settings

Use the filters at the top of the page to change what you see:

  • Team: Show data for a subset of the teams in the Segments
  • Segment A: The first Segment to compare
  • Segment B: The second Segment to compare

Click More to see the following filters.

  • Day Type: Limit data to either weekday or weekend activity

Click the refresh icon ⟳ in the top right corner after making your filter selections to ensure they are applied to the dashboard.

Important: The Team filter works best when the Segments you compare include all, or most, of the teams in your account. If you select a team that isn't in Segment A or Segment B, the dashboard shows null values for the Segment that doesn't include it. See the Frequently asked questions below for more detail.

Productivity & Focus

Each card shows Segment A and Segment B with a comparison symbol (<, >, or =) between them. The letter for the Segment with the higher value is teal; remember that a higher value isn't always a better result. A higher share of overutilized users, for example, usually points to burnout risk. When the two values are equal, the card shows A = B, and neither letter is highlighted. Under each card, a small table lists the two values (A vs. B) and the Difference between them, in the same unit as the metric. 

This group compares the following four metrics for each Segment. Read them together. A Segment with more screen time and less focused time is working longer, not necessarily better.

  • Daily Screen Time compares how many hours per day each Segment spends on their computer or device. A higher value can point to longer workdays rather than better results.
  • Daily Productive Time compares the time each Segment spends on activity classified as productive. Check it alongside Screen Time to see how much of the day is productive.
  • % Daily Focused Time compares the percentage of productive time that is focused time.
  • Avg Focused Session (min) compares the average length of a focused session, in minutes. Longer sessions mean fewer interruptions between stretches of focused work.

Workload Balance & Wellness

Each card shows Segment A and Segment B with a comparison symbol (<, >, or =) between them. The letter for the Segment with the higher value is teal; remember that a higher value isn't always a better result. A higher share of overutilized users, for example, usually points to burnout risk. When the two values are equal, the card shows A = B, and neither letter is highlighted. Under each card, a small table lists the two values (A vs. B) and the Difference between them, in the same unit as the metric. 

This group shows how workload is distributed across each Segment.

  • The Overutilized, Healthy and Underutilized cards show the percentage of users in the Segment at each utilization level. A higher share of overutilized users usually signals burnout risk. A higher share of underutilized users can mean spare capacity or disengagement.
  • Daily Break Time compares average break time per day, in minutes.

Productive Time Breakdown & Work Day Span

The Productive Time Breakdown chart splits each Segment's Productive Hrs/Day into Focused Hrs/Day (orange), Collaboration Hrs/Day (light blue), and Multitasking Hrs/Day (magenta), shown as percentages on one bar per Segment. Use it to see whether a change shifted how people spend productive time, for example, from multitasking toward focused work.

The Work Day Span (Avg Start & End Day) chart shows the average Work Day Span for each Segment on a time-of-day axis, indicating Avg Start of Day and Avg End of Day. A bar that starts earlier, ends later or stretches longer shows how the workday shifted.

Trends tab

Use the Trends tab to see how each Segment's work habits change over time. You can view a daily, weekly, monthly or yearly breakdown. The tab is especially useful for a before-and-after analysis of a one-time event, such as a leadership change or a reduction in force.

Open More in the filters section to change what each chart shows and how it groups time. Use View Trends by to choose daily, weekly, monthly or yearly periods. Longer periods smooth out day-to-day swings, and shorter periods show exactly when a change started.

Filter settings

Use the filters at the top of the page to change what you see:

  • Team: Show data for a subset of the teams in the Segments
  • Segment A: The first Segment to compare
  • Segment B: The second Segment to compare

Click More to see the following filters.

  • Productivity Trend: Choose the metric to display in the Productivity Trend View - Screen Time (hrs/day), Productive Time (hrs/day), Focused Time (hrs/day), Collaborative Time (hrs/day), and Multitasking Time (hrs/day)
  • Utilization Level Trend: Choose the utilization metric to display in the Utilization Level Trend View - % Underutilized Users, % Healthy Users, and % Overutilized Users
  • View Trends by: Group the data in the trend charts by Day, Week, Month, or Year
  • Day Type: Limit data to either weekday or weekend activity

Click the refresh icon ⟳ in the top right corner after making your filter selections to ensure they are applied to the dashboard.

Important: The Team filter works best when the Segments you compare include all, or most, of the teams in your account. If you select a team that isn't in Segment A or Segment B, the dashboard shows null values for the Segment that doesn't include it. See the Frequently asked questions below for more detail.

Productivity Trend View

The Productivity Trend chart compares one metric for the two Segments over time, with a pair of bars for each period. To change the metric, the time period, or both:

  1. Click More in the filters at the top of the dashboard.
  2. Select a metric from the Productivity Trend drop-down.
  3. Select Day, Week, Month, or Year under View Trends by.

Available metrics: Screen Time (hrs/day), Productive Time (hrs/day), Focused Time (hrs/day), Collaborative Time (hrs/day), and Multitasking Time (hrs/day).

Look for the size of the gap between the two bars and whether it holds. A gap that appears once is worth noting. A gap that persists across many periods is a trend.

Utilization Level Trend View

The Utilization Level Trend chart shows how the percentage of healthy, overutilized, and underutilized employees in each Segment changes over time.

  1. Click More in the filters at the top of the dashboard.
  2. Select a metric from the Utilization Level Trend drop-down.
  3. Select Day, Week, Month, or Year under View Trends by.

Available metrics: % Underutilized Users, % Healthy Users, and % Overutilized Users.

Percentages can swing widely when a Segment has only a few users, because one person’s change moves the result noticeably. If the weekly bars look uneven, switch View Trends by to Month for a steadier view.

Technology Usage tab

Use the Technology Usage tab to compare website and application usage for the two Segments. The data can show whether a new technology is being adopted, or whether employees spend time in the tools critical to their roles.

Filter settings

Use the filters at the top of the page to change what you see:

  • Team: Show data for a subset of the teams in the Segments
  • Segment A: The first Segment to compare
  • Segment B: The second Segment to compare

Click More to see the following filters.

  • Category: Limit the chart to a single category. Leave it set to any value to include all categories.
  • Show Top N: Use the slider to choose how many items appear in the chart.
  • Day Type: Limit data to either weekday or weekend activity

Click the refresh icon ⟳ in the top right corner after making your filter selections to ensure they are applied to the dashboard.

Important: The Team filter works best when the Segments you compare include all, or most, of the teams in your account. If you select a team that isn't in Segment A or Segment B, the dashboard shows null values for the Segment that doesn't include it. See the Frequently asked questions below for more detail.

Category by Allocation %

The two Category by Allocation % charts rank the top categories for each Segment, with Segment A on the left and Segment B on the right. Compare the order and the percentages to see where each Segment's time goes.

Apps/Sites by Allocation %

The two Apps/Sites by Allocation % charts break the same comparison down to individual applications and websites. Each bar shows the allocation percentage, and a dot at the right edge of the row shows the number of Users in that Segment who used the application or site. Hover over a dot to see the application or site name and the user count.

Read allocation and users together. Allocation % shows how much of a Segment's time a tool takes up. The user count shows how many people use it. A tool with high allocation and a low user count is concentrated among a few people, while a tool with modest allocation across most of the Segment is broadly adopted.

Practical applications

Before-and-after analysis

To measure a one-time event, create two Segments with the same teams, locations and days but different time periods. Set the first time period to end when the event happened and the second to start after it. Compare them on the Summary tab, then open the Trends tab to see how the change developed. Leave the end date of the second Segment blank to keep the comparison running.

Example: Measure the effect of a leadership change on the Engineering team.

  1. Create a Segment named "Before Leadership Change" with Teams set to Engineering, Location set to All Locations, all days of the week, and a time period of 04/01/2026 to 06/30/2026.
  2. Create a second Segment named "After Leadership Change" with the same settings and a time period of 07/01/2026 to 09/30/2026.
  3. After the next data refresh, open the Summary tab and select the "before" Segment as Segment A and the "after" Segment as Segment B.
  4. Check the Difference values and the Work Day Span, then open the Trends tab to see whether the change was gradual or sudden.

A/B comparison

To compare two groups over the same period, create two Segments with the same time period but different Location or Teams. For example, compare Remote with Office, or one team with another, and check which Segment has the stronger focus metrics and the more balanced workload.

Example: Compare Office and Remote employees for one quarter.

  1. Create a Segment named "Office" with Location set to Office, and a second named "Remote" with Location set to Remote. Set both to the time period 07/01/2026 to 09/30/2026, all days and All Teams.
  2. After the next data refresh, select "Office" as Segment A and "Remote" as Segment B on the Summary tab.
  3. On the Summary tab, compare Daily Productive Time, % Daily Focused Time and the utilization cards, then open the Technology Usage tab to see which tools each group relies on.

Checking technology adoption

To see whether a new tool is taking hold, build a before-and-after pair around the rollout date, using the same teams in both Segments. On the Technology Usage tab, select the tool's category in the Category filter and raise the Show Top N slider until the tool appears. Compare its Allocation % and User count in Segment B with Segment A. If the tool is new, expect it to be missing or low in the "before" Segment.

Testing a policy with the default Segments

Select the default Monday - Thursday and Friday Segments as Segment A and Segment B to see whether a policy such as No-Meeting Fridays changes focus time, screen time and utilization. No setup is needed, which makes this a quick way to explore the dashboard.

Best practices

  • Compare equal time periods. Comparing a 3-month Segment with a 1-month Segment can skew averages. Use time periods of the same length.
  • Change one thing at a time. In a before-and-after comparison, keep Teams, Location and Days of the week identical. In an A/B comparison, keep the time period identical.
  • Leave room after a change. Habits often take a few weeks to settle, so consider starting the "after" time period a little after the event.
  • Watch Segment size. In a Segment of eight users, one user is 12.5%. Small groups produce large swings in percentages.
  • Account for the calendar. Holidays, quarter-end pushes and seasonal slowdowns can affect either Segment.
  • Read metrics together. Screen time, productive time, focus and utilization each tell part of the story.
  • Confirm on Trends. A difference on the Summary tab is stronger evidence when the Trends tab shows it holding across periods.

Frequently asked questions

Which User Roles can access Impact Analysis?

Admins and Configurators have access by default. Admins can manage access for other User Roles on the Role Access page (Settings > Access > Role Access).

  • Admins and Configurators can create, edit and delete Segments
  • Power Users and Viewers with access can view the Segments list but can’t create, edit, or delete Segments

Can I view historical data in Impact Analysis?

Yes. You can see user data from the date an agent was first deployed, or as far back as your data retention limits allow. Location data is the exception, because it follows the same limits as Productivity by Location.

If you create a Segment with a specific Location (for example, Remote) and a start date before location data is available, the dashboard returns no data for that Segment, because earlier locations report as Unknown. Segments set to All Locations don't have this issue.

How often does Impact Analysis data refresh?

Data refreshes every 24 hours. New and edited Segments show up in Impact Analysis, including the Segment A and Segment B drop-downs, after the next refresh. That’s typically the day after you create or edit them.

I created a Segment but can't find it in the Segment A or Segment B drop-down. Why?

The most likely reason is timing. New Segments appear in the drop-downs after the next data refresh. If it still doesn't show after a day, check these:

  • The Segment's time period is in the future
  • A team is selected in the Team filter, and the Segment doesn’t include that team or has no activity for it in the time period

Can I compare more than two Segments?

Impact Analysis compares two Segments at a time. To compare a third group, swap out one selection. Segments are saved, so you can switch back and forth without rebuilding them.

What does the Team filter do?

When a Segment includes several teams, the Team filter lets you focus on a subset. For example, if a change affects the whole organization, you can select only the teams in one department.

  • If you select a team that isn’t in Segment A or Segment B, the dashboard shows null values (0 for numbers, no results in charts) for the Segment that doesn’t include it. For example, if Segment A includes Sales and Marketing and Segment B includes only Marketing, selecting Sales shows values for Segment A and nulls for Segment B.
  • If a selected team has no activity during a Segment’s time period, that Segment doesn’t appear in the Segment A or Segment B drop-downs. The same applies to Segments with a future time period.
  • When you select a team, the Segment A and Segment B drop-downs show only Segments that include that team. This is a quick way to shorten the list if you only want to see your own team.

Does a difference between Segments mean the change caused it?

Not necessarily. Impact Analysis shows how work habits differ between two Segments, but it can’t identify the cause. Seasonality, staffing changes, and project deadlines can also affect the results. See the section on best practices for ways to make a comparison more reliable.

What are the Monday - Thursday and Friday Segments?

They’re default Segments added to every account, so you can see example data before you create your own. You can’t edit or delete them. The Monday - Thursday Segment includes users from all teams and locations on Monday through Thursday. The Friday Segment includes the same users on Fridays.

Learn more

Was this article helpful?
3 out of 3 found this helpful