# How to Measure the Impact of Generative AI With LinearB | LinearB Blog

> Measure the engineering impact of adopting generative AI tools.

_This is a markdown rendering of a live HTML page on linearb.io, generated for AI/LLM consumption — it is not a markdown-only site. To get the full HTML page instead, request this URL with an explicit `Accept: text/html` header (no wildcard, no markdown preference)._

[Blog](https://linearb.io/blog)

/

How to Measure the Impact of Generative AI With LinearB

# How to Measure the Impact of Generative AI With LinearB

![Photo of Ben Lloyd Pearson](https://assets.linearb.io/image/upload/c_limit,w_2560/f_auto/q_auto/v1/blp_headshot_1_ee25d527aa?_a=BAVMn6ID0)

By [Ben Lloyd Pearson](https://linearb.io/blog/measure-generative-ai-impact#ben-lloyd-pearson)

|

January 23, 2024

![How_to_Measure_the_Impact_of_Generative_AI_2025_25b6231c98](https://assets.linearb.io/image/upload/c_limit,w_2560/f_auto/q_auto/v1/How_to_Measure_the_Impact_of_Generative_AI_2025_25b6231c98?_a=BAVMn6ID0)

By the end of 2024, Generative AI is projected to generate [20% of all code](https://blog.metamirror.io/20-of-code-in-2024-will-be-written-by-genai-8cb309a0f42c) – or 1 in every 5 lines. 

Nearly every engineering team is thinking about how to implement GenAI into their processes, with many already investing in tools like Copilot, CodeWhisperer or Tabnine to kickstart this initiative. 

In fact, our recent [GenAI Code Report](https://linearb.io/resources/measuring-impact-the-genai-code-report) revealed that 87% of participants are likely or highly likely to invest in a GenAI coding tool in 2024.

![gen-ai-adoption-survey.jpg](https://assets.linearb.io/image/upload/v1720000000/gen_ai_adoption_survey_8137df9c30.jpg)

As with any new tech rollout, the next question quickly becomes: how do we measure the impact of this investment? It’s every engineering leader’s responsibility to their board, executive team, and developers alike to zero in on an answer and report their findings. 

LinearB’s approach to measuring the impact of GenAI code starts with PR labels. Every pull request that includes GenAI code is labeled, allowing metric tracking for this type of work. From there, you can compare success metrics against the unlabeled PRs.

To help you get started, we put together the following quickstart guide:

1. Create a LinearB Account and connect your git repos.
2. Install gitStream to your git organization, and auto-apply labels to indicate PRs supported with generative AI tools.
3. Use your LinearB dashboard to measure and track the impact of generative AI initiatives.

This guide will take about 10 minutes to complete. Let’s get started!

## Step 1: Create A LinearB Account

If you don’t already have a LinearB account, you first need to [create one](https://app.linearb.io/sign-up). As part of the onboarding process, you’ll need to connect LinearB to your git repos so it can begin to track your metrics. If you don’t have administrative permissions for your git repositories, it would be a good idea to plan ahead by contacting the appropriate individuals at your organization. You’ll also need these privileges in the next step, so it might be easier to batch these requests.

Once you’ve connected LinearB to your git repositories, your dashboard will populate with data. If you want, you can also take this moment to connect LinearB to your project management solution to get all your metrics, but it isn’t necessary to follow this guide.

## Step 2: Setup gitStream

Now that you have LinearB set to track your metrics, it’s time to set up gitStream to handle workflow automations. [gitStream](https://docs.gitstream.cm/) is a workflow automation tool for code repositories that enables you to handle a wide range of tasks automatically via YAML configurations and JavaScript plugins. In this guide, gitStream serves the role of automatically labeling PRs that are supported by generative AI tools so you can filter them inside LinearB.

Like LinearB, gitStream is also a GitHub and GitLab app, so you’ll need someone with admin privileges on your git repos to install it. Head over to the docs to find [installation instructions](https://docs.gitstream.cm/) for GitHub and GitLab. We recommend installing the gen AI gitStream automations at the organization level to ensure they are applied consistently. With gitStream installed, you have three options for tracking generative AI usage: based on a list of known users, PR tags, or using prompts in GitHub comments.

![label-copilot-by-contributors.png](https://assets.linearb.io/image/upload/v1720000000/label_copilot_by_contributors_daab0f1d73.png)

For this guide, we’ll show how to do things for GitHub Copilot, but you can easily adapt these examples to other generative AI tools. To use any of the examples in this guide, create a new CM file inside cm repo for your organization (if you installed at the organization-level) and copy/paste the configurations you want from this guide into that file.

### Label Based on Known User List

If you have an opt-in program for developers to adopt generative AI tools, a good solution to track the impact is to label based on the list of opted-in users. The following automation example shows how to use a pre-determined list to automatically label PRs based on whether the author has adopted generative AI tools.

```yaml
# -*- mode: yaml -*-

manifest:
  version: 1.0

automations:
  label_genai:
    # For all PRs authored by someone who is specified in the genai_contributors list
    if:
      - {{ pr.author | match(list=genai_contributors) | some  }}
    # Apply a label indicating the user has adopted Copilot
    run:
      - action: add-label@v1
        args:
          label: '🤖 Copilot'

genai_contributors:
  - username1
  - username2
  - etc
```

If you want to pull the list of opted-in generative AI users from a centralized source, you can leverage gitStream plugins to [connect to external data sources](https://docs.gitstream.cm/plugins/).

### Label Based on PR Tags

If your developers are less consistent with using generative AI tools, an option to track the impact of generative AI adoption is to include a special tag in the PR description or comment that informs gitStream that the PR author used generative AI support to write the code. For example, you could require developers to include a #copilot# tag in the PR description and use gitStream to detect the presence of the tag and automatically label the PR.

![label-copilot-by-tag.png](https://assets.linearb.io/image/upload/v1720000000/label_copilot_by_tag_6360f5b2d9.png)

```yaml
# -*- mode: yaml -*-

manifest:
  version: 1.0

automations:
  label_copilot:
    # Detect PRs that contain the text '#copilot#' in the title, description, comments, or commit messages
    if:
      - {{ copilot_tag.pr_title or copilot_tag.pr_desc or copilot_tag.pr_comments or copilot_tag.commit_messages  }}
    # Apply a label indicating the user has adopted Copilot
    run:
      - action: add-label@v1
        args:
          label: '🤖 Copilot'

copilot_tag:
  pr_title: {{ pr.title | includes(regex=r/#copilot#/) }}
  pr_desc: {{pr.description | includes(regex=r/#copilot#/) }}
  pr_comments: {{ pr.comments | map(attr='content') | match(regex=r/#copilot#/) | some }}
  commit_messages: {{ branch.commits.messages | match(regex=r/#copilot#/) | some }}
```

### Prompt Users to Indicate Generative AI Usage

One of gitStream’s best features is its ability to create complex, highly configurable automations that respond to the changing conditions of a PR. If the first two options for tracking generative AI contributions don’t work for you, you can create an automation to prompt the PR author via a comment that asks them to indicate whether they used generative AI to help make the code in the PR. gitStream will automatically apply the label if the user indicates yes.

![label-copilot-by-prompt.png](https://assets.linearb.io/image/upload/v1720000000/label_copilot_by_prompt_70fe9f9de1.png)

The comment prompt requires two separate automations. The first creates the comment with the prompt, and the second labels the PR when someone indicates they used generative AI. You'll need to create separate CM files for each because they have different execution triggers.

```yaml
-*- mode: yaml -*-

manifest:
  version: 1.0

on:
  - pr_created

automations:
  comment_copilot_prompt:
    # Post a comment for all PRs to prompt the PR author to indicate whether they used Copilot to assist coding in this PR
    if:
      - true
    run:
      - action: add-comment@v1
        args:
          comment: |
            Please mark whether you used Copilot to assist coding in this PR

            - [ ] Copilot Assisted
            - [ ] Not Copilot Assisted
```

```yaml
-*- mode: yaml -*-

manifest:
  version: 1.0

on:
  - comment_added
  - commit
  - merge

automations:
  # You should use this automation in conjunction with comment_copilot_prompt.cm
  label_copilot_pr:
    # If the PR author has indicated that they used Copilot to assist coding in this PR, 
    # apply a label indicating the PR was supported by Copilot
    if:
      - {{ pr.comments | filter(attr='commenter', term='gitstream-cm') | filter (attr='content', regex=r/\- \[x\] Copilot Assisted/) | some}}
    run:
      - action: add-label@v1
        args:
          label: '🤖 Copilot'
```

## Step 3: Track Impact Over Time With Your LinearB Dashboard

Once gitStream labels your PRs, you can log into your dashboard and use the filter capability at the top of any metrics dashboard. This will show you the metrics for all of your developers using generative AI tools and enable you to easily compare their cycle time, deployment frequency, change failure rate, and more against the baseline of your entire organization.

![copilot-label-metrics.png](https://assets.linearb.io/image/upload/v1720000000/copilot_label_metrics_0f46b4632f.png)

## The Future of Initiative Tracking 

As exciting as it is to talk about the future of the software delivery landscape, the reality is that GenAI is likely just one initiative that you as an engineering leader have in flight right now. 

Your mind is probably also spinning about your developer experience initiative, your agile coaching initiative, your merge standards initiative, your test coverage initiative, your new CI pipeline initiative, etc, etc.

Universal label tracking with gitStream allows you to measure the impact of any initiative you’ve kicked off with your team. This way, you can answer questions like:

* What is the ROI on this new 3rd party tool we bought?
* Should we roll this agile coaching initiative out to the rest of the organization?
* Is changing up my CI pipeline allowing us to speed up our delivery? By how much?

Advocating for more headcount or even for another funding round is much more effective when you can point to a dashboard with tangible engineering results that you can trace back to any given initiative, GenAI or otherwise. 

LinearB metrics and workflow automation have already saved developers thousands of hours, with the average repo seeing a 61% decrease in Cycle Time. 

You can start tracking the impact of your GenAI initiative today with a free forever account! [Click here to schedule a personalized demo](https://linearb.io/book-a-demo).

## Improve developer productivity with LinearB

Find us on

[](https://www.linkedin.com/company/linearb)
[](https://devinterrupted.substack.com/)

![blp_headshot_1_ee25d527aa](https://assets.linearb.io/image/upload/c_limit,w_2560/f_auto/q_auto/v1/blp_headshot_1_ee25d527aa?_a=BAVMn6ID0)

## Ben Lloyd Pearson

Ben hosts Dev Interrupted, a podcast and newsletter for engineering leaders, and is Director of DevEx Strategy at LinearB. Ben has spent the last decade working in platform engineering and developer advocacy to help teams improve workflows, foster internal and external communities, and deliver better developer experiences.

### Connect with

[](https://www.linkedin.com/in/benlloydpearson)
[](https://substack.com/@benlloydpearson)

## Your next read

[![Cover image for Slack turns channels into the context engine for agentic AI](https://assets.linearb.io/image/upload/c_limit,w_2560/f_auto/q_auto/v1/Blog_Post_Name_2400x1256_077524ba8b?_a=BAVMn6ID0)](https://linearb.io/blog/slack-jaime-delanghe-mcp-agent-context-channels)

Workflow

[Slack turns channels into the context engine for agentic AI](https://linearb.io/blog/slack-jaime-delanghe-mcp-agent-context-channels)

Slack Chief Product Officer Jaime DeLanghe breaks down how channels serve as the foundational context layer for human-agent collaboration. Learn why Slack is...

[![Cover image for Code generation is faster than ever, but shipping value isn't](https://assets.linearb.io/image/upload/c_limit,w_2560/f_auto/q_auto/v1/Blog_AI_code_review_bottleneck_2400x1256_d73333ea46?_a=BAVMn6ID0)](https://linearb.io/blog/code-generation-faster-shipping-isnt)

Workflow

[Code generation is faster than ever, but shipping value isn't](https://linearb.io/blog/code-generation-faster-shipping-isnt)

Your team writes more code than ever, but less reaches production. AI moved the bottleneck to code review. Here's how to measure it and unblock your pipeline.&n...

[![Cover image for AI as a value multiplier: a human-centric approach to engineering leadership](https://assets.linearb.io/image/upload/c_limit,w_2560/f_auto/q_auto/v1/Blog_Servant_Leadership_2400x1256_0cfd4e2a0c?_a=BAVMn6ID0)](https://linearb.io/blog/ai-as-value-multiplier-human-centric-leadership)

Workflow

[AI as a value multiplier: a human-centric approach to engineering leadership](https://linearb.io/blog/ai-as-value-multiplier-human-centric-leadership)

Super.com's Matt Culver explains why AI should be used as a value multiplier, not a cost-cutter, advocating for a human-centric approach to engineering...

## Structured data

_Machine-readable metadata (JSON-LD) embedded in the page for search/AI context — not content rendered on the page itself._

```json
{
  "@context": "https://schema.org",
  "@type": "Organization",
  "name": "LinearB",
  "url": "https://linearb.io",
  "logo": "https://assets.linearb.io/image/upload/v1715628027/logo-mark-lg.svg",
  "description": "LinearB is the engineering productivity platform that helps engineering leaders prove AI is improving throughput without sacrificing delivery confidence, flow efficiency, or developer experience.",
  "sameAs": [
    "https://www.linkedin.com/company/linearb"
  ],
  "award": [
    {
      "@type": "Award",
      "name": "LinearB is a Leader in the 2026 Gartner® Magic Quadrant™ for Developer Productivity Insight Platforms",
      "dateAwarded": "2026",
      "awardedBy": {
        "@type": "Organization",
        "name": "Gartner®"
      }
    },
    {
      "@type": "Award",
      "name": "Great Place to Work Certification",
      "dateAwarded": "2025-2027",
      "awardedBy": {
        "@type": "Organization",
        "name": "Great Place to Work"
      }
    },
    {
      "@type": "Award",
      "name": "America's Best Startup Employers 2025",
      "dateAwarded": "2025",
      "awardedBy": {
        "@type": "Organization",
        "name": "Forbes Magazine"
      }
    }
  ],
  "hasCertification": [
    {
      "@type": "Certification",
      "name": "SOC 1 Type 2"
    },
    {
      "@type": "Certification",
      "name": "SOC 2 Type 2"
    },
    {
      "@type": "Certification",
      "name": "GDPR Compliance certification"
    },
    {
      "@type": "Certification",
      "name": "ISO 27001"
    }
  ]
}
```

```json
{
  "@context": "https://schema.org",
  "@type": "Article",
  "headline": "How to Measure the Impact of Generative AI With LinearB",
  "url": "https://linearb.io/blog/measure-generative-ai-impact",
  "author": {
    "@type": "Person",
    "name": "Ben Lloyd Pearson"
  },
  "datePublished": "2024-01-23T19:38:43.816Z",
  "dateModified": "2024-01-23T19:38:43.816Z",
  "image": "https://assets.linearb.io/image/upload/v1740003943/How_to_Measure_the_Impact_of_Generative_AI_2025_25b6231c98.png",
  "publisher": {
    "@type": "Organization",
    "name": "LinearB",
    "logo": "https://assets.linearb.io/image/upload/v1777485755/linearb-logo-2026.png"
  },
  "description": "Measure the engineering impact of adopting generative AI tools."
}
```

## More on linearb.io

### Top navigation

- [Book a Demo](https://linearb.io/book-a-demo)
- [AI Code Reviews — Catch security risks, bugs, and spec mismatches](https://linearb.io/platform/ai-code-reviews)
- [AI & Productivity Insights — See how AI tools affect cycle time and delivery speed](https://linearb.io/platform/ai-developer-productivity-insights)
- [Measure AI Impact — Track AI adoption and tie it to delivery outcomes](https://linearb.io/use-case/measure-ai-impact)
- [MCP Server — Chat with your data to spot patterns and boost output](https://linearb.io/platform/mcp-server)
- [Resource Allocation — Cost initiatives and shape your investment strategy](https://linearb.io/platform/resource-allocation)
- [Cost Capitalization — Capitalize engineering costs with audit-ready reports](https://linearb.io/platform/cost-capitalization)
- [Dev Team Management — Set targets and tie throughput to business outcomes](https://linearb.io/platform/goals-and-reporting)
- [DevOps Workflow Automation — Policy-based PR routing, approvals, and tests](https://linearb.io/platform/ai-workflow-governance)
- [AI Powered Support — Unify AI and human code delivery in one clear view](https://linearb.io/use-case/ai-powered-support)
- [Optimization — Surface friction with feedback and MCP insights](https://linearb.io/platform/developer-experience)
- [Reporting — Spot what's working and what needs attention](https://linearb.io/use-case/measuring-developer-experience)
- [Surveys — Turn developer feedback into actionable signals](https://linearb.io/platform/developer-surveys)
- [Platform overview](https://linearb.io/platform/overview)
- [Register now](https://linearb.io/event/engineering-productivity-gap)
- [Customers](https://linearb.io/customers)
- [Pricing](https://linearb.io/pricing)
- [Why choose LinearB — Explore your data. Measure performance. Act to improve it.](https://linearb.io/why-linearb)
- [APEX framework — The operating model for AI-era engineering teams](https://linearb.io/resources/apex-framework)
- [Anti-FAQ — The questions other vendors won't answer](https://linearb.io/why-linearb/anti-faq)
- [Security — Enterprise-grade compliance and zero code access](https://linearb.io/security)
- [Build vs. buy — The hidden cost of building it yourself](https://linearb.io/resources/build-vs-buy)
- [Dev Interrupted Podcast — Conversations with engineering leaders](https://linearb.io/dev-interrupted/podcasts)
- [Reports & Guides — Deep dives on productivity and delivery](https://linearb.io/resources)
- [Webinars — Expert sessions on productivity and AI](https://linearb.io/resources?category=workshops)
- [Metrics Benchmarks — See how your engineering org stacks up](https://linearb.io/resources/software-engineering-benchmarks-report)
- [Blog — Product updates and practical insights](https://linearb.io/blog)
- [Help Center — Documentation, setup, and support](https://linearb.helpdocs.io)
- [API Docs](https://docs.linearb.io/api-overview)
- [Status](https://www.linearbstatus.com/)
- [Integrations](https://linearb.io/integrations)
- [LinearB is a Leader in the 2026 Gartner® Magic Quadrant™ for Developer Productivity Insight Platforms](https://linearb.io/resources/gartner-magic-quadrant-dpi-platforms-2026)
- [Sign in](https://app.linearb.io/login)
- [Enterprise](https://linearb.io/solutions/enterprise)
- [Contact](https://linearb.io/contact-us)
- [About us](https://linearb.io/about-us)
- [Careers](https://linearb.io/careers)
- [Service agreement](https://linearb.io/services-agreement)
- [Privacy policy](https://linearb.io/privacy-policy)
- [DPA](https://linearb.io/data-processing-agreement)
- [Security FAQ](https://linearb.io/security-faq)
- [Substack](https://devinterrupted.substack.com/)

### Footer

_Additional links from the site footer, not repeated from the top navigation above._

- [GitHub](https://github.com/linear-b)
- [LinkedIn](https://www.linkedin.com/company/linearb)
- [Twitter](https://twitter.com/LinearB_Inc)