How to Manage Audit Lists

The Manage Audit List page is where you build and maintain the question sets used to test the quality of AI responses to questions about your institution. An audit list is a curated collection of questions thatare used  so you can see if the AI is returning accurate, well-sourced answers. Running an audit against a list lets you spot knowledge gaps, score answer quality, and decide where new content (like Topic Cards) is needed.

You'll find this page under AI Training → Manage Audit Lists.

What's on the page

The page shows all of your account's audit lists as a set of cards. Each card displays:

• List name — the title you gave the list.
• Default badge — a blue Default label marks the system-generated starter list (see below).
• Description — your optional summary of what the list covers.
• Metadata — the number of questions in the list and the date it was created (e.g. "24 questions • Created Jun 3, 2026").
• Action icons on each card:
  • Edit (pencil) — open the list to change it.
  • Duplicate (copy) — create a copy of the list.
  • Delete (trash) — remove the list. This icon is not shown on the Default list, which can't be deleted.

At the top of the page you'll find the Create New List button. If you've never made a list, you'll instead see an empty-state message — "No audit lists created yet" — with a Create Your First List button.

The Default list

Every account has a Default list that is automatically populated with the standard, Halda-curated industry questions for your account. The Default list:

• Is marked with a blue Default badge.
• Cannot be deleted (you can still duplicate it to use as a starting point).

Question types you'll see

When building a list you'll choose from two kinds of questions:

• Halda Questions — industry-standard questions maintained by Halda and shared across all accounts in your industry. These carry an orange Halda Question badge and can't be deactivated by your account.
• Custom Questions — questions specific to your account, either created manually or imported via CSV. 

How to add a custom audit list

1. On the Manage Audit List page, click Create New List. The Create New Audit List screen opens.
2. Name the list in the List Name field (required) — for example, "Graduate Program Questions."
3. (Optional) Add a Description so teammates know the list's purpose.
4. Add questions using the two-column selector:
   • The left column, "All Available Questions," lists every question available to your account. Use the Search questions… box to filter, tick individual checkboxes, or use Select all / Add All to move questions in bulk.
   • The right column, "Selected Questions," shows everything currently in your list. Use Remove All or individual checkboxes to take questions back out.
   • A list must contain at least one question before it can be saved.
5. (Optional) Bulk-add via CSV. In the Upload Questions from CSV section, click Choose CSV file and select a .csv file that has a column headed question. After upload you'll see a confirmation such as "18 questions loaded (5 duplicates matched to existing)."  Halda automatically matches uploaded questions to existing ones so duplicates aren't created, and adds any genuinely new questions. You can click Remove to clear the CSV.
6. (Optional) Restrict by segment. In the Segments section, choose which customer segments these questions apply to. Use the Search segments… box to find them. If you leave this empty, all segments are included by default.
7. Click Create List to save. (This button stays disabled until you've entered a name and selected at least one question.)

How to edit an existing audit list

1. On the Manage Audit List page, click the Edit (pencil) icon on the list you want to change. The screen opens as Edit Audit List, pre-filled with the list's current values.
2. Change any of the following:
   • List Name
   • Description
   • Questions — add or remove questions using the same two-column selector and CSV upload described above.
   • Segments — adjust which segments the list is built to test.
3. Click Update List to save your changes.

Deleting a list

To remove a custom list, click the Delete (trash) icon on its card and confirm at the prompt "Are you sure you want to delete this audit list?"  The Default list has no delete icon and cannot be removed. While lists can be deleted, historical audit results are preserved.

What happens after you build a list

Once a list exists, you can run an audit against it from the AI Training / Audit view:

1. Click Start New Audit and pick the list you want to run.
2. Halda asks the AI search engine every question in the list (once per included segment) and records, for each one, whether it knew the answer, the response it gave, the sources it cited.
3. You then review the responses and rate them, which feeds back into training and surfaces gaps to address.

Audit results report two headline measures: a Knows Answer Score (how often the AI returned a correct answer) and a Review Score (based on your 1–5 star ratings of the responses).