---
title: "Aviation Software Evaluation Plan & Worksheet | FlightAtom"
description: "Plan a FlightAtom evaluation with representative inputs, a current-process baseline, product measures, deployment scope, and explicit acceptance criteria."
canonical: https://www.flightatom.com/resources/evaluation-guide.html
last_updated: 2026-10-11
publisher: FlightAtom
---

# A practical evaluation guide: Make the demonstration answer a buying question.

Choose a workflow, bring a representative example, and agree what a useful result looks like. Use the same inputs and review criteria to compare the product with your current process.

## Start with a baseline you can explain.

A credible comparison records how the work is done today, what the evaluation changes, and who reviews the result.

### Define the scenario

Describe the starting record, users, decision, and expected output. Include a difficult or incomplete example alongside the normal workflow.

### Record the current process

Measure the same task using the current tools. Keep preparation time, processing time, reviewer corrections, and data gaps visible.

### Agree acceptance in advance

Choose the measures, sample, pass criteria, reviewers, and permitted data. Record exceptions and the limits of the comparison.

## Keep the evaluation evidence in one record.

Use the same questions and scenario for each product. Record the evidence, result, and owner, then save a separate copy for each evaluation.

[Download the evaluation worksheet (Excel)](https://www.flightatom.com/resources/downloads/flightatom-airline-software-evaluation-worksheet.xlsx?v=82d8778fa694)

[Plan a product evaluation](https://www.flightatom.com/#contact)

## Measure the job the product is meant to do.

These are proposed evaluation measures. The website does not publish customer benchmarks or claim a measured improvement.

**Suggested measures for a product evaluation**

| Product | Representative input | What to measure against the baseline |
| --- | --- | --- |
| [DELPHI Ai](https://www.flightatom.com/products/delphi.html#evaluate) | Approved manuals with conflicting revisions and difficult or unanswerable questions. | Citation support; revision correctness; unsupported answers; time to verify. |
| [TRACE Ai](https://www.flightatom.com/products/trace.html#evaluate) | A representative closed case with permission to use its evidence. | Investigator preparation time; missing evidence; reviewer corrections. |
| [CREW Ai](https://www.flightatom.com/products/crew.html#evaluate) | A representative roster, current constraints, and a disruption scenario. | Planning time and solver runtime; uncovered duties; constraint violations; roster cost. |
| [AURORA Ai](https://www.flightatom.com/products/aurora.html#evaluate) | An occurrence, risk assessment, and corrective action from the same workflow. | Action preparation time; overdue actions; completeness of closure evidence. |
| [MENTHOR Ai](https://www.flightatom.com/products/menthor.html#evaluate) | A training requirement, a pilot record, an instructor assessment, and a representative FDM event export. | Record preparation time; time from a recurring event to an assigned course; overdue assignments; assessment completeness. |
| [HIRE Ai](https://www.flightatom.com/products/hire.html#evaluate) | Permissioned applications and assessments with an agreed reviewer rubric. | Review time; scoring agreement; errors by relevant applicant group. |
| [WORKSPACE](https://www.flightatom.com/products/workspace.html#evaluate) · Deployed per operator | Test accounts with different application grants, including one with no access. | Agreement between assigned access and visible cards; time for a change to appear; denied launches for removed access. |
| [FOLIO Ai](https://www.flightatom.com/products/folio.html#evaluate) | A complex DOCX manual and a representative change request. | Import corrections; revision cycle time; acknowledgment completion. |
| [FLIGHT Ai](https://www.flightatom.com/products/flight.html#evaluate) | Representative return documents and a held-out period of flight records. | Field accuracy; missing-data coverage; forecast error; reviewer correction time. |
| [PINAX Ai](https://www.flightatom.com/products/pinax.html#evaluate) | An operating period with a known source and a specific punctuality question. | Report preparation time; source coverage; agreement with independently calculated metrics. |
| [VISION Ai](https://www.flightatom.com/products/vision.html#evaluate) | An approved sample dataset, a reporting question, and the dashboard your team uses today. | Dashboard preparation time; agreement with reference calculations; reviewer corrections; report preparation time. |
| [EPHOR Ai](https://www.flightatom.com/products/ephor.html#evaluate) | A training session change and a document package with a revision. | Approval turnaround; revision queries; reconfirmation completeness. |
| [PHAROS Ai](https://www.flightatom.com/products/flightdata.html#evaluate) · In development | Synthetic fixtures and independent reference decodes for an agreed aircraft layout. | Decode agreement; event detection errors; data-quality coverage. |
| [CARE Ai](https://www.flightatom.com/products/customer-care.html#evaluate) · Operator activation | Approved airline guidance, a policy exception, and a caller asking for a person. | Answer support against approved sources; handoff completeness; queue wait; callback follow-up time. |
| [XENIA Ai](https://www.flightatom.com/products/xenia.html#evaluate) · Preview | Approved destination content and representative travel enquiries. | Enquiry completeness; handoff completion; answer usefulness. |

## Record what you are buying and operating.

Use the evaluation record to connect product fit with delivery responsibilities.

### Product and record ownership

Identify native capabilities, separately scoped products or services, retained systems, migration, and each authoritative record.

[Compare products](https://www.flightatom.com/platform.html#compare)

### Deployment and data

Record the WingLayer environment, provider data flows, access controls, recovery arrangements, export, and retention.

[Hosting, data, and support](https://www.flightatom.com/trust.html#deployment)

### Acceptance and support

Name the accepting roles and define rollout, user orientation, support hours, escalation, maintenance, and outstanding actions.

[How implementation works](https://www.flightatom.com/about.html#implementation)

## What a credible outcome report contains.

Use the same standard for an internal evaluation or a customer story approved for publication.

### Scope and conditions

State the workflow, data period, sample, deployed scope, source connections, and what was excluded.

### Observed results

Report baseline and evaluation measurements together, including errors, missing data, reviewer effort, and remaining limitations.

### Review and permission

Include the acceptance decision and responsible reviewers. Publish customer identities, comments, and results only with permission.

## See FlightAtom in action: Start with your workflow.

A focused walkthrough, with the people and decisions that matter to your team.

[Request a demo](https://www.flightatom.com/#contact)

---

Source: https://www.flightatom.com/resources/evaluation-guide.html
Contact FlightAtom: hello@flightatom.com · Request a demo: https://www.flightatom.com/#contact