Commit Graph

13 Commits

Author SHA1 Message Date
Ian Jennings
2c3dab6ee9
upgrade to v3.9.0 (#768) 2024-08-27 18:13:38 -07:00
Ian Jennings
d0c0a7fd96
upgrade to 3.6.5 (#726) 2024-07-22 18:10:38 -05:00
Ian Jennings
3d72e97831
WIP: TestDriver: Update to v3 (#690)
**Action Required:**
We've moved to an authenticated system and you must now provide an
authentication key within our script.

1. Create an account or log into https://app.dashcam.io. 
2. Copy the API key from https://app.dashcam.io/team. You must be the
team "owner"
3. Add the API key as `DASHCAM_API_KEY` within GitHub actions by
following the guide
[here](https://docs.github.com/en/actions/security-guides/using-secrets-in-github-actions).

This PR moves to our v3 system which includes

- Faster and more stable tests. Notice we're using a `yml` file to guide
the test rather than open prompts. This means the AI will follow the
same steps every time.
- Smarter AI. Better text matching, and more commands. We optimized how
the AI matches text and images, making it way faster and more
fault-tolerant.
- Better summaries. The AI will summarize the full test execution as
well as errors
- Assertions. We can now explicitly ask the AI to verify things on
screen
- Embedded tests. We can nest scripts for reusable components.

---------

Co-authored-by: orliesaurus <orliesaurus@users.noreply.github.com>
2024-07-02 14:38:05 -05:00
orliesaurus
cd15beba26
fix: yml formatting issues (#656)
looks like there were some issues to the yml format before that caused
the workflow to not run.
2024-05-21 16:02:30 -07:00
Ian Jennings
d07068c09d
TestDriver v2.12.12 (#655) 2024-05-08 11:10:17 -07:00
Ian Jennings
2772c76728
Upgrade TestDriver to v2.12.5 (#652) 2024-05-06 14:17:25 -07:00
orliesaurus
5afe233381
Introduce corepack dependency (#643)
This Pull Request introduces the corepack dependency, necessary for the
Testdriver infrastructure to run.

## Rationale:

Corepack enables faster installations and is required for `yarn`
By default, corepack is not installed on the testdriver infrastructure,
necessitating this addition.

## Benefits:

Allows better handling of `yarn` installation.

## Testing:
Local testing has confirmed successful corepack installation and
functionality within the testdriver infrastructure.
2024-05-02 16:08:31 -07:00
Evan Simkowitz
cd855762cd
Migrate package manager to Yarn Modern (#628)
We were using Yarn Classic. While this is not deprecated, Yarn is moving
in a different direction with Yarn Modern (read more
[here](https://yarnpkg.com/migration/overview)) and we should align with
that. The migration mainly requires rebuilding our lockfile. We will
still use `node_modules` for now, though in the future we may want to
adopt the new [Plug'n'Play model](https://yarnpkg.com/features/pnp).
2024-05-02 14:13:32 -07:00
Ian Jennings
397d4d7369
Update TestDriver to v2.11.2 (#640) 2024-05-02 12:54:45 -07:00
Ian Jennings
8cea209823
TestDriver.ai: Validate that overlapping text does not appear in UI (#528) 2024-04-30 16:43:27 -07:00
Ian Jennings
c53e0a99f6
TestDriver.ai: Add comments to PRs (#498) 2024-04-30 12:37:22 -07:00
Ian Jennings
22c5d224bd
TestDriver: Update to 2.9.4 (#607)
* update to 2.9.4

* move prerun to action file

* update v

* migrate prompt

* bunk update to trigger re-run
2024-04-26 11:11:30 -07:00
Ian Jennings
b8b4dc20f5
add initial testdriver config (#350)
* add initial testdriver config

* remove slack
2024-02-27 19:38:16 -08:00