P5 Factory

Production test, step by step.

Import a Python test suite and run it on any box in your fleet. Every step streams to the dashboard as it starts, passes, or fails, and every run is kept.

app.stoutdata.ai/factory

Boxes

	IP Address	Lager Version	Health
	100.96.12.41	0.49.0	Online
Main bring-up bench. nRF5340 target on a J-Link, UART console on an FT232H, rails on the LabJack. Heartbeat 35 seconds ago · Stout Online · bench-01.local · linux/arm64
	100.96.12.58	0.49.0	Online
	100.96.13.7	0.48.0	Online
GPIO and rail checks for the sensor node. The LabJack moves between this bench and bench-04. Heartbeat 41 seconds ago · Stout Online · bench-03.local · linux/amd64
	100.96.13.22	0.49.0	Online
	100.96.15.30	0.45.1	Offline
	100.96.13.61	0.47.1	Degraded
	100.96.14.9	0.49.0	Degraded

CI Metrics

Merges exercised on real hardware, firmware bugs caught, and per-test flake rates for each product, reported by the connected CI pipeline.

Merges checked on hardware

67 / 69

97% of announced merges

Real FW bugs caught

2 bench or harness, 1 ambiguous

Flaky failures

Reds explained by a retry or same-commit rerun

Infra runs

5 / 259

Runs where the connectivity pre-check failed

Merges not checked on hardware

A merge counts as checked when this product's suite ran tests on that exact commit after passing the connection pre-check, or on a push that included it. In All products, a merge that touches shared code is counted once for each product it triggers. Two pull requests merged in separate pushes seconds apart can show the first as not checked even though its code ran in the second's run.

Merged	Product	Repo	Branch	Commit
Sep 20, 2026, 02:14 PM	Gateway	fleet/firmware	main	d4e0b71826
Sep 11, 2026, 04:52 PM	Sensor node	fleet/firmware	release/1.4	8f1a2c9ed0

Real FW bugs caught

Failures that were resolved by a newer commit, where the test harness blamed the device, the failing commit changed firmware, and the fix changed firmware and not the test harness.

First failed	Product	Test	Box	Broke	Fixed by	Harness verdict	Status
2026-09-19	Gateway	power/brownout_recovery	bench-02	a3f81c2761 Debounce brown-out detector IRQ	9d02e4f553 Widen the brown-out debounce window	Device	Automatic
2026-09-12	Gateway	boot/banner_timeout	bench-01	51b7aa00e5 Move the boot banner after clock init	07adf1931b Print the banner before the PLL settles	Device	Automatic
2026-09-04	Sensor node	radio/link_reconnect	bench-04	7d3e5b8b89 Retune the PLL after each channel hop	90c1f3ae9d Wait for PLL lock before the first hop	Device	Automatic

First failed	Product	Test	Box	Commit	Why it is not counted	Status
2026-09-17	Gateway	io/gpio_loopback	bench-03	c81d203718	Harness verdict: bench or infrastructure	Automatic
2026-09-09	Sensor node	sensor/imu_selftest	bench-04	b62f0c491e	Fix touched harness paths	Automatic
2026-08-28	Sensor node	power/sleep_current	bench-01	6a8b0e5c6e	AmbiguousCommit under test did not touch firmware	Automatic

Flakiest tests

Product	Test	Boxes	Runs	Attempts	Failed	Pass on retry	Flake rate
Gateway	boot/banner_timeout	2	58	66	11	8	16.7%
Gateway	io/gpio_loopback	1	58	61	4	3	6.6%
Sensor node	radio/link_reconnect	2	40	44	5	4	11.4%
Sensor node	sensor/imu_selftest	1	40	41	2	1	4.9%

PR Reviewers

AI-generated hardware tests on every pull request. Configure one reviewer per repo, or several scoped by path prefix for a monorepo.

Awaiting approval1

Repository	PR	Plan	Status	Waiting
fleet/firmware	#482	Inject a 2 ms sag and a 40 us glitch on vbat-sense and expect exactly one latched brown-out event.	Needs approval	18 minutes ago

Repository	Status	AI provider	Rate limit	Approval	Last run	Awaiting
fleet/firmware	Enabled	Anthropic · claude-opus-5-5	10/hr	Required	Needs approval18 minutes ago	1
fleet/bootloader	Enabled	Anthropic · claude-sonnet-5	20/hr	Auto	Waiting for buildjust now	0
sensors/driver	Enabled	OpenAI-compatible · gpt-4.1	5/hr	Required	Skipped4 days ago	0
power/bms	Enabled	Anthropic · claude-sonnet-5	15/hr	Auto	Generatingjust now	0
radio/phy	Enabled	Anthropic · claude-opus-5-5	8/hr	Required	Passed5 hours ago	0
display/panel	Disabled	Anthropic · claude-haiku-4-5-20251001	30/hr	Auto	Passed5 days ago	0

Workbench

Drive a box's instruments directly from the dashboard.

Box

Arranged by S. Rivera

Supplysupply1Keithley_2281S · 1

CH1 ONCV

Voltage (V)

Range 0 to 30 V

Current limit (A)

Range 0 to 3 A

Over-voltage protection (V)

Over-current protection (A)

03.301V

Voltage

00.182A

Current

00.601W

Power

Protection

OCP00.800 AOVP03.600 V

Set

03.300 V · 00.500 A

Hardware max

30.000 V · 3.000 A

E-loadeload1Rigol_DL3021 · 1

Constant current (A)

Constant voltage (V)

Constant resistance (Ω)

Constant power (W)

USB hubAcroname 8Port8 ports

8/8 on

0usb1ON
1usb2ON
2usb3ON
3usb4ON
4usb5ON
5usb6ON
6usb7ON
7usb8ON

Debugdebug1J-Link_Plus · nRF5340_xxAA_APP

Target MCU: nRF5340_xxAA_APP

Firmware file (.hex, .elf, .bin)

No file selected

VerboseSkip eraseHalt after flash

UARTuart1FTDI_FT232H · /dev/ttyUSB0

Disconnected

Connect to start the serial console.

Thermocoupletherm-1

ChannelsLabJack T76 channels

AIN0adc1vbat sense--
AIN1adc23V3 rail--
AIN2adc31V8 rail--
DAC0dac1Sensor stimulus
DIO4boot-strapBoot mode strapLOW
DIO5reset-nLOW

Webcambench-camLogitech_4K_Pro · /dev/video0

Live · 12 fpsbench-cam

Factory

Automated hardware test suites

P5.1

Suites are just Python

A suite is a main.py plus supporting files. Import the bundle once and Stout reads the steps straight out of the source.

P5.2

Watch the run live

Step starts, passes, failures, and log lines stream to the run page as they happen.

P5.3

Any suite, any box

Run the same suite on a bring-up rig today and a production bench tomorrow.

P5.4

Pick the box at run time

Start a run and choose any online box. Stout dispatches the suite and streams the result back.

P5.5

Pass and fail across the fleet

See which suites pass and fail on which boxes, with timing and status for every run.

P5.6

History that sticks around

Every run keeps its step results and logs, so a failure on the line is a link, not a story.

Related capability

03.2Job Orchestration

All features

P0The Stout Dashboard

Bring a suite.

Book a demo and we will import one of your suites and run it on a live box.

Book a Demo See the whole dashboard