1 of 8

BSDCam 2018

Testing Working Group

2 of 8

Please help keeping notes

Link is on the wiki

3 of 8

Build (bootstrap) standard

  • -STABLE
  • -RELEASE
  • "LINT" kernel

4 of 8

12.0-RELEASE test plan

  • Test coverage

5 of 8

Revision metadata

  • Keeping too many history makes Jenkins slow
  • External metadata storage maps revision number to build status, link to artifacts, build logs, compiler warnings, etc.
  • Other features
    • JSON AP
    • Query interface?

6 of 8

Integration & tool

  • Binary selecting tool
  • Performance test
  • Test cases management tool

7 of 8

"testvm" enhancement

  • Run ddb scripts automatically on panic
    • Show backtrace

8 of 8

Artifacts

  • Artifacts.ci.freebsd.org
    • Space is large enough, but not unlimited
    • Keep sync with jobs/builds of ci.freebsd.org
  • External archive
    • Space is usually not a big issue
    • Other requirements?